00000001:02000400:0.0F:1789760374.206476:0:3118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789760393.243151:0:3339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789760395.039780:0:3401:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 430 MB/s 00000001:01000000:0.0:1789760395.289919:0:3401:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 951 MB/s 00000001:01000000:3.0:1789760395.539910:0:3401:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8791 MB/s 00000020:02000000:0.0:1789760396.462702:0:3430:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g082f77f 00000400:02000000:3.0:1789760397.189661:0:3445:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.138@tcp [8/256/0/180] 00008000:02000000:1.0F:1789760400.853235:0:3595:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789760463.289620:0:5852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789760472.511684:0:6446:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789760472.511690:0:6446:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789760472.511856:0:6446:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000437d5cd9 00000080:02000400:1.0:1789760472.511867:0:6446:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789760472.516983:0:6446:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789760472.516996:0:6446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789760472.517033:0:6446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000dbbb3e7c) 00000020:00000080:1.0:1789760472.517052:0:6446:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789760472.535297:0:6446:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789760472.535751:0:6446:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789760472.556388:0:6446:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789760472.556427:0:6446:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789760472.556449:0:6446:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789760472.556499:0:6446:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789760472.556527:0:6446:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789760472.557067:0:6446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789760472.557075:0:6446:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789760472.557085:0:6446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2b9a3a739856710 00000020:01000004:1.0:1789760472.557091:0:6446:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789760472.557096:0:6446:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789760472.557100:0:6446:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000437d5cd9 from MGS 00000020:01000004:1.0:1789760472.557104:0:6446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789760472.557124:0:6446:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000febbdec6) 00000020:00000080:1.0:1789760472.557133:0:6446:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789760472.557194:0:6446:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000437d5cd9 from MGS, refs=2 00080000:01000000:1.0:1789760472.557200:0:6446:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789760472.557207:0:6446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2b9a3a73985671e 00000100:00100000:1.0:1789760472.557297:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789760472.557432:0:6446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789760472.557438:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789760472.558079:0:6446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789760472.558091:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789760472.559013:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760472.559199:0:6446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789760472.559204:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789760472.559931:0:6446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789760472.559938:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789760472.560241:0:6446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789760472.560248:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789760472.561038:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760472.561042:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760472.561044:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760472.561304:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760472.561306:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760472.561308:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760472.561945:0:6446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789760472.566511:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789760472.813411:0:6446:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3166 MB/s 00000001:01000000:3.0:1789760473.062901:0:6446:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3671 MB/s 00000001:01000000:2.0:1789760473.313295:0:6446:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 611 MB/s 00000001:01000000:1.0:1789760473.563520:0:6446:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 683 MB/s 00080000:10000000:1.0:1789760473.576910:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1789760473.590964:0:6446:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789760473.590997:0:6446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789760473.591000:0:6446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789760473.594060:0:6456:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789760473.594286:0:6446:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789760473.594341:0:6446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789760473.594554:0:6446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789760473.594595:0:6446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789760473.594990:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760473.595149:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789760473.595155:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789760473.596460:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789760473.596469:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789760473.601890:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789760473.601903:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789760473.608777:0:6446:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789760473.608813:0:6446:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.138@tcp' 00000020:01000004:3.0:1789760473.608816:0:6446:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00010000:00010000:2.0:1789760473.608825:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789760473.608865:0:6446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.138@tcp (typ=mgc) 00000020:00000080:3.0:1789760473.608892:0:6446:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.138@tcp (000000003576cc9c) 00000020:00000080:3.0:1789760473.608907:0:6446:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789760473.609043:0:6446:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000015c26549@MGC192.168.203.138@tcp: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1789760473.609214:0:6446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.138@tcp-0 is initialized 00000040:01000000:3.0:1789760473.609219:0:6446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789760473.609393:0:6461:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789760473.620368:0:6462:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789760473.620501:0:6446:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.138@tcp (uuid 1c2ee86d-cc6e-4694-9302-8ec928b8d70f) 00000020:00000080:3.0:1789760473.620525:0:6446:0:(genops.c:1385:class_connect()) connect: client 1c2ee86d-cc6e-4694-9302-8ec928b8d70f, cookie 0xc2b9a3a73985672c 00000100:00080000:3.0:1789760473.620538:0:6446:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760473.620544:0:6446:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import 0000000015c26549 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1789760473.620588:0:6446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000439f8da0 x1876699798044800/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789760473.620607:0:6446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1c2ee86d-cc6e-4694-9302-8ec928b8d70f->MGS 00000020:01000004:3.0:1789760473.620624:0:6446:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789760473.620628:0:6446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789760473.620642:0:6446:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000046cbaee3) 00000020:00000080:3.0:1789760473.620653:0:6446:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789760473.624075:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000439f8da0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3460:1876699798044800:0@lo:250: 00000100:00100000:2.0:1789760473.624175:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760473.624257:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798044800 00000100:00100000:2.0:1789760473.624265:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798044800 00000100:00100000:2.0:1789760473.625409:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760473.625417:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c25233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3460:x1876699798044800:12345-0@lo:250: 00010000:00080000:2.0:1789760473.625445:0:6457:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1c2ee86d-cc6e-4694-9302-8ec928b8d70f@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:2.0:1789760473.625485:0:6457:0:(genops.c:1385:class_connect()) connect: client 1c2ee86d-cc6e-4694-9302-8ec928b8d70f, cookie 0xc2b9a3a73985673a 00000100:00080000:2.0:1789760473.625629:0:6457:0:(import.c:65:import_set_state_nolock()) 000000006d793917 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760473.625693:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c25233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:3460:x1876699798044800:12345-0@lo:250: Request processed in 275us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760473.625700:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760473.625752:0:3460:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789760473.625760:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1789760473.625768:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789760473.625773:0:3460:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789760473.625775:0:3460:0:(import.c:65:import_set_state_nolock()) 0000000015c26549 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789760473.625778:0:3460:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789760473.625821:0:3460:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789760473.625826:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000439f8da0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3460:1876699798044800:0@lo:250: 00000100:00100000:2.0:1789760473.651931:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760473.652330:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789760473.652336:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789760473.659547:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789760473.659562:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789760473.659999:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789760473.660005:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789760473.660668:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760473.662944:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789760473.662953:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789760473.663902:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789760473.663911:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789760473.734181:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760473.734403:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789760473.734409:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789760473.735736:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789760473.735747:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789760473.736379:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760473.736554:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789760473.736560:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789760473.737898:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789760473.737908:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789760473.738434:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760473.738602:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789760473.738607:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789760473.742635:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789760473.742647:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789760473.743818:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760473.744028:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789760473.744034:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789760473.745552:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789760473.745562:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789760473.776835:0:6446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760473.777425:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789760473.777431:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789760473.785216:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789760473.785230:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789760473.786539:0:6446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789760473.786550:0:6446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789760473.790612:0:6446:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789760473.790636:0:6446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789760473.790641:0:6446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789760473.790766:0:6446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789760473.791021:0:6446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789760473.791025:0:6446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789760473.791027:0:6446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789760473.791028:0:6446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760473.791029:0:6446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760473.791031:0:6446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760473.791032:0:6446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760473.791033:0:6446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789760473.791035:0:6446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789760473.791036:0:6446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760473.791037:0:6446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760473.791039:0:6446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760473.791040:0:6446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789760473.791042:0:6446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789760473.791045:0:6446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789760473.791046:0:6446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789760473.791047:0:6446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760473.791049:0:6446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760473.791050:0:6446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760473.791051:0:6446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760473.791052:0:6446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789760473.791053:0:6446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789760473.791054:0:6446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760473.791055:0:6446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760473.791056:0:6446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760473.791057:0:6446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789760473.791858:0:6446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789760473.791878:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f4dc5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798044928:0@lo:253: 00000100:00100000:3.0:1789760473.791978:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760473.792044:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024734a43 going to sleep for 11 seconds 00000100:00100000:1.0:1789760473.792563:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798044928 00000100:00100000:1.0:1789760473.792571:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798044928 00000100:00100000:1.0:1789760473.792615:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760473.792624:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adc6aa9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:6446:x1876699798044928:12345-0@lo:253: 20000000:01000000:1.0:1789760473.792671:0:6460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789760473.792687:0:6460:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789760473.793599:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789760473.793659:0:6460:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789760473.794050:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760473.795430:0:6482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789760473.795714:0:6460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789760473.795717:0:6460:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789760473.795723:0:6460:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789760473.795726:0:6460:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789760473.795929:0:6460:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789760473.796292:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760473.800853:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789760473.800883:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789760473.800955:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789760473.801006:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789760473.801047:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789760473.802011:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789760473.802025:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789760473.802112:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789760473.802123:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789760473.802158:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789760473.802165:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789760473.802272:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789760473.802327:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789760473.802375:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789760473.802380:0:6460:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789760473.802395:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760473.802761:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789760473.802771:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789760473.802972:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789760473.803015:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789760473.803067:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789760473.803080:0:6460:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789760473.803169:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789760473.803248:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789760473.803314:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789760473.803362:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789760473.803400:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789760473.803548:0:6460:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789760473.803643:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789760473.803652:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789760473.803686:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789760473.803723:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789760473.806045:0:6460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789760473.806128:0:6460:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789760473.806135:0:6460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789760473.807619:0:6483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789760473.808163:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789760473.808283:0:6460:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.138@tcp for mdt 20000000:01000000:1.0:1789760473.808285:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:1.0:1789760473.808326:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789760473.808335:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789760473.808363:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789760473.808369:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:1.0:1789760473.808569:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789760473.808583:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789760473.808624:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789760473.808662:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789760473.808733:0:6460:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789760473.808737:0:6460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789760473.808742:0:6460:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789760473.808747:0:6460:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789760473.809580:0:6484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1789760473.809719:0:6460:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789760473.831058:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789760473.831128:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1789760473.831204:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1789760473.831240:0:6460:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789760473.831243:0:6460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789760473.831247:0:6460:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789760473.831259:0:6460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789760473.831262:0:6460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789760473.831294:0:6460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789760473.831297:0:6460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789760473.834991:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789760473.842702:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789760473.842770:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789760473.842884:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1789760473.842903:0:6460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789760473.842905:0:6460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789760473.843677:0:6486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1789760473.844077:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1789760473.844133:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1789760473.844202:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1789760473.844218:0:6460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760473.844221:0:6460:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1789760473.844228:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789760473.844248:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844265:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844274:0:6460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844295:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844301:0:6460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844308:0:6460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844314:0:6460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000045a626c9 already unused, calling callback (0000000011508811) 00010000:00010000:0.0:1789760473.844318:0:6460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844326:0:6460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844339:0:6460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844346:0:6460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760473.844351:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045a626c9/0xc2b9a3a739856741 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789760473.844370:0:6460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789760474.098160:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adc6aa9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:6446:x1876699798044928:12345-0@lo:253: Request processed in 305530us (306173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760474.098174:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760474.098335:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f4dc5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798044928:0@lo:253: 10000000:01000000:3.0:1789760474.098352:0:6446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789760474.098355:0:6446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789760474.098357:0:6446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789760474.098358:0:6446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760474.098359:0:6446:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789760474.098361:0:6446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760474.098362:0:6446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760474.098364:0:6446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789760474.098365:0:6446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789760474.098366:0:6446:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789760474.098368:0:6446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760474.098369:0:6446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789760474.098390:0:6446:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000437d5cd9 from lustre-MDT0000 10000000:01000000:3.0:1789760474.098492:0:6446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789760474.098496:0:6446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789760474.098500:0:6446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97e550c219b8 10000000:01000000:3.0:1789760474.098504:0:6446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789760474.098512:0:6446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e550c219b8 from 1 10000000:01000000:3.0:1789760474.098514:0:6446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789760474.098556:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760474.098566:0:6446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760474.098575:0:6446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760474.098613:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f4dc5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045056:0@lo:101: 00000100:00100000:3.0:1789760474.098649:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760474.098747:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d225f43d going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.099006:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798045056 00000100:00100000:2.0:1789760474.099013:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798045056 00000100:00100000:3.0:1789760474.099177:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760474.099184:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000395948a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:6446:x1876699798045056:12345-0@lo:101: 00010000:00010000:3.0:1789760474.099207:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760474.099222:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856748 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760474.099246:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 6 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760474.099256:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 6 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760474.099265:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008685ba91, rc 0) 00000100:00100000:3.0:1789760474.099310:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000395948a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:6446:x1876699798045056:12345-0@lo:101: Request processed in 127us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760474.099317:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760474.099388:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f4dc5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045056:0@lo:101: 00010000:00010000:0.0:1789760474.099402:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.099425:0:6446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.099585:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045184:0@lo:501: 00000100:00100000:0.0:1789760474.099628:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.099657:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000151d2e19 going to sleep for 11 seconds 00000100:00100000:1.0:1789760474.099876:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798045184 00000100:00100000:1.0:1789760474.099892:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798045184 00000100:00100000:1.0:1789760474.099966:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760474.099974:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055531d91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:6446:x1876699798045184:12345-0@lo:501: 00000100:00100000:1.0:1789760474.100222:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055531d91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:6446:x1876699798045184:12345-0@lo:501: Request processed in 249us (594us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760474.100230:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760474.100298:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045184:0@lo:501: 10000000:01000000:0.0:1789760474.100325:0:6446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789760474.100347:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.100356:0:6446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760474.100364:0:6446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e546616000 10000000:01000000:0.0:1789760474.100369:0:6446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789760474.100373:0:6446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97e546616000 10000000:01000000:0.0:1789760474.100375:0:6446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789760474.100378:0:6446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97e546616000 from 1 10000000:01000000:0.0:1789760474.100380:0:6446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789760474.100401:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000045a626c9/0xc2b9a3a739856756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.100409:0:6446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000045a626c9/0xc2b9a3a739856756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.100417:0:6446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000045a626c9/0xc2b9a3a739856756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.100441:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045312:0@lo:101: 00000100:00100000:0.0:1789760474.100469:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.100720:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000151d2e19 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.100850:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798045312 00000100:00100000:2.0:1789760474.100857:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798045312 00000100:00100000:2.0:1789760474.100893:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760474.100900:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9413c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:6446:x1876699798045312:12345-0@lo:101: 00010000:00010000:2.0:1789760474.100909:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760474.100923:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001742b3f8/0xc2b9a3a73985675d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856756 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.100942:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001742b3f8/0xc2b9a3a73985675d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856756 expref: 7 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.100950:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001742b3f8/0xc2b9a3a73985675d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856756 expref: 7 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.100964:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001742b3f8, rc 0) 00000100:00100000:2.0:1789760474.101054:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9413c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+7:6446:x1876699798045312:12345-0@lo:101: Request processed in 155us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.101061:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760474.101617:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045312:0@lo:101: 00010000:00010000:0.0:1789760474.101633:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000045a626c9/0xc2b9a3a739856756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985675d expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.101641:0:6446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000045a626c9/0xc2b9a3a739856756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985675d expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760474.101658:0:6446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789760474.102121:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000045a626c9/0xc2b9a3a739856756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985675d expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.102130:0:6446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000045a626c9/0xc2b9a3a739856756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985675d expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760474.102210:0:6446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789760474.102217:0:6446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760474.102223:0:6446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97e546616000 10000000:01000000:0.0:1789760474.102226:0:6446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789760474.102229:0:6446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789760474.102231:0:6446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789760474.102256:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.102263:0:6446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.102285:0:6446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.102302:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045440:0@lo:101: 00000100:00100000:0.0:1789760474.102342:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.102424:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000151d2e19 going to sleep for 11 seconds 00000100:00100000:1.0:1789760474.104549:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798045440 00000100:00100000:1.0:1789760474.104564:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798045440 00000100:00100000:1.0:1789760474.104683:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760474.104692:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f441bcd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+7:6446:x1876699798045440:12345-0@lo:101: 00010000:00010000:1.0:1789760474.104710:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760474.104734:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856764 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760474.104846:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 8 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760474.104857:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 8 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760474.104897:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072106473, rc 0) 00000100:00100000:1.0:1789760474.104966:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f441bcd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+8:6446:x1876699798045440:12345-0@lo:101: Request processed in 275us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760474.104972:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760474.105114:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045440:0@lo:101: 00010000:00010000:0.0:1789760474.105133:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.105223:0:6446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.105287:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045568:0@lo:501: 00000100:00100000:0.0:1789760474.105320:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.105441:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000151d2e19 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.105607:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798045568 00000100:00100000:2.0:1789760474.105613:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798045568 00000100:00100000:2.0:1789760474.105640:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760474.105647:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b9c33a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+8:6446:x1876699798045568:12345-0@lo:501: 00000100:00100000:2.0:1789760474.105999:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b9c33a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6446:x1876699798045568:12345-0@lo:501: Request processed in 351us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.106007:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760474.106233:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045568:0@lo:501: 00000100:00100000:0.0:1789760474.106268:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045696:0@lo:503: 00000100:00100000:0.0:1789760474.106308:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.106337:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000151d2e19 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.106401:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798045696 00000100:00100000:2.0:1789760474.106407:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798045696 00000100:00100000:2.0:1789760474.106427:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760474.106432:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078033131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6446:x1876699798045696:12345-0@lo:503: 00000100:00100000:2.0:1789760474.106733:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078033131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6446:x1876699798045696:12345-0@lo:503: Request processed in 300us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.106740:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760474.107042:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798045696:0@lo:503: 00000100:00100000:1.0:1789760474.112166:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6727e3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6488:1876699798045824:0@lo:502: 00000100:00100000:1.0:1789760474.112246:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760474.112309:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000221a8f78 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.112453:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798045824 00000100:00100000:2.0:1789760474.112461:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798045824 00000100:00100000:2.0:1789760474.112520:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760474.112528:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e1dda7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6488:x1876699798045824:12345-0@lo:502: 00000100:00100000:2.0:1789760474.112952:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e1dda7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6488:x1876699798045824:12345-0@lo:502: Request processed in 224us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.112962:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760474.113963:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6727e3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6488:1876699798045824:0@lo:502: 00000020:01000000:0.0:1789760474.114557:0:6488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760474.114573:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760474.114575:0:6488:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789760474.114580:0:6488:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789760474.114593:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760474.114617:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000573e6fe0) 00000020:00000080:0.0:1789760474.114646:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789760474.114653:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789760474.115310:0:6488:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789760474.115320:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2b9a3a739856779 00000020:00000080:0.0:1789760474.116318:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789760474.116327:0:6488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760474.116344:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760474.116346:0:6488:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789760474.116349:0:6488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760474.116354:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760474.116355:0:6488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789760474.116359:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760474.116370:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f5765da0) 00000020:00000080:0.0:1789760474.116385:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789760474.116388:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789760474.116389:0:6488:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789760474.116448:0:6488:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789760474.116456:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789760474.116587:0:6488:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000437d5cd9 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789760474.116600:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000aeb99d19) 00000020:00000080:0.0:1789760474.116607:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789760474.116681:0:6488:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789760474.116687:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2b9a3a73985678e 00000020:00000080:0.0:1789760474.117074:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789760474.117080:0:6488:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789760474.117084:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc2b9a3a739856795 00080000:01000000:0.0:1789760474.117089:0:6488:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789760474.117093:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2b9a3a73985679c 00080000:10000000:0.0:1789760474.117741:0:6488:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789760474.129042:0:6488:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789760474.134444:0:6488:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789760474.296453:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789760474.296782:0:6488:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789760474.299936:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789760474.300225:0:6488:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789760474.337876:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000031fe70b9) 00000020:00000080:3.0:1789760474.337899:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789760474.337986:0:6488:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789760474.337993:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2b9a3a7398567aa 00000020:00000080:0.0:1789760474.339487:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789760474.342622:0:6488:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760474.396645:0:6488:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760474.478550:0:6488:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760474.573655:0:6488:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760474.624411:0:6488:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1789760474.633079:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789760474.670296:0:6488:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789760474.692263:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc2b9a3a7398567b1 00000020:00000080:2.0:1789760474.692431:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789760474.692443:0:6488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760474.692448:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760474.692450:0:6488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789760474.692452:0:6488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760474.692458:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760474.692459:0:6488:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789760474.692463:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789760474.692495:0:6488:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789760474.692507:0:6488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760474.692511:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760474.692512:0:6488:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789760474.692514:0:6488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760474.692516:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760474.692518:0:6488:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789760474.692520:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789760474.692522:0:6488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789760474.692569:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6488:1876699798045952:0@lo:502: 00000100:00100000:2.0:1789760474.692645:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760474.692694:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f34180b8 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.692715:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798045952 00000100:00100000:2.0:1789760474.692721:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798045952 00000100:00100000:2.0:1789760474.692757:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760474.692765:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b12225 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6488:x1876699798045952:12345-0@lo:502: 00000100:00100000:2.0:1789760474.693138:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b12225 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6488:x1876699798045952:12345-0@lo:502: Request processed in 373us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.693152:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760474.693205:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6488:1876699798045952:0@lo:502: 00000020:01000000:2.0:1789760474.693231:0:6488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760474.693236:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760474.693237:0:6488:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789760474.693240:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789760474.693623:0:6446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789760474.693647:0:6446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789760474.693703:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.693714:0:6446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760474.693722:0:6446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e546616000 from 1 10000000:01000000:0.0:1789760474.693725:0:6446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789760474.693894:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.693903:0:6446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.693914:0:6446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.693929:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046080:0@lo:101: 00000100:00100000:0.0:1789760474.693967:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.693997:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6da9d57 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.694039:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798046080 00000100:00100000:2.0:1789760474.694045:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798046080 00000100:00100000:2.0:1789760474.694078:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760474.694085:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb2f2a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6446:x1876699798046080:12345-0@lo:101: 00010000:00010000:2.0:1789760474.694106:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760474.694118:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398567b8 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.694139:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 10 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.694149:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 10 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.694156:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2711f29, rc 0) 00000100:00100000:2.0:1789760474.694191:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb2f2a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:6446:x1876699798046080:12345-0@lo:101: Request processed in 107us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.694197:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760474.694292:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046080:0@lo:101: 00010000:00010000:0.0:1789760474.694304:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.694312:0:6446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.699288:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046208:0@lo:256: 00000100:00100000:0.0:1789760474.699372:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.699543:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6da9d57 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.699705:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798046208 00000100:00100000:2.0:1789760474.699713:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798046208 00000100:00100000:2.0:1789760474.699863:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760474.699872:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be69dff4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:6446:x1876699798046208:12345-0@lo:256: 20000000:01000000:2.0:1789760474.700029:0:6459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789760474.700035:0:6459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789760474.700127:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be69dff4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:6446:x1876699798046208:12345-0@lo:256: Request processed in 256us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.700134:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760474.700208:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046208:0@lo:256: 10000000:01000000:0.0:1789760474.700823:0:6446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760474.700839:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.700850:0:6446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760474.700858:0:6446:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e546616000 from 1 10000000:01000000:0.0:1789760474.700860:0:6446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789760474.700896:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.700972:0:6446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.700982:0:6446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.700998:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046336:0@lo:101: 00000100:00100000:0.0:1789760474.701035:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.701412:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6da9d57 going to sleep for 11 seconds 00000100:00100000:1.0:1789760474.701482:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798046336 00000100:00100000:1.0:1789760474.701489:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798046336 00000100:00100000:1.0:1789760474.701522:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760474.701528:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095728b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:6446:x1876699798046336:12345-0@lo:101: 00010000:00010000:1.0:1789760474.701539:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760474.701551:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398567c6 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760474.701572:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 11 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760474.701581:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 11 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760474.701603:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dbc44bfc, rc 0) 00000100:00100000:1.0:1789760474.701650:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095728b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:6446:x1876699798046336:12345-0@lo:101: Request processed in 122us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760474.701657:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789760474.701737:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046336:0@lo:101: 00010000:00010000:0.0:1789760474.701757:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.701765:0:6446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.701836:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046464:0@lo:501: 00000100:00100000:0.0:1789760474.701861:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.701881:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6da9d57 going to sleep for 11 seconds 00000100:00100000:1.0:1789760474.702080:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798046464 00000100:00100000:1.0:1789760474.702084:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798046464 00000100:00100000:1.0:1789760474.702117:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760474.702122:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f849a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:6446:x1876699798046464:12345-0@lo:501: 00000100:00100000:1.0:1789760474.702614:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f849a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:6446:x1876699798046464:12345-0@lo:501: Request processed in 491us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760474.702621:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760474.702951:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046464:0@lo:501: 00000100:00100000:0.0:1789760474.702982:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046592:0@lo:503: 00000100:00100000:0.0:1789760474.703014:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.703029:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6da9d57 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.703198:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798046592 00000100:00100000:2.0:1789760474.703204:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798046592 00000100:00100000:2.0:1789760474.703229:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760474.703235:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004456ae9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:6446:x1876699798046592:12345-0@lo:503: 00000040:00080000:2.0:1789760474.703269:0:6459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789760474.703317:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004456ae9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:6446:x1876699798046592:12345-0@lo:503: Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.703324:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789760474.703346:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046592:0@lo:503: 00000040:00080000:0.0:1789760474.704517:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789760474.704665:0:6446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789760474.704684:0:6446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760474.704702:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.704714:0:6446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760474.704769:0:6446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789760474.704771:0:6446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e546616000 10000000:01000000:2.0:1789760474.704774:0:6446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e546616000 10000000:01000000:2.0:1789760474.704778:0:6446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789760474.704784:0:6446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e546616000 from 1 10000000:01000000:2.0:1789760474.704840:0:6446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789760474.704872:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.704909:0:6446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.704919:0:6446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760474.704938:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046720:0@lo:101: 00000100:00100000:2.0:1789760474.704993:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760474.705024:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 000000005856a156 going to sleep for 11 seconds 00000100:00100000:0.0:1789760474.705200:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798046720 00000100:00100000:0.0:1789760474.705207:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798046720 00000100:00100000:0.0:1789760474.705249:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789760474.705256:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5cf87d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:6446:x1876699798046720:12345-0@lo:101: 00010000:00010000:0.0:1789760474.705268:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760474.705282:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398567d4 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.705304:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.705314:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.705321:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000063f2d6b, rc 0) 00000100:00100000:0.0:1789760474.705356:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5cf87d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6446:x1876699798046720:12345-0@lo:101: Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760474.705374:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760474.705525:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046720:0@lo:101: 00010000:00010000:2.0:1789760474.705537:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.705545:0:6446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760474.705589:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046848:0@lo:501: 00000100:00100000:2.0:1789760474.705614:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760474.705636:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 000000005856a156 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.705654:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798046848 00000100:00100000:2.0:1789760474.705658:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798046848 00000100:00100000:2.0:1789760474.705681:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789760474.705686:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4247ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6446:x1876699798046848:12345-0@lo:501: 00000100:00100000:2.0:1789760474.705988:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4247ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6446:x1876699798046848:12345-0@lo:501: Request processed in 301us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.705995:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789760474.706034:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046848:0@lo:501: 00000100:00100000:2.0:1789760474.706059:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046976:0@lo:503: 00000100:00100000:2.0:1789760474.706105:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760474.706124:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 000000005856a156 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.706135:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798046976 00000100:00100000:2.0:1789760474.706139:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798046976 00000100:00100000:2.0:1789760474.706154:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760474.706159:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b29bfa97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6446:x1876699798046976:12345-0@lo:503: 00000100:00100000:2.0:1789760474.706447:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b29bfa97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6446:x1876699798046976:12345-0@lo:503: Request processed in 287us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.706454:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789760474.706717:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798046976:0@lo:503: 00000100:00100000:0.0:1789760474.707303:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6493:1876699798047104:0@lo:502: 00000100:00100000:0.0:1789760474.707344:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.707371:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057d2d470 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.707410:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798047104 00000100:00100000:2.0:1789760474.707415:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798047104 00000100:00100000:2.0:1789760474.707469:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760474.707475:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d303355e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6493:x1876699798047104:12345-0@lo:502: 00000100:00100000:2.0:1789760474.707704:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d303355e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6493:x1876699798047104:12345-0@lo:502: Request processed in 230us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.707711:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789760474.707852:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f72c8ed2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6493:1876699798047104:0@lo:502: 00000020:01000004:3.0:1789760474.707917:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789760474.707931:0:6493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000487b63e9) 00000020:00000080:3.0:1789760474.707947:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789760474.708008:0:6493:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000437d5cd9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789760474.708011:0:6493:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000437d5cd9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789760474.708014:0:6493:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000437d5cd9 4 00010000:00080000:3.0:1789760474.708039:0:6493:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f7d35862@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1789760474.709704:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789760474.710995:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789760474.711032:0:6493:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789760474.711044:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc2b9a3a7398567e9 00000100:00080000:3.0:1789760474.711057:0:6493:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760474.711062:0:6493:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f7d35862 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1789760474.711108:0:6493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003836ef04 x1876699798047232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789760474.711134:0:6493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789760474.711278:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003836ef04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3460:1876699798047232:0@lo:38: 00000100:00100000:0.0:1789760474.711356:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760474.711461:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798047232 00000100:00100000:1.0:1789760474.711469:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798047232 00000100:00100000:1.0:1789760474.711508:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760474.711515:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000910a9e4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1876699798047232:12345-0@lo:38: 00000100:00100000:1.0:1789760474.711569:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000910a9e4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1876699798047232:12345-0@lo:38: Request processed in 54us (213us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789760474.711576:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760474.711613:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760474.711620:0:3460:0:(import.c:65:import_set_state_nolock()) 00000000f7d35862 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789760474.711624:0:3460:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789760474.711626:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003836ef04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3460:1876699798047232:0@lo:38: 00000100:00100000:3.0:1789760474.712166:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080c64cf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6493:1876699798047360:0@lo:502: 00000100:00100000:3.0:1789760474.712213:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760474.712246:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031ab0f44 going to sleep for 11 seconds 00000100:00100000:1.0:1789760474.712288:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798047360 00000100:00100000:1.0:1789760474.712293:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798047360 00000100:00100000:1.0:1789760474.712329:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760474.712335:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa41c8f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6493:x1876699798047360:12345-0@lo:502: 00000100:00100000:1.0:1789760474.712544:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa41c8f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6493:x1876699798047360:12345-0@lo:502: Request processed in 210us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760474.712552:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760474.712594:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080c64cf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6493:1876699798047360:0@lo:502: 00000040:00080000:1.0:1789760474.712616:0:6493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789760474.712843:0:6446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789760474.712865:0:6446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760474.712882:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760474.712893:0:6446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789760474.712947:0:6446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789760474.712949:0:6446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789760474.712951:0:6446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760474.712952:0:6446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760474.712954:0:6446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760474.712955:0:6446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760474.712956:0:6446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789760474.712957:0:6446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789760474.712958:0:6446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760474.712960:0:6446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760474.712961:0:6446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760474.712963:0:6446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789760474.712966:0:6446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789760474.712969:0:6446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789760474.712970:0:6446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789760474.712971:0:6446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760474.712972:0:6446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760474.712973:0:6446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760474.712974:0:6446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760474.712975:0:6446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789760474.712976:0:6446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789760474.712977:0:6446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760474.712977:0:6446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760474.712979:0:6446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760474.712980:0:6446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789760474.712993:0:6446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789760474.713002:0:6446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082da5f96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798047488:0@lo:253: 00000100:00100000:3.0:1789760474.713036:0:6446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760474.713060:0:6446:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f5492b7 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.714363:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798047488 00000100:00100000:2.0:1789760474.714375:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798047488 00000100:00100000:2.0:1789760474.714428:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789760474.714437:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a06051d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6446:x1876699798047488:12345-0@lo:253: 20000000:01000000:2.0:1789760474.714469:0:6460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789760474.714483:0:6460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789760474.749370:0:6460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789760474.749391:0:6460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789760474.749471:0:6481:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789760474.749475:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789760474.749494:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.749511:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.749519:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.749551:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760474.749564:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 12 pid: 6457 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760474.749577:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c0cf0a8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798047616:0@lo:104: 00000100:00100000:0.0:1789760474.749631:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760474.749674:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d184dec9 going to sleep for 11 seconds 00000100:00100000:2.0:1789760474.749766:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798047616 00000100:00100000:2.0:1789760474.749773:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798047616 00000100:00100000:2.0:1789760474.749840:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760474.749846:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b573721b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6481:x1876699798047616:12345-0@lo:104: 00010000:00010000:2.0:1789760474.749857:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.749903:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760474.749908:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b573721b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6481:x1876699798047616:12345-0@lo:104: Request processed in 63us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.749914:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760474.749947:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c0cf0a8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798047616:0@lo:104: 00010000:00010000:2.0:1789760474.749966:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.749981:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760474.749986:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.749993:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000335e3f6 already unused, calling callback (00000000cdd84c74) 10000000:00010000:2.0:1789760474.749996:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750003:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760474.750009:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760474.750013:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760474.750040:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750052:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760474.750068:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750073:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000000335e3f6/0xc2b9a3a7398567b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567bf expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750100:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760474.750102:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760474.750104:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760474.750153:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046d937c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798047744:0@lo:103: 00000100:00100000:2.0:1789760474.750181:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760474.750242:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798047744 00000100:00100000:2.0:1789760474.750245:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798047744 00010000:00010000:2.0:1789760474.750260:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 13 pid: 6457 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760474.750282:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760474.750286:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000050dd193 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:3462:x1876699798047744:12345-0@lo:103: 00010000:00010000:2.0:1789760474.750297:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760474.750300:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 13 pid: 6457 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750308:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 13 pid: 6457 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750319:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f2711f29/0xc2b9a3a7398567bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398567b8 expref: 13 pid: 6457 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750341:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750347:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789760474.750357:0:6450:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000882227s 00010000:00010000:2.0:1789760474.750360:0:6450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750365:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750370:0:6450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750375:0:6450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750380:0:6450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000204dfe0f already unused, calling callback (0000000011508811) 00010000:00010000:2.0:1789760474.750383:0:6450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750388:0:6450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750399:0:6450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750689:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760474.750727:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000050dd193 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:3462:x1876699798047744:12345-0@lo:103: Request processed in 440us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760474.750735:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789760474.750919:0:6481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750927:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760474.750932:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000204dfe0f/0xc2b9a3a7398567f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760474.750960:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046d937c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798047744:0@lo:103: 00000100:00100000:3.0:1789760474.767034:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a06051d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:6446:x1876699798047488:12345-0@lo:253: Request processed in 52592us (53991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760474.767049:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760474.767131:0:6446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082da5f96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6446:1876699798047488:0@lo:253: 10000000:01000000:0.0:1789760474.767145:0:6446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789760474.767160:0:6446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760474.767161:0:6446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789760474.767163:0:6446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760474.767164:0:6446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760474.767166:0:6446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760474.767167:0:6446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760474.767168:0:6446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789760474.767169:0:6446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789760474.767171:0:6446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760474.767172:0:6446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760474.767173:0:6446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760474.767175:0:6446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789760474.767193:0:6446:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789760474.785704:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760474.786313:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789760474.786522:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760474.786690:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789760474.787178:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760474.787349:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789760474.788911:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760474.789115:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789760474.789306:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760474.789473:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789760474.789652:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760474.790065:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789760474.847679:0:6446:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789760474.888701:0:6446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789760474.889174:0:6499:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789760474.891488:0:6446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789760474.891637:0:6446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789760474.892115:0:6446:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789760474.892123:0:6446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789760474.892248:0:6446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1789760474.894483:0:6498:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789760474.894491:0:6498:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1789760474.894908:0:6446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789760474.896146:0:6446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789760474.896197:0:6446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789760474.896531:0:6446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789760474.896735:0:6446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1789760474.897991:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789760474.898164:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789760474.898313:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789760474.898452:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789760474.898605:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789760474.898738:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789760474.898924:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789760474.899059:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789760474.900057:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789760474.900220:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789760474.900375:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789760474.900523:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789760474.900675:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789760474.901001:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789760474.901163:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789760474.901296:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789760474.901589:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789760474.901712:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789760474.902053:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789760474.902191:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789760474.902337:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789760474.902495:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789760474.902652:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789760474.903133:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789760474.903297:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789760474.903416:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789760474.903564:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789760474.903708:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789760474.904090:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789760474.904235:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789760474.904382:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789760474.904517:0:6446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789760474.904951:0:6446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789760474.972290:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789760475.075985:0:6446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789760475.076020:0:6446:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0f9c18af988 00100000:10000000:3.0:1789760475.076029:0:6446:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789760475.078759:0:6446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789760475.078779:0:6446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789760475.078814:0:6446:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789760475.078834:0:6446:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789760475.124692:0:6499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789760475.126065:0:6499:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1789760475.126072:0:6499:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789760475.657190:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760476.680385:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760477.706200:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760478.727667:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760479.351449:0:6742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789760479.756069:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760479.945406:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1789760479.945430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789760479.945435:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789760479.945438:0:37:0:(import.c:65:import_set_state_nolock()) 00000000f7d35862 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789760479.945450:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f7d35862 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1789760479.945473:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004585fcfa x1876699798048000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760479.945507:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004585fcfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3460:1876699798048000:0@lo:38: 00000100:00100000:2.0:1789760479.945588:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760479.945659:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798048000 00000100:00100000:2.0:1789760479.945665:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798048000 00000100:00100000:2.0:1789760479.945697:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760479.945704:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002318f63e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3460:x1876699798048000:12345-0@lo:38: 00010000:00080000:2.0:1789760479.945740:0:6467:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1789760479.945772:0:6467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc2b9a3a7398567f7 00000004:00100000:2.0:1789760479.946031:0:6467:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789760479.946167:0:6467:0:(import.c:65:import_set_state_nolock()) 00000000e618fe06 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760479.946226:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002318f63e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1876699798048000:12345-0@lo:38: Request processed in 522us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760479.946234:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789760479.946335:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004585fcfa x1876699798048000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789760479.946350:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789760479.946356:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789760479.946360:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789760479.946362:0:3460:0:(import.c:65:import_set_state_nolock()) 00000000f7d35862 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789760479.946367:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004585fcfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3460:1876699798048000:0@lo:38: 00000100:00100000:3.0:1789760479.946946:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046d937c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798047872:0@lo:400: 00000100:00100000:3.0:1789760479.946991:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760479.950395:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798047872 00000100:00100000:1.0:1789760479.950409:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798047872 00000100:00100000:1.0:1789760479.950471:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760479.950479:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeaa8fae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:3464:x1876699798047872:12345-0@lo:400: 00000100:00100000:1.0:1789760479.950644:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeaa8fae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:3464:x1876699798047872:12345-0@lo:400: Request processed in 166us (3652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760479.950652:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760479.950775:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046d937c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798047872:0@lo:400: 00010000:00010000:0.0:1789760480.777455:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760481.798995:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760482.825505:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789760483.527529:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789760483.527537:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e546616000 from 3 10000000:01000000:0.0:1789760483.527542:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789760483.527604:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760483.527616:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760483.527627:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760483.527651:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6708bd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798048128:0@lo:101: 00000100:00100000:0.0:1789760483.527737:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760483.527819:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaca78e5 going to sleep for 11 seconds 00000100:00100000:3.0:1789760483.527876:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798048128 00000100:00100000:3.0:1789760483.527883:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798048128 00000100:00100000:3.0:1789760483.527928:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760483.527948:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ff8ac80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:6462:x1876699798048128:12345-0@lo:101: 00010000:00010000:3.0:1789760483.527961:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760483.527971:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398567fe expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760483.527991:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 12 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760483.528000:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 12 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760483.528007:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a25da76, rc 0) 00000100:00100000:3.0:1789760483.528058:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ff8ac80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6462:x1876699798048128:12345-0@lo:101: Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760483.528065:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760483.528241:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6708bd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798048128:0@lo:101: 00010000:00010000:0.0:1789760483.528254:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760483.528268:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760483.528312:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6708bd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798048256:0@lo:256: 00000100:00100000:0.0:1789760483.528341:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760483.528432:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaca78e5 going to sleep for 11 seconds 00000100:00100000:3.0:1789760483.531018:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798048256 00000100:00100000:3.0:1789760483.531043:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798048256 00000100:00100000:3.0:1789760483.531178:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760483.531188:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038371a84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6462:x1876699798048256:12345-0@lo:256: 20000000:01000000:3.0:1789760483.531211:0:6459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789760483.531232:0:6459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789760483.531235:0:6459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789760483.531361:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038371a84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:6462:x1876699798048256:12345-0@lo:256: Request processed in 175us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760483.531374:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789760483.531526:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6708bd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798048256:0@lo:256: 10000000:01000000:0.0:1789760483.531589:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760483.531598:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760483.531609:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760483.847092:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760484.871090:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760485.065132:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760485.066356:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8a4e3f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798048512:0@lo:400: 00000100:00100000:2.0:1789760485.066454:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760485.069480:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798048512 00000100:00100000:3.0:1789760485.069502:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798048512 00000100:00100000:3.0:1789760485.069579:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760485.069589:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff8ec923 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798048512:12345-0@lo:400: 00000100:00100000:3.0:1789760485.069732:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff8ec923 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798048512:12345-0@lo:400: Request processed in 144us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760485.069740:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760485.069962:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f8a4e3f7 x1876699798048512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760485.069982:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8a4e3f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798048512:0@lo:400: 00000100:00100000:0.0:1789760485.070345:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2694a79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798048384:0@lo:400: 00000100:00100000:0.0:1789760485.070398:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760485.073361:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798048384 00000100:00100000:3.0:1789760485.073381:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798048384 00000100:00100000:2.0:1789760485.073518:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789760485.073529:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0e1f520 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:3463:x1876699798048384:12345-0@lo:400: 00000100:00100000:2.0:1789760485.073643:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0e1f520 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:3463:x1876699798048384:12345-0@lo:400: Request processed in 116us (3244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760485.073651:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789760485.074172:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2694a79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798048384:0@lo:400: 00010000:00010000:2.0:1789760485.896031:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760486.932999:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760487.943224:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760488.967555:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789760489.159073:0:7262:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789760489.159077:0:7262:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:3.0:1789760489.159182:0:7262:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000096a4287 00000020:01000004:3.0:1789760489.159196:0:7262:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1789760489.159206:0:7262:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789760489.159228:0:7262:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000826f0f54) 00000020:00000080:3.0:1789760489.159241:0:7262:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789760489.175749:0:7262:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789760489.177893:0:7262:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789760489.206284:0:7262:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789760489.206325:0:7262:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789760489.206348:0:7262:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789760489.206396:0:7262:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789760489.206419:0:7262:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789760489.206769:0:7262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789760489.206778:0:7262:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789760489.207460:0:7262:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc2b9a3a739856813 00000020:01000004:1.0:1789760489.207468:0:7262:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:1.0:1789760489.207490:0:7262:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789760489.207492:0:7262:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789760489.207499:0:7262:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789760489.207519:0:7262:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:1.0:1789760489.207522:0:7262:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789760489.237096:0:7262:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789760489.237134:0:7262:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789760489.237138:0:7262:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789760489.237140:0:7262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789760489.237141:0:7262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760489.237143:0:7262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760489.237144:0:7262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760489.237145:0:7262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760489.237147:0:7262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760489.237148:0:7262:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760489.237150:0:7262:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760489.237151:0:7262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760489.237152:0:7262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760489.237155:0:7262:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789760489.237157:0:7262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789760489.237158:0:7262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789760489.237159:0:7262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760489.237160:0:7262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760489.237161:0:7262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760489.237163:0:7262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760489.237164:0:7262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760489.237165:0:7262:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760489.237166:0:7262:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760489.237167:0:7262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760489.237168:0:7262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760489.237197:0:7262:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789760489.237214:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798048640:0@lo:253: 00000100:00100000:2.0:1789760489.237280:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.237369:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da0fd12b going to sleep for 11 seconds 00000100:00100000:1.0:1789760489.237781:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798048640 00000100:00100000:1.0:1789760489.237867:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798048640 00000100:00100000:2.0:1789760489.238168:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789760489.238178:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042c4ad31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798048640:12345-0@lo:253: 20000000:01000000:2.0:1789760489.238222:0:6457:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789760489.238227:0:6457:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1789760489.238231:0:6457:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1789760489.238235:0:6457:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1789760489.238606:0:6457:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1789760489.239541:0:6457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789760489.239736:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789760489.239749:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789760489.239838:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789760489.239890:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789760489.239926:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789760489.240029:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1789760489.240037:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1789760489.240080:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1789760489.240088:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1789760489.240116:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1789760489.240123:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1789760489.240150:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789760489.240206:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789760489.240676:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1789760489.240687:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1789760489.240715:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1789760489.240724:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789760489.240768:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1789760489.240784:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1789760489.240858:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1789760489.240866:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789760489.240895:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789760489.240940:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789760489.240974:0:6457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789760489.241374:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1789760489.241386:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1789760489.243099:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 160 off11176 00000040:00080000:2.0:1789760489.243208:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11400 00000040:00080000:2.0:1789760489.243248:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11624 20000000:01000000:2.0:1789760489.243257:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1789760489.243285:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 80 off11704 00000040:00080000:2.0:1789760489.243368:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789760489.243377:0:6457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1789760489.243503:0:6457:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789760489.243512:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789760489.244191:0:7264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789760489.244594:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789760489.244619:0:6457:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.138@tcp for mdt 20000000:01000000:3.0:1789760489.244621:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1789760489.245084:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789760489.245096:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789760489.245135:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789760489.245142:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1789760489.245193:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789760489.245203:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789760489.245237:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789760489.245274:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789760489.251451:0:6457:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789760489.251468:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1789760489.252109:0:7265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1789760489.252509:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789760489.252533:0:6457:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.138@tcp for mdt 20000000:01000000:3.0:1789760489.252602:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1789760489.252653:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789760489.252670:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760489.253282:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789760489.253298:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1789760489.253345:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789760489.253355:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760489.253387:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789760489.253446:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1789760489.253472:0:6457:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789760489.253476:0:6457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789760489.253481:0:6457:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789760489.253486:0:6457:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789760489.258448:0:7266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 17 count 22 20000000:00000400:3.0:1789760489.258598:0:6457:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 20000000:01000000:3.0:1789760489.276080:0:6457:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789760489.276087:0:6457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789760489.276091:0:6457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789760489.276111:0:6457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789760489.276113:0:6457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789760489.276174:0:6457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789760489.276177:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789760489.277694:0:7267:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 19 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789760489.277773:0:7267:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 21 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789760489.277821:0:7267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789760489.278068:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789760489.278113:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789760489.278186:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789760489.278201:0:6457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789760489.278203:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789760489.278694:0:7268:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789760489.278744:0:7268:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789760489.278947:0:7268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789760489.279249:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789760489.279293:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789760489.279328:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789760489.279341:0:6457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789760489.279342:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789760489.280192:0:7269:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1789760489.280256:0:7269:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1789760489.280306:0:7269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789760489.280581:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789760489.280615:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789760489.280691:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1789760489.280710:0:6457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789760489.280726:0:6457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.280754:0:6457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 12 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.280761:0:6457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 12 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.280767:0:6457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.280772:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.281052:0:6457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.281159:0:6457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 12 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760489.281173:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b4c51a6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798048768:0@lo:104: 00000100:00100000:1.0:1789760489.281241:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760489.281334:0:6457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 12 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.281342:0:6457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 12 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760489.281350:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004024c716 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798048896:0@lo:104: 00000100:00100000:1.0:1789760489.281371:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760489.282084:0:6457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 12 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.282105:0:6457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 12 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760489.282114:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a826536a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798049024:0@lo:104: 00000100:00100000:1.0:1789760489.282143:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.282266:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798048768 00000100:00100000:0.0:1789760489.282273:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798048768 00000100:00100000:2.0:1789760489.282325:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798048896 00000100:00100000:2.0:1789760489.282329:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798048896 00000100:00100000:2.0:1789760489.282353:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760489.282360:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3ca00d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6457:x1876699798048768:12345-0@lo:104: 00010000:00010000:2.0:1789760489.282372:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.282443:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760489.282449:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3ca00d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6457:x1876699798048768:12345-0@lo:104: Request processed in 90us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.282456:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760489.282472:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760489.282478:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddfc4a23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6457:x1876699798048896:12345-0@lo:104: 00010000:00010000:2.0:1789760489.282484:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.282515:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789760489.282519:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddfc4a23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6457:x1876699798048896:12345-0@lo:104: Request processed in 43us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.282543:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789760489.282596:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760489.282602:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282609:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a360a7a7 already unused, calling callback (00000000cdd84c74) 10000000:00010000:3.0:1789760489.282612:0:6453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282620:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760489.282646:0:6453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760489.282652:0:6453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760489.282687:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282693:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760489.282711:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282716:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 00000000a360a7a7/0xc2b9a3a7398567d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567db expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282727:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760489.282729:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282735:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000357ab3f2 already unused, calling callback (00000000cdd84c74) 10000000:00010000:3.0:1789760489.282736:0:6453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282742:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760489.282747:0:6453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760489.282752:0:6453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760489.282773:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282779:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760489.282816:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282822:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a739856764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985676b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.282832:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760489.282833:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760489.282835:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760489.282839:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760489.282849:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0308dc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798049152:0@lo:103: 00000100:00100000:3.0:1789760489.282888:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760489.282927:0:6457:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b1ede64 going to sleep for 11 seconds 00000100:00100000:3.0:1789760489.282944:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a474cbb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798049280:0@lo:103: 00000100:00100000:1.0:1789760489.282952:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b4c51a6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798048768:0@lo:104: 00000100:00100000:3.0:1789760489.282973:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.283017:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798049152 00000100:00100000:3.0:1789760489.283021:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798049152 00010000:00010000:3.0:1789760489.283039:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 13 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760489.283057:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798049280 00000100:00100000:3.0:1789760489.283072:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798049280 00010000:00010000:3.0:1789760489.283083:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 14 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760489.283096:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004024c716 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798048896:0@lo:104: 00000100:00100000:3.0:1789760489.283100:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760489.283109:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084895e81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:3462:x1876699798049152:12345-0@lo:103: 00010000:00010000:3.0:1789760489.283129:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760489.283134:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 14 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283144:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 14 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283156:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000063f2d6b/0xc2b9a3a7398567db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398567d4 expref: 14 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283168:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760489.283201:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084895e81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:3462:x1876699798049152:12345-0@lo:103: Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760489.283208:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760489.283226:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760489.283230:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0308dc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798049152:0@lo:103: 00000100:00100000:3.0:1789760489.283236:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6329a38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:3463:x1876699798049280:12345-0@lo:103: 00010000:00010000:3.0:1789760489.283246:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760489.283249:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 12 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283258:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 12 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283266:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000072106473/0xc2b9a3a73985676b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856764 expref: 12 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283273:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760489.283303:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6329a38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:3463:x1876699798049280:12345-0@lo:103: Request processed in 72us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760489.283309:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760489.283427:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a474cbb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798049280:0@lo:103: 00000100:00100000:2.0:1789760489.283460:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798049024 00000100:00100000:2.0:1789760489.283465:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798049024 00000100:00100000:2.0:1789760489.283483:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760489.283488:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000509e6335 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6457:x1876699798049024:12345-0@lo:104: 00010000:00010000:2.0:1789760489.283495:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.283542:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760489.283546:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000509e6335 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6457:x1876699798049024:12345-0@lo:104: Request processed in 59us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.283552:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760489.283576:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a826536a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798049024:0@lo:104: 00010000:00010000:1.0:1789760489.283594:0:6457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283601:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760489.283607:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283614:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f4565ff already unused, calling callback (00000000cdd84c74) 10000000:00010000:3.0:1789760489.283617:0:6453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283623:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760489.283628:0:6453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760489.283633:0:6453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760489.283687:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283694:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760489.283716:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283721:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000005f4565ff/0xc2b9a3a739856748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985674f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283735:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760489.283736:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760489.283738:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760489.283743:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760489.283751:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798049408:0@lo:103: 00000100:00100000:3.0:1789760489.283775:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.283823:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798049408 00000100:00100000:3.0:1789760489.283827:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798049408 00010000:00010000:3.0:1789760489.283840:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 11 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760489.283858:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760489.283863:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2abcd78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:3463:x1876699798049408:12345-0@lo:103: 00010000:00010000:3.0:1789760489.283870:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760489.283874:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 11 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283881:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 11 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283891:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008685ba91/0xc2b9a3a73985674f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856748 expref: 11 pid: 6459 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283904:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283912:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283923:0:6450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283929:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.283935:0:6450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.284539:0:6450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.284544:0:6450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000488b157c already unused, calling callback (0000000011508811) 00010000:00010000:3.0:1789760489.284547:0:6450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.284553:0:6450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.284570:0:6450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.284579:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760489.284617:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2abcd78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:3463:x1876699798049408:12345-0@lo:103: Request processed in 754us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760489.284624:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760489.284659:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798049408:0@lo:103: 00010000:00010000:3.0:1789760489.284676:0:6457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.284683:0:6457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.284688:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000488b157c/0xc2b9a3a73985681a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789760489.284703:0:6457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789760489.342116:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042c4ad31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:7262:x1876699798048640:12345-0@lo:253: Request processed in 103931us (104827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760489.342130:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789760489.351352:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798048640:0@lo:253: 10000000:01000000:2.0:1789760489.351371:0:7262:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789760489.351389:0:7262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789760489.351391:0:7262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789760489.351392:0:7262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760489.351393:0:7262:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789760489.351394:0:7262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760489.351395:0:7262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760489.351396:0:7262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760489.351398:0:7262:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789760489.351399:0:7262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760489.351400:0:7262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789760489.351419:0:7262:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000096a4287 from lustre-MDT0001 10000000:01000000:2.0:1789760489.351445:0:7262:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789760489.351447:0:7262:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789760489.351454:0:7262:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97e550c219b8 local copy 10000000:01000000:2.0:1789760489.351457:0:7262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789760489.351492:0:7262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.351502:0:7262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.351509:0:7262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760489.351524:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798049536:0@lo:101: 00000100:00100000:2.0:1789760489.351578:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.351633:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfbc91a3 going to sleep for 11 seconds 00000100:00100000:0.0:1789760489.351996:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798049536 00000100:00100000:0.0:1789760489.352004:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798049536 00000100:00100000:0.0:1789760489.352056:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789760489.352065:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037b86f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:7262:x1876699798049536:12345-0@lo:101: 00010000:00010000:0.0:1789760489.352077:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760489.352089:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000335e3f6/0xc2b9a3a739856828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856821 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.352112:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000335e3f6/0xc2b9a3a739856828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856821 expref: 10 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.352121:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000335e3f6/0xc2b9a3a739856828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856821 expref: 10 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.352129:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000335e3f6, rc 0) 00000100:00100000:0.0:1789760489.352174:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037b86f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:7262:x1876699798049536:12345-0@lo:101: Request processed in 111us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760489.352181:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789760489.352303:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798049536:0@lo:101: 00010000:00010000:2.0:1789760489.352315:0:7262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.352324:0:7262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760489.352432:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798049664:0@lo:501: 00000100:00100000:2.0:1789760489.352460:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.352490:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfbc91a3 going to sleep for 11 seconds 00000100:00100000:0.0:1789760489.353679:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798049664 00000100:00100000:0.0:1789760489.353688:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798049664 00000100:00100000:0.0:1789760489.353737:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789760489.353744:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002522c313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:7262:x1876699798049664:12345-0@lo:501: 00000100:00100000:0.0:1789760489.354022:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002522c313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:7262:x1876699798049664:12345-0@lo:501: Request processed in 278us (1561us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760489.354039:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789760489.354244:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798049664:0@lo:501: 10000000:01000000:2.0:1789760489.354266:0:7262:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789760489.354310:0:7262:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789760489.354316:0:7262:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.354325:0:7262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.354332:0:7262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.354355:0:7262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789760489.354375:0:7262:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e544828000 10000000:01000000:2.0:1789760489.354380:0:7262:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789760489.354384:0:7262:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97e550c219b8 10000000:01000000:2.0:1789760489.354386:0:7262:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789760489.354389:0:7262:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97e550c219b8 from 1 10000000:01000000:2.0:1789760489.354392:0:7262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789760489.354416:0:7262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000046d772a2/0xc2b9a3a73985682f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.354424:0:7262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000046d772a2/0xc2b9a3a73985682f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.354443:0:7262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000046d772a2/0xc2b9a3a73985682f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760489.354459:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798049792:0@lo:101: 00000100:00100000:2.0:1789760489.354491:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.354525:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000254bff73 going to sleep for 11 seconds 00000100:00100000:1.0:1789760489.354594:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798049792 00000100:00100000:1.0:1789760489.354600:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798049792 00000100:00100000:1.0:1789760489.354631:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789760489.354648:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000270da6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:7262:x1876699798049792:12345-0@lo:101: 00010000:00010000:1.0:1789760489.354658:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760489.354670:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004448474c/0xc2b9a3a739856836 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a73985682f expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.354688:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004448474c/0xc2b9a3a739856836 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a73985682f expref: 11 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.354698:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004448474c/0xc2b9a3a739856836 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985682f expref: 11 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.354713:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004448474c, rc 0) 00000100:00100000:1.0:1789760489.354749:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000270da6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:7262:x1876699798049792:12345-0@lo:101: Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760489.354755:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1789760489.354873:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760489.354885:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.354892:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e8c3718 already unused, calling callback (00000000cdd84c74) 10000000:00010000:3.0:1789760489.354895:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.354902:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760489.354907:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760489.354912:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760489.354929:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.354935:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760489.354961:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.354967:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000003e8c3718/0xc2b9a3a739856821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856828 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.354992:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760489.354994:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760489.354995:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760489.355002:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760489.355012:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798049920:0@lo:103: 00000100:00100000:3.0:1789760489.355043:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.355076:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798049920 00000100:00100000:3.0:1789760489.355085:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798049920 00000100:00100000:3.0:1789760489.355120:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760489.355126:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a536098 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:3462:x1876699798049920:12345-0@lo:103: 00010000:00010000:3.0:1789760489.355134:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760489.355142:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000335e3f6/0xc2b9a3a739856828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739856821 expref: 11 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.355155:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760489.355183:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a536098 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:3462:x1876699798049920:12345-0@lo:103: Request processed in 58us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760489.355188:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760489.355216:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798049920:0@lo:103: 00000100:00100000:2.0:1789760489.355321:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798049792:0@lo:101: 00010000:00010000:2.0:1789760489.355333:0:7262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000046d772a2/0xc2b9a3a73985682f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856836 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.355341:0:7262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000046d772a2/0xc2b9a3a73985682f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856836 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760489.355356:0:7262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789760489.355374:0:7262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000046d772a2/0xc2b9a3a73985682f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856836 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.355381:0:7262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000046d772a2/0xc2b9a3a73985682f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856836 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760489.355390:0:7262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97e544828000 10000000:01000000:2.0:1789760489.355393:0:7262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789760489.355397:0:7262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97e544828000 from 1 10000000:01000000:2.0:1789760489.355399:0:7262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789760489.355413:0:7262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000f2711f29/0xc2b9a3a73985683d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.355419:0:7262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000f2711f29/0xc2b9a3a73985683d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.355431:0:7262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000f2711f29/0xc2b9a3a73985683d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760489.355442:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050048:0@lo:101: 00000100:00100000:2.0:1789760489.355468:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.355489:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000254bff73 going to sleep for 11 seconds 00000100:00100000:1.0:1789760489.355540:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798050048 00000100:00100000:1.0:1789760489.355544:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798050048 00000100:00100000:1.0:1789760489.355574:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789760489.355579:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ad47305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:7262:x1876699798050048:12345-0@lo:101: 00010000:00010000:1.0:1789760489.355587:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760489.355593:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a065b56f/0xc2b9a3a739856844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a73985683d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.355606:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a065b56f/0xc2b9a3a739856844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a73985683d expref: 11 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.355613:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a065b56f/0xc2b9a3a739856844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985683d expref: 11 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.355620:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a065b56f, rc 0) 00000100:00100000:1.0:1789760489.355655:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ad47305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:7262:x1876699798050048:12345-0@lo:101: Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760489.355661:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760489.355953:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050048:0@lo:101: 00010000:00010000:2.0:1789760489.355962:0:7262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000f2711f29/0xc2b9a3a73985683d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856844 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.355969:0:7262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000f2711f29/0xc2b9a3a73985683d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856844 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760489.355978:0:7262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789760489.355996:0:7262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000f2711f29/0xc2b9a3a73985683d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856844 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.356002:0:7262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000f2711f29/0xc2b9a3a73985683d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856844 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760489.356008:0:7262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789760489.356011:0:7262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789760489.356015:0:7262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97e544828000 10000000:01000000:2.0:1789760489.356017:0:7262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789760489.356020:0:7262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789760489.356022:0:7262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789760489.356034:0:7262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000cd84be68/0xc2b9a3a73985684b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.356045:0:7262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000cd84be68/0xc2b9a3a73985684b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.356052:0:7262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000cd84be68/0xc2b9a3a73985684b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760489.356062:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050176:0@lo:101: 00000100:00100000:2.0:1789760489.356084:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.356103:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000254bff73 going to sleep for 11 seconds 00000100:00100000:0.0:1789760489.356211:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798050176 00000100:00100000:0.0:1789760489.356215:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798050176 00000100:00100000:0.0:1789760489.356236:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789760489.356241:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6e3db8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:7262:x1876699798050176:12345-0@lo:101: 00010000:00010000:0.0:1789760489.356248:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760489.356257:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000063f2d6b/0xc2b9a3a739856852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a73985684b expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.356270:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000063f2d6b/0xc2b9a3a739856852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.356277:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000063f2d6b/0xc2b9a3a739856852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.356283:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000063f2d6b, rc 0) 00000100:00100000:0.0:1789760489.356322:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6e3db8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050176:12345-0@lo:101: Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760489.356328:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760489.356396:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d89801bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050176:0@lo:101: 00010000:00010000:3.0:1789760489.356406:0:7262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000cd84be68/0xc2b9a3a73985684b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.356412:0:7262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000cd84be68/0xc2b9a3a73985684b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760489.356494:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050304:0@lo:501: 00000100:00100000:3.0:1789760489.356519:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.356544:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f80a6968 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.358973:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798050304 00000100:00100000:2.0:1789760489.358995:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798050304 00000100:00100000:2.0:1789760489.359041:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789760489.359048:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033267352 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050304:12345-0@lo:501: 00000100:00100000:2.0:1789760489.359349:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033267352 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050304:12345-0@lo:501: Request processed in 300us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.359356:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789760489.359446:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050304:0@lo:501: 00000100:00100000:3.0:1789760489.359491:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050432:0@lo:503: 00000100:00100000:3.0:1789760489.359535:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.359572:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f80a6968 going to sleep for 11 seconds 00000100:00100000:0.0:1789760489.359765:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798050432 00000100:00100000:0.0:1789760489.359771:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798050432 00000100:00100000:0.0:1789760489.359824:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760489.359831:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d7a4fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050432:12345-0@lo:503: 00000100:00100000:0.0:1789760489.359967:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d7a4fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050432:12345-0@lo:503: Request processed in 137us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760489.359974:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789760489.360083:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050432:0@lo:503: 00000040:00080000:3.0:1789760489.360402:0:7262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760489.360463:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050560:0@lo:502: 00000100:00100000:3.0:1789760489.360501:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.360520:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f80a6968 going to sleep for 11 seconds 00000100:00100000:1.0:1789760489.360611:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798050560 00000100:00100000:1.0:1789760489.360616:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798050560 00000100:00100000:1.0:1789760489.360650:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789760489.360657:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d342b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050560:12345-0@lo:502: 00000100:00100000:1.0:1789760489.360854:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d342b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050560:12345-0@lo:502: Request processed in 198us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760489.360867:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789760489.361097:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050560:0@lo:502: 00000040:00080000:3.0:1789760489.361319:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789760489.361369:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789760489.361415:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789760489.361447:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789760489.361475:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789760489.361517:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789760489.361548:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789760489.361579:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789760489.361620:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789760489.361666:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789760489.361716:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789760489.361777:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789760489.361845:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789760489.361879:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789760489.361923:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789760489.361954:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789760489.361981:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 160 off11176 00000040:00080000:3.0:1789760489.362038:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11400 00000040:00080000:3.0:1789760489.362075:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11624 00000040:00080000:3.0:1789760489.362108:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 80 off11704 00000040:00080000:3.0:1789760489.362154:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789760489.362187:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789760489.362214:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789760489.362246:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050688:0@lo:502: 00000100:00100000:3.0:1789760489.362299:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.362332:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f80a6968 going to sleep for 11 seconds 00000100:00100000:0.0:1789760489.362530:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798050688 00000100:00100000:0.0:1789760489.362536:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798050688 00000100:00100000:0.0:1789760489.362571:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789760489.362576:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039fb6456 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050688:12345-0@lo:502: 00000100:00100000:0.0:1789760489.362756:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039fb6456 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798050688:12345-0@lo:502: Request processed in 180us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760489.362764:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789760489.362993:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798050688:0@lo:502: 00000040:00080000:3.0:1789760489.363076:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789760489.363087:0:7262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1789760489.368345:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760489.368361:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760489.368362:0:7271:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789760489.368367:0:7271:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789760489.368370:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760489.368381:0:7271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000005bd179b7) 00000020:00000080:3.0:1789760489.368403:0:7271:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1789760489.368407:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789760489.368494:0:7271:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789760489.368501:0:7271:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc2b9a3a739856860 00000020:00000080:3.0:1789760489.368730:0:7271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789760489.368735:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760489.368739:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760489.368740:0:7271:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789760489.368743:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760489.368747:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760489.368748:0:7271:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789760489.368750:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760489.368757:0:7271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000198cac1d) 00000020:00000080:3.0:1789760489.368767:0:7271:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1789760489.368770:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789760489.368771:0:7271:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789760489.368774:0:7271:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789760489.368778:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789760489.368849:0:7271:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000096a4287 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789760489.368861:0:7271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000070f9267f) 00000020:00000080:3.0:1789760489.368868:0:7271:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1789760489.368925:0:7271:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789760489.368935:0:7271:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc2b9a3a739856875 00000020:00000080:3.0:1789760489.369025:0:7271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789760489.369031:0:7271:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789760489.369035:0:7271:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc2b9a3a73985687c 00080000:01000000:3.0:1789760489.369040:0:7271:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789760489.369043:0:7271:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc2b9a3a739856883 00080000:10000000:3.0:1789760489.369358:0:7271:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789760489.369512:0:7271:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1789760489.444466:0:7271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1789760489.445113:0:7271:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1789760489.449340:0:7271:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789760489.449763:0:7271:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789760489.651952:0:7271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789760489.651965:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760489.651972:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760489.651974:0:7271:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789760489.651978:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760489.651994:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760489.651996:0:7271:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789760489.652000:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789760489.652004:0:7271:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:3.0:1789760489.652030:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760489.652057:0:7271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000045bdf198) 00000020:00000080:3.0:1789760489.652078:0:7271:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789760489.652084:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789760489.652149:0:7271:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789760489.652156:0:7271:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789760489.652164:0:7271:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc2b9a3a739856891 00010000:00080000:3.0:1789760489.652194:0:7271:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006159b73e@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1789760489.659628:0:7271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1789760489.663273:0:7271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789760489.663288:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789760489.663332:0:7271:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789760489.663352:0:7271:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc2b9a3a739856898 00000100:00080000:2.0:1789760489.663362:0:7271:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789760489.663368:0:7271:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000006159b73e using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1789760489.663405:0:7271:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fbb2b228 x1876699798050816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789760489.663427:0:7271:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789760489.663477:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760489.663482:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760489.663491:0:7271:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789760489.663495:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760489.663500:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760489.663501:0:7271:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789760489.663505:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789760489.663538:0:7271:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789760489.663551:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760489.663554:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760489.663555:0:7271:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789760489.663557:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789760489.663559:0:7271:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789760489.663560:0:7271:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789760489.663562:0:7271:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789760489.663563:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789760489.663565:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760489.663566:0:7271:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789760489.663568:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760489.663571:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760489.663572:0:7271:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789760489.663574:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789760489.663576:0:7271:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789760489.664383:0:7271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760489.664391:0:7271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760489.664394:0:7271:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789760489.664397:0:7271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1789760489.664565:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbb2b228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3460:1876699798050816:0@lo:38: 00000100:00100000:2.0:1789760489.664712:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.664774:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798050816 00000100:00100000:2.0:1789760489.664781:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798050816 00000100:00100000:2.0:1789760489.664893:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760489.664898:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d9ded27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3460:x1876699798050816:12345-0@lo:38: 00010000:00080000:2.0:1789760489.664920:0:6470:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:2.0:1789760489.664954:0:6470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc2b9a3a73985689f 00000004:00100000:2.0:1789760489.664966:0:6470:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789760489.664971:0:6470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789760489.666727:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6708bd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798050944:0@lo:400: 00000020:01000000:3.0:1789760489.666759:0:7262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789760489.666800:0:7262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789760489.666813:0:7262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000cd84be68/0xc2b9a3a73985684b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.666823:0:7262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000cd84be68/0xc2b9a3a73985684b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760489.666841:0:7262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e544828000 from 1 10000000:01000000:3.0:1789760489.666844:0:7262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789760489.666866:0:7262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760489.666873:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760489.666873:0:7262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.666882:0:7262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760489.666894:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051072:0@lo:101: 00000100:00100000:3.0:1789760489.666923:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.666948:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 000000004aeff500 going to sleep for 11 seconds 00000100:00100000:1.0:1789760489.666958:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798051072 00000100:00100000:1.0:1789760489.666964:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798051072 00000100:00100000:1.0:1789760489.667007:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760489.667015:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e06982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+12:7262:x1876699798051072:12345-0@lo:101: 00010000:00010000:1.0:1789760489.667027:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760489.667038:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398568a6 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.667058:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 13 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.667068:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 13 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.667081:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038a4aee8, rc 0) 00000100:00100000:1.0:1789760489.667113:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e06982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:7262:x1876699798051072:12345-0@lo:101: Request processed in 100us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760489.667120:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789760489.667249:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051072:0@lo:101: 00010000:00010000:3.0:1789760489.667262:0:7262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.667270:0:7262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760489.667898:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798050944 00000100:00100000:2.0:1789760489.667905:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798050944 00000100:00100000:2.0:1789760489.667937:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760489.667943:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a826536a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798050944:12345-0@lo:400: 00000100:00100000:2.0:1789760489.668007:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a826536a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798050944:12345-0@lo:400: Request processed in 65us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.668014:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789760489.668131:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b6708bd6 x1876699798050944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760489.668145:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6708bd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798050944:0@lo:400: 00000100:00100000:3.0:1789760489.668693:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051200:0@lo:256: 00000100:00100000:3.0:1789760489.668738:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760489.668767:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 000000004aeff500 going to sleep for 11 seconds 00000100:00100000:1.0:1789760489.669131:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798051200 00000100:00100000:1.0:1789760489.669137:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798051200 00000100:00100000:1.0:1789760489.669434:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789760489.669442:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ffa996a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:7262:x1876699798051200:12345-0@lo:256: 20000000:01000000:1.0:1789760489.669460:0:6457:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789760489.669474:0:6457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789760489.669477:0:6457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789760489.669571:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ffa996a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:7262:x1876699798051200:12345-0@lo:256: Request processed in 130us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760489.669579:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789760489.671396:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051200:0@lo:256: 10000000:01000000:1.0:1789760489.672272:0:7262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789760489.672286:0:7262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.672297:0:7262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760489.672305:0:7262:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e544828000 from 1 10000000:01000000:1.0:1789760489.672308:0:7262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760489.672341:0:7262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.672348:0:7262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.672356:0:7262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760489.672373:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004024c716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051328:0@lo:101: 00000100:00100000:1.0:1789760489.672445:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760489.672551:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087b4cfc6 going to sleep for 11 seconds 00000100:00100000:3.0:1789760489.673202:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798051328 00000100:00100000:3.0:1789760489.673211:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798051328 00000100:00100000:3.0:1789760489.673254:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760489.673262:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6f68583 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:7262:x1876699798051328:12345-0@lo:101: 00010000:00010000:3.0:1789760489.673287:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760489.673300:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398568b4 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.673324:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 14 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.673333:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 14 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.673341:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f4565ff, rc 0) 00000100:00100000:3.0:1789760489.673392:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6f68583 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:7262:x1876699798051328:12345-0@lo:101: Request processed in 127us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760489.673399:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789760489.673453:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004024c716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051328:0@lo:101: 00010000:00010000:1.0:1789760489.673661:0:7262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760489.673679:0:7262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760489.673911:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004024c716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051456:0@lo:501: 00000100:00100000:1.0:1789760489.673940:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760489.673961:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087b4cfc6 going to sleep for 11 seconds 00000100:00100000:1.0:1789760489.673975:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798051456 00000100:00100000:1.0:1789760489.673979:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798051456 00000100:00100000:1.0:1789760489.674015:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760489.674020:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003745b470 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:7262:x1876699798051456:12345-0@lo:501: 00000100:00100000:1.0:1789760489.674147:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003745b470 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:7262:x1876699798051456:12345-0@lo:501: Request processed in 127us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760489.674167:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789760489.674903:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004024c716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051456:0@lo:501: 00000100:00100000:0.0:1789760489.674937:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf9c34dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051584:0@lo:503: 00000100:00100000:0.0:1789760489.674991:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.675078:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074d2046a going to sleep for 11 seconds 00000100:00100000:1.0:1789760489.677069:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798051584 00000100:00100000:1.0:1789760489.677082:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798051584 00000100:00100000:1.0:1789760489.677134:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789760489.677143:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040ae1b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:7262:x1876699798051584:12345-0@lo:503: 00000040:00080000:1.0:1789760489.677199:0:6457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760489.677287:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040ae1b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:7262:x1876699798051584:12345-0@lo:503: Request processed in 145us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760489.677294:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789760489.677480:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf9c34dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051584:0@lo:503: 00000040:00080000:1.0:1789760489.678283:0:7262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760489.678344:0:7262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1789760489.678419:0:7262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760489.681877:0:7277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789760489.682040:0:7262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789760489.682067:0:7262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760489.682084:0:7262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.682096:0:7262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760489.682140:0:7262:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789760489.682142:0:7262:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e544828000 10000000:01000000:0.0:1789760489.682145:0:7262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e544828000 10000000:01000000:0.0:1789760489.682148:0:7262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760489.682153:0:7262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e544828000 from 1 10000000:01000000:0.0:1789760489.682156:0:7262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760489.682188:0:7262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a7398568c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.682203:0:7262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a7398568c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.682214:0:7262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a7398568c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760489.682235:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000832164be pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051712:0@lo:101: 00000100:00100000:0.0:1789760489.682300:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.682347:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054fafb21 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.682403:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798051712 00000100:00100000:2.0:1789760489.682410:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798051712 00000100:00100000:2.0:1789760489.682449:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789760489.682455:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6310618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:7262:x1876699798051712:12345-0@lo:101: 00010000:00010000:2.0:1789760489.682467:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760489.682478:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8326e36/0xc2b9a3a7398568c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398568c2 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.682497:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8326e36/0xc2b9a3a7398568c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 15 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.682506:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8326e36/0xc2b9a3a7398568c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 15 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.682513:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8326e36, rc 0) 00000100:00100000:2.0:1789760489.682552:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6310618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798051712:12345-0@lo:101: Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.682558:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789760489.682700:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000832164be pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051712:0@lo:101: 00010000:00010000:0.0:1789760489.682713:0:7262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a7398568c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.682720:0:7262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a7398568c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760489.682885:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000832164be pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051840:0@lo:501: 00000100:00100000:0.0:1789760489.682910:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.682926:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054fafb21 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.682973:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798051840 00000100:00100000:2.0:1789760489.682977:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798051840 00000100:00100000:2.0:1789760489.683011:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789760489.683017:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c55e350 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798051840:12345-0@lo:501: 00000100:00100000:2.0:1789760489.683177:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c55e350 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798051840:12345-0@lo:501: Request processed in 160us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.683185:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760489.683246:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000832164be pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051840:0@lo:501: 00000100:00100000:0.0:1789760489.683269:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000832164be pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051968:0@lo:503: 00000100:00100000:0.0:1789760489.683299:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.683319:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054fafb21 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.683356:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798051968 00000100:00100000:2.0:1789760489.683359:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798051968 00000100:00100000:2.0:1789760489.683382:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789760489.683388:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d3c4ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798051968:12345-0@lo:503: 00000100:00100000:2.0:1789760489.683535:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d3c4ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798051968:12345-0@lo:503: Request processed in 147us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.683542:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789760489.683607:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000832164be pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798051968:0@lo:503: 00000040:00080000:0.0:1789760489.684063:0:7262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760489.684118:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000832164be pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798052096:0@lo:502: 00000100:00100000:0.0:1789760489.684150:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.684179:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054fafb21 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.684301:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798052096 00000100:00100000:2.0:1789760489.684306:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798052096 00000100:00100000:2.0:1789760489.684326:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789760489.684331:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090aa9eef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798052096:12345-0@lo:502: 00000100:00100000:2.0:1789760489.684546:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090aa9eef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798052096:12345-0@lo:502: Request processed in 214us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.684552:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789760489.687040:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000832164be pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798052096:0@lo:502: 00000040:00080000:1.0:1789760489.687324:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789760489.687384:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789760489.687420:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789760489.687466:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789760489.687504:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789760489.687572:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789760489.687610:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789760489.687660:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789760489.687712:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789760489.687750:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789760489.687882:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789760489.687940:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789760489.688004:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789760489.688044:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789760489.688110:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789760489.688148:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789760489.688181:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789760489.688230:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789760489.688268:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789760489.688301:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789760489.688354:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789760489.688392:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789760489.688429:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789760489.688482:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789760489.688522:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789760489.688558:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789760489.688609:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789760489.688647:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789760489.688688:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b4c51a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798052224:0@lo:502: 00000100:00100000:1.0:1789760489.688761:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760489.689093:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1319dc1 going to sleep for 11 seconds 00000100:00100000:0.0:1789760489.689728:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798052224 00000100:00100000:0.0:1789760489.689737:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798052224 00000100:00100000:0.0:1789760489.690043:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789760489.690054:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003015f234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798052224:12345-0@lo:502: 00000100:00100000:0.0:1789760489.690293:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003015f234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798052224:12345-0@lo:502: Request processed in 243us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760489.690301:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789760489.690384:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b4c51a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798052224:0@lo:502: 00000040:00080000:1.0:1789760489.690472:0:7262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789760489.690485:0:7262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789760489.692402:0:7278:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789760489.692417:0:7278:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000081623ef5) 00000020:00000080:0.0:1789760489.692438:0:7278:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789760489.692525:0:7278:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000096a4287 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789760489.692529:0:7278:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000096a4287 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789760489.692531:0:7278:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000096a4287 3 00010000:00080000:0.0:1789760489.692559:0:7278:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000000d88581@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1789760489.694747:0:7278:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1789760489.694969:0:7278:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789760489.695016:0:7278:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789760489.695028:0:7278:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc2b9a3a7398568d7 00000100:00080000:0.0:1789760489.695037:0:7278:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760489.695042:0:7278:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000000d88581 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1789760489.695072:0:7278:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000af82f625 x1876699798052352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760489.695093:0:7278:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789760489.695472:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af82f625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3460:1876699798052352:0@lo:38: 00000100:00100000:2.0:1789760489.695542:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.695608:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798052352 00000100:00100000:2.0:1789760489.695624:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798052352 00000100:00100000:2.0:1789760489.695672:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760489.695679:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df23b536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3460:x1876699798052352:12345-0@lo:38: 00010000:00080000:2.0:1789760489.695703:0:6467:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:2.0:1789760489.695738:0:6467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc2b9a3a7398568de 00000004:00100000:2.0:1789760489.695752:0:6467:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789760489.695780:0:6467:0:(import.c:65:import_set_state_nolock()) 00000000d566c5d6 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760489.695997:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df23b536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1876699798052352:12345-0@lo:38: Request processed in 316us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.696006:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789760489.696044:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000af82f625 x1876699798052352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760489.696054:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789760489.696061:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789760489.696067:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789760489.696070:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789760489.696073:0:3460:0:(import.c:65:import_set_state_nolock()) 0000000000d88581 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789760489.696077:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af82f625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3460:1876699798052352:0@lo:38: 00000040:00080000:0.0:1789760489.696302:0:7278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789760489.697276:0:7262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789760489.697304:0:7262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789760489.697326:0:7262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a7398568c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.697337:0:7262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000357ab3f2/0xc2b9a3a7398568c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789760489.697385:0:7262:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789760489.697391:0:7262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789760489.697392:0:7262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760489.697393:0:7262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760489.697394:0:7262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760489.697396:0:7262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760489.697397:0:7262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760489.697398:0:7262:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760489.697399:0:7262:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760489.697400:0:7262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760489.697401:0:7262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789760489.697405:0:7262:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789760489.697407:0:7262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789760489.697408:0:7262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789760489.697409:0:7262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760489.697410:0:7262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760489.697411:0:7262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760489.697412:0:7262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760489.697412:0:7262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760489.697413:0:7262:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760489.697414:0:7262:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760489.697415:0:7262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760489.697416:0:7262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789760489.697434:0:7262:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789760489.697448:0:7262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e1e5f23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798052480:0@lo:253: 00000100:00100000:2.0:1789760489.697596:0:7262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.697666:0:7262:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d92f989b going to sleep for 11 seconds 00000100:00080000:2.0:1789760489.697973:0:6470:0:(import.c:65:import_set_state_nolock()) 00000000cd3d8daf : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760489.698031:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d9ded27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3460:x1876699798050816:12345-0@lo:38: Request processed in 33131us (33320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.698040:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 40000000:00080000:2.0:1789760489.698099:0:7279:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1789760489.698252:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760489.698260:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789760489.698267:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789760489.698272:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789760489.698274:0:3460:0:(import.c:65:import_set_state_nolock()) 000000006159b73e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789760489.698292:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbb2b228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3460:1876699798050816:0@lo:38: 00000100:00100000:2.0:1789760489.698388:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798052608:0@lo:41: 00000100:00100000:2.0:1789760489.698417:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.698454:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798052608 00000100:00100000:2.0:1789760489.698470:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798052608 00000100:00100000:2.0:1789760489.698504:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760489.698510:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a096992 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798052608:12345-0@lo:41: 00000004:00000024:2.0:1789760489.698535:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760489.698571:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a096992 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798052608:12345-0@lo:41: Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.698577:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760489.698608:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798052608:0@lo:41: 00000100:00100000:0.0:1789760489.702579:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798052480 00000100:00100000:0.0:1789760489.702604:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798052480 00000100:00100000:0.0:1789760489.702777:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789760489.703302:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c09cdcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7262:x1876699798052480:12345-0@lo:253: 20000000:01000000:0.0:1789760489.703350:0:6457:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789760489.703363:0:6457:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789760489.747721:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789760489.747823:0:6457:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789760489.747835:0:6457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789760489.747967:0:6481:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789760489.747972:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789760489.747999:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748018:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 15 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748025:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 15 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748031:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748070:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 15 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748083:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 15 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760489.748096:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003dc6d542 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798052736:0@lo:104: 00000100:00100000:0.0:1789760489.748156:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760489.748369:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 15 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748396:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 15 pid: 6460 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760489.748405:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005472d85e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798052864:0@lo:104: 00000100:00100000:0.0:1789760489.748431:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.748448:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000004684fdc3 going to sleep for 11 seconds 00000100:00100000:0.0:1789760489.748472:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798052736 00000100:00100000:0.0:1789760489.748479:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798052736 00000100:00100000:0.0:1789760489.748513:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798052864 00000100:00100000:0.0:1789760489.748516:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798052864 00000100:00100000:0.0:1789760489.748530:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760489.748536:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d95a8880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6481:x1876699798052736:12345-0@lo:104: 00010000:00010000:0.0:1789760489.748549:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748603:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760489.748609:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d95a8880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6481:x1876699798052736:12345-0@lo:104: Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760489.748615:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760489.748631:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760489.748636:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000108083fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6481:x1876699798052864:12345-0@lo:104: 00010000:00010000:0.0:1789760489.748642:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748671:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760489.748675:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000108083fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6481:x1876699798052864:12345-0@lo:104: Request processed in 40us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760489.748690:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789760489.748709:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760489.748713:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748720:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008685ba91 already unused, calling callback (00000000cdd84c74) 10000000:00010000:0.0:1789760489.748723:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748730:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760489.748736:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760489.748742:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760489.748766:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748772:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760489.748879:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760489.748942:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748950:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000008685ba91/0xc2b9a3a7398568a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568ad expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.748964:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760489.748966:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760489.748967:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760489.748994:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009759b104 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798052992:0@lo:103: 00000100:00100000:0.0:1789760489.749029:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.749159:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003dc6d542 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798052736:0@lo:104: 00000100:00100000:0.0:1789760489.749167:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005472d85e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798052864:0@lo:104: 00010000:00010000:0.0:1789760489.749183:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760489.749433:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798052992 00000100:00100000:3.0:1789760489.749440:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798052992 00010000:00010000:3.0:1789760489.749459:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 16 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760489.749481:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760489.749488:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2d8aa56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:3464:x1876699798052992:12345-0@lo:103: 00010000:00010000:3.0:1789760489.749497:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760489.749502:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 16 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.749511:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 16 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.749531:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038a4aee8/0xc2b9a3a7398568ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398568a6 expref: 16 pid: 6457 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760489.749543:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760489.749579:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2d8aa56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:3464:x1876699798052992:12345-0@lo:103: Request processed in 92us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760489.749586:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760489.749657:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009759b104 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798052992:0@lo:103: 00010000:00010000:2.0:1789760489.749850:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760489.749857:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.749864:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000204dfe0f already unused, calling callback (00000000cdd84c74) 10000000:00010000:2.0:1789760489.749866:0:6453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.749873:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760489.749878:0:6453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760489.749883:0:6453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760489.749904:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.749910:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760489.749922:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.749928:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 00000000204dfe0f/0xc2b9a3a7398567fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856805 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.749957:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760489.749959:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760489.749960:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760489.749967:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760489.749976:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798053120:0@lo:103: 00000100:00100000:2.0:1789760489.750020:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.750048:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798053120 00000100:00100000:2.0:1789760489.750052:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798053120 00010000:00010000:2.0:1789760489.750066:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 15 pid: 6460 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760489.750084:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760489.750090:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031aa5f3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:3462:x1876699798053120:12345-0@lo:103: 00010000:00010000:2.0:1789760489.750097:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760489.750100:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 15 pid: 6460 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750109:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 15 pid: 6460 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750119:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007a25da76/0xc2b9a3a739856805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398567fe expref: 15 pid: 6460 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750130:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750138:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789760489.750162:0:6450:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002190084s 00010000:00010000:2.0:1789760489.750165:0:6450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750171:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750176:0:6450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750182:0:6450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750187:0:6450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df0b6608 already unused, calling callback (0000000011508811) 00010000:00010000:2.0:1789760489.750190:0:6450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750196:0:6450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750225:0:6450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760489.750233:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760489.750261:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031aa5f3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:3462:x1876699798053120:12345-0@lo:103: Request processed in 172us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.750268:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760489.750316:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798053120:0@lo:103: 00010000:00010000:2.0:1789760489.750331:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760489.750338:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760489.750489:0:6481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.750497:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760489.750502:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df0b6608/0xc2b9a3a7398568e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760489.756236:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c09cdcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:7262:x1876699798052480:12345-0@lo:253: Request processed in 53444us (58633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.756253:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789760489.756375:0:7262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e1e5f23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7262:1876699798052480:0@lo:253: 10000000:01000000:0.0:1789760489.756389:0:7262:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789760489.756392:0:7262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760489.756394:0:7262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789760489.756395:0:7262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760489.756396:0:7262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760489.756398:0:7262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760489.756399:0:7262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760489.756400:0:7262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789760489.756402:0:7262:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760489.756593:0:7262:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760489.756595:0:7262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760489.756596:0:7262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789760489.756612:0:7262:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789760489.761975:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760489.762458:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760489.762889:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760489.763268:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760489.763507:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760489.763757:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789760489.765061:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760489.765352:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789760489.765551:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760489.766134:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789760489.766375:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760489.766583:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:0.0:1789760489.769595:0:7262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1789760489.770101:0:7285:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1789760489.770150:0:7285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009759b104 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7285:1876699798053248:0@lo:700: 00000100:00100000:0.0:1789760489.770223:0:7285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.770260:0:7285:0:(client.c:2715:ptlrpc_set_wait()) set 000000009477a387 going to sleep for 11 seconds 00000020:00080000:3.0:1789760489.770316:0:7284:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789760489.770320:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789760489.770382:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798053248 00000100:00100000:1.0:1789760489.770390:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798053248 00000100:00100000:1.0:1789760489.770439:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760489.770447:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005472d85e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7285:x1876699798053248:12345-0@lo:700: 00000040:01000000:2.0:1789760489.771310:0:7262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789760489.775309:0:7286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b4c51a6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798053376:0@lo:1000: 00000100:00100000:1.0:1789760489.775378:0:7286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760489.775417:0:7286:0:(client.c:2715:ptlrpc_set_wait()) set 00000000550d1b1c going to sleep for 11 seconds 00000040:01000000:3.0:1789760489.776155:0:7262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789760489.776296:0:7262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789760489.776719:0:7262:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789760489.776725:0:7262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789760489.776878:0:7262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760489.777815:0:7262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789760489.778354:0:7262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789760489.778385:0:7262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789760489.778608:0:7262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789760489.778816:0:7262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000100:00100000:2.0:1789760489.779464:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798053376 00000100:00100000:2.0:1789760489.779476:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798053376 00000100:00100000:2.0:1789760489.779522:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760489.779530:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2e0a749 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798053376:12345-0@lo:1000: 00000100:00100000:2.0:1789760489.779652:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2e0a749 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798053376:12345-0@lo:1000: Request processed in 123us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.779660:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760489.779710:0:7286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b4c51a6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798053376:0@lo:1000: 00000040:01000000:2.0:1789760489.779742:0:7286:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789760489.779780:0:7286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798053504:0@lo:700: 00000100:00100000:2.0:1789760489.779843:0:7286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.779877:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798053504 00000100:00100000:2.0:1789760489.779880:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798053504 00000100:00100000:2.0:1789760489.779904:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760489.779909:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000050dd193 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798053504:12345-0@lo:700: 00000100:00100000:2.0:1789760489.779943:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000050dd193 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798053504:12345-0@lo:700: Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.779958:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760489.779988:0:7286:0:(client.c:2715:ptlrpc_set_wait()) set 000000000de77454 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.780003:0:7286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798053504:0@lo:700: 00000100:00100000:2.0:1789760489.780041:0:7286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7286:1876699798053632:0@lo:900: 00000100:00100000:2.0:1789760489.780065:0:7286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.780092:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798053632 00000100:00100000:2.0:1789760489.780096:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798053632 00000100:00100000:2.0:1789760489.780119:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760489.780124:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8bada43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7286:x1876699798053632:12345-0@lo:900: 00000100:00100000:2.0:1789760489.780154:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8bada43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7286:x1876699798053632:12345-0@lo:900: Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.780161:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760489.780175:0:7286:0:(client.c:2715:ptlrpc_set_wait()) set 000000000de77454 going to sleep for 11 seconds 00010000:00080000:2.0:1789760489.780189:0:7286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009b09ac31 x1876699798053632/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789760505 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760489.780198:0:7286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7286:1876699798053632:0@lo:900: 00000100:00100000:2.0:1789760489.780882:0:7286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798053760:0@lo:1000: 00000100:00100000:2.0:1789760489.780917:0:7286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.780944:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798053760 00000100:00100000:2.0:1789760489.780949:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798053760 00000100:00100000:2.0:1789760489.780978:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760489.780997:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003409ccc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798053760:12345-0@lo:1000: 00000100:00100000:2.0:1789760489.781053:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003409ccc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798053760:12345-0@lo:1000: Request processed in 58us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.781060:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760489.781086:0:7286:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063977e17 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.781100:0:7286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798053760:0@lo:1000: 00000004:00080000:2.0:1789760489.781136:0:7286:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000de77454 with version 0 00000020:00100000:2.0:1789760489.781148:0:7286:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760489.781153:0:7286:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009b09ac31 x1876699798054016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760489.781165:0:7286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798054016:0@lo:1000: 00000100:00100000:2.0:1789760489.781188:0:7286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.781206:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798054016 00000100:00100000:2.0:1789760489.781210:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798054016 00000100:00100000:2.0:1789760489.781229:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760489.781234:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f965401b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798054016:12345-0@lo:1000: 00000100:00100000:2.0:1789760489.782977:0:7286:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4db4ea3 going to sleep for 11 seconds 00100000:10000000:3.0:1789760489.784149:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789760489.784296:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789760489.784438:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789760489.784610:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789760489.784988:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789760489.785195:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789760489.785349:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789760489.785487:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789760489.785628:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789760489.787558:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789760489.791212:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789760489.791416:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789760489.791604:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789760489.792026:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789760489.792182:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789760489.792333:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789760489.792592:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789760489.795127:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789760489.795320:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789760489.795459:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789760489.795613:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789760489.795860:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789760489.796006:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789760489.796167:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789760489.796323:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789760489.796452:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789760489.796588:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789760489.796729:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789760489.796927:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789760489.799115:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789760489.799311:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789760489.799472:0:7262:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789760489.800758:0:7262:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 40000000:02000000:1.0:1789760489.841546:0:6472:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1789760489.850515:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005472d85e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7285:x1876699798053248:12345-0@lo:700: Request processed in 80061us (80285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760489.850531:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789760489.854744:0:7285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009759b104 x1876699798053248/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760505 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760489.854766:0:7285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009759b104 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7285:1876699798053248:0@lo:700: 40000000:02000000:0.0:1789760489.854783:0:7285:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1789760489.894269:0:7262:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789760489.894305:0:7262:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb0f9c2b97988 00100000:10000000:2.0:1789760489.894313:0:7262:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789760489.898903:0:7262:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789760489.899600:0:7262:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789760489.899621:0:7262:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789760489.899651:0:7262:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000001:00080000:0.0:1789760489.926396:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1789760489.926588:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f965401b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798054016:12345-0@lo:1000: Request processed in 145350us (145395us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789760489.926601:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789760489.926664:0:7286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789760489.926669:0:7286:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789760489.926685:0:7286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798054016:0@lo:1000: 00000100:00100000:2.0:1789760489.926774:0:7286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798054144:0@lo:1000: 00000100:00100000:2.0:1789760489.926833:0:7286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760489.926868:0:7286:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4db4ea3 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.926884:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798054144 00000100:00100000:2.0:1789760489.926896:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798054144 00000100:00100000:2.0:1789760489.926931:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760489.926938:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be54e7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798054144:12345-0@lo:1000: 00000100:00100000:2.0:1789760489.927015:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be54e7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7286:x1876699798054144:12345-0@lo:1000: Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760489.927021:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760489.927048:0:7286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7286:1876699798054144:0@lo:1000: 00000040:00080000:2.0:1789760489.927065:0:7286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789760489.927093:0:7286:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000bbc77c83 with version 1 00000040:00080000:2.0:1789760489.929103:0:7286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789760489.929184:0:7286:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789760489.931492:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000001c45a39d version 1 rpc_version 1 00000020:00100000:0.0:1789760489.931534:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789760489.931544:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009759b104 x1876699798054400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789760489.931567:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009759b104 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798054400:0@lo:1000: 00000100:00100000:0.0:1789760489.931650:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760489.931685:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd93dc68 going to sleep for 11 seconds 00000100:00100000:2.0:1789760489.931743:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798054400 00000100:00100000:2.0:1789760489.931751:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798054400 00000100:00100000:2.0:1789760489.931825:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760489.931834:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dc6d542 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7275:x1876699798054400:12345-0@lo:1000: 00000001:00080000:0.0:1789760489.955005:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1789760489.955336:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dc6d542 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7275:x1876699798054400:12345-0@lo:1000: Request processed in 23500us (23683us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789760489.955348:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789760489.955398:0:7275:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789760489.955403:0:7275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789760489.955419:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009759b104 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798054400:0@lo:1000: 00010000:00010000:1.0:1789760489.992313:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789760490.039298:0:7285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 10000000:01000000:0.0:1789760490.064698:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789760490.064713:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e544828000 from 4 10000000:01000000:0.0:1789760490.064719:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789760490.064756:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000df0b6608/0xc2b9a3a7398568ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760490.064767:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000df0b6608/0xc2b9a3a7398568ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760490.064777:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000df0b6608/0xc2b9a3a7398568ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760490.064830:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb784c28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798054528:0@lo:101: 00000100:00100000:2.0:1789760490.064911:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.064951:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000923e6e10 going to sleep for 11 seconds 00000100:00100000:2.0:1789760490.064968:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798054528 00000100:00100000:2.0:1789760490.064973:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798054528 00000100:00100000:2.0:1789760490.065027:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760490.065034:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abc12b65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:6462:x1876699798054528:12345-0@lo:101: 00010000:00010000:2.0:1789760490.065054:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760490.065065:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e8c3718/0xc2b9a3a7398568f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398568ec expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760490.065085:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e8c3718/0xc2b9a3a7398568f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 14 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760490.065095:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e8c3718/0xc2b9a3a7398568f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 14 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760490.065103:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e8c3718, rc 0) 00000100:00100000:2.0:1789760490.065151:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abc12b65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:6462:x1876699798054528:12345-0@lo:101: Request processed in 117us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760490.065158:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789760490.065179:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb784c28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798054528:0@lo:101: 00010000:00010000:3.0:1789760490.065198:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000df0b6608/0xc2b9a3a7398568ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760490.065206:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000df0b6608/0xc2b9a3a7398568ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760490.065253:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0b7f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798054656:0@lo:256: 00000100:00100000:3.0:1789760490.065284:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760490.065307:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a497ae9 going to sleep for 11 seconds 00000100:00100000:2.0:1789760490.065414:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798054656 00000100:00100000:2.0:1789760490.065419:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798054656 00000100:00100000:2.0:1789760490.065442:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760490.065448:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd94e7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:6462:x1876699798054656:12345-0@lo:256: 20000000:01000000:2.0:1789760490.065460:0:6457:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789760490.065474:0:6457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789760490.065477:0:6457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789760490.065560:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd94e7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:6462:x1876699798054656:12345-0@lo:256: Request processed in 112us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760490.065567:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789760490.065601:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0b7f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798054656:0@lo:256: 10000000:01000000:3.0:1789760490.065638:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789760490.065644:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000df0b6608/0xc2b9a3a7398568ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760490.065651:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000df0b6608/0xc2b9a3a7398568ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760490.065660:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760490.065661:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e546616000 from 21 10000000:01000000:3.0:1789760490.065664:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760490.065677:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000005d861f62/0xc2b9a3a7398568fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760490.065683:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000005d861f62/0xc2b9a3a7398568fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760490.065688:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000005d861f62/0xc2b9a3a7398568fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760490.065707:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0b7f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798054784:0@lo:101: 00000100:00100000:3.0:1789760490.065730:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760490.065751:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a497ae9 going to sleep for 11 seconds 00000100:00100000:2.0:1789760490.065942:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798054784 00000100:00100000:2.0:1789760490.065947:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798054784 00000100:00100000:2.0:1789760490.065975:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760490.065990:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004485bd70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:6462:x1876699798054784:12345-0@lo:101: 00010000:00010000:2.0:1789760490.065998:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760490.066011:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a360a7a7/0xc2b9a3a739856901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398568fa expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760490.066024:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a360a7a7/0xc2b9a3a739856901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 15 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760490.066031:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a360a7a7/0xc2b9a3a739856901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 15 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760490.066038:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a360a7a7, rc 0) 00000100:00100000:2.0:1789760490.066066:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004485bd70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798054784:12345-0@lo:101: Request processed in 77us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760490.066071:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760490.066109:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0b7f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798054784:0@lo:101: 00010000:00010000:2.0:1789760490.066117:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000005d861f62/0xc2b9a3a7398568fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760490.066124:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000005d861f62/0xc2b9a3a7398568fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760490.066166:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798054912:0@lo:501: 00000100:00100000:2.0:1789760490.066189:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.066208:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc066b51 going to sleep for 11 seconds 00000100:00100000:2.0:1789760490.066217:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798054912 00000100:00100000:2.0:1789760490.066220:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798054912 00000100:00100000:2.0:1789760490.066237:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760490.066242:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001023499f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798054912:12345-0@lo:501: 00000100:00100000:2.0:1789760490.066499:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001023499f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798054912:12345-0@lo:501: Request processed in 256us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760490.066513:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760490.066555:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798054912:0@lo:501: 00000100:00100000:2.0:1789760490.066578:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055040:0@lo:503: 00000100:00100000:2.0:1789760490.066608:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.066618:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc066b51 going to sleep for 11 seconds 00000100:00100000:2.0:1789760490.066627:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798055040 00000100:00100000:2.0:1789760490.066630:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798055040 00000100:00100000:2.0:1789760490.066659:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789760490.066663:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037b9e5c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798055040:12345-0@lo:503: 00000100:00100000:2.0:1789760490.066927:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037b9e5c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798055040:12345-0@lo:503: Request processed in 263us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760490.066934:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789760490.066967:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b09ac31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055040:0@lo:503: 00000100:00100000:1.0:1789760490.072666:0:7293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7293:1876699798055168:0@lo:502: 00000100:00100000:1.0:1789760490.072750:0:7293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.072866:0:7293:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b2e68e4 going to sleep for 11 seconds 00000100:00100000:3.0:1789760490.072959:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798055168 00000100:00100000:3.0:1789760490.072967:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798055168 00000100:00100000:3.0:1789760490.073054:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789760490.073062:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038671dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7293:x1876699798055168:12345-0@lo:502: 00000100:00100000:3.0:1789760490.073658:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038671dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7293:x1876699798055168:12345-0@lo:502: Request processed in 595us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760490.073666:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789760490.073899:0:7293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7293:1876699798055168:0@lo:502: 00000100:00100000:1.0:1789760490.074372:0:7293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7293:1876699798055296:0@lo:502: 00000100:00100000:1.0:1789760490.074726:0:7293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.074758:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798055296 00000100:00100000:1.0:1789760490.074764:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798055296 00000100:00100000:1.0:1789760490.074811:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789760490.074817:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b161cfe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7293:x1876699798055296:12345-0@lo:502: 00000100:00100000:1.0:1789760490.074999:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b161cfe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:7293:x1876699798055296:12345-0@lo:502: Request processed in 182us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.075007:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789760490.075049:0:7293:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b2e68e4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.075064:0:7293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7293:1876699798055296:0@lo:502: 00000040:00080000:1.0:1789760490.075084:0:7293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789760490.075138:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789760490.075156:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760490.075164:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000005d861f62/0xc2b9a3a7398568fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075175:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000005d861f62/0xc2b9a3a7398568fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760490.075183:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789760490.075186:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e546616000 from 4 10000000:01000000:1.0:1789760490.075189:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789760490.075211:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000038a4aee8/0xc2b9a3a739856908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075218:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000038a4aee8/0xc2b9a3a739856908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075237:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000038a4aee8/0xc2b9a3a739856908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760490.075249:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055424:0@lo:101: 00000100:00100000:1.0:1789760490.075277:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.075293:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b2e68e4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.075305:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798055424 00000100:00100000:1.0:1789760490.075309:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798055424 00000100:00100000:1.0:1789760490.075329:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789760490.075335:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000041a33bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798055424:12345-0@lo:101: 00010000:00010000:1.0:1789760490.075343:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760490.075353:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000488b157c/0xc2b9a3a73985690f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856908 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075370:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000488b157c/0xc2b9a3a73985690f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075379:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000488b157c/0xc2b9a3a73985690f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075387:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000488b157c, rc 0) 00000100:00100000:1.0:1789760490.075414:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000041a33bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798055424:12345-0@lo:101: Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.075420:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789760490.075447:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055424:0@lo:101: 00010000:00010000:1.0:1789760490.075458:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000038a4aee8/0xc2b9a3a739856908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075489:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000038a4aee8/0xc2b9a3a739856908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760490.075540:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055552:0@lo:256: 00000100:00100000:1.0:1789760490.075569:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.075581:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b2e68e4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.075592:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798055552 00000100:00100000:1.0:1789760490.075595:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798055552 00000100:00100000:1.0:1789760490.075616:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789760490.075622:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e502b5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798055552:12345-0@lo:256: 20000000:01000000:1.0:1789760490.075634:0:6459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789760490.075649:0:6459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789760490.075652:0:6459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789760490.075713:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e502b5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798055552:12345-0@lo:256: Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.075719:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789760490.075747:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055552:0@lo:256: 10000000:01000000:1.0:1789760490.075780:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789760490.075810:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000038a4aee8/0xc2b9a3a739856908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075818:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000038a4aee8/0xc2b9a3a739856908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760490.075826:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789760490.075827:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789760490.075829:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789760490.075846:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000072106473/0xc2b9a3a739856916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075852:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000072106473/0xc2b9a3a739856916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075858:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000072106473/0xc2b9a3a739856916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760490.075868:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055680:0@lo:101: 00000100:00100000:1.0:1789760490.075889:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.075905:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b2e68e4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.075922:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798055680 00000100:00100000:1.0:1789760490.075925:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798055680 00000100:00100000:1.0:1789760490.075943:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789760490.075948:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cd67777 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798055680:12345-0@lo:101: 00010000:00010000:1.0:1789760490.075954:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760490.075961:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c2bd372/0xc2b9a3a73985691d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856916 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075974:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c2bd372/0xc2b9a3a73985691d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.075994:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c2bd372/0xc2b9a3a73985691d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.076000:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c2bd372, rc 0) 00000100:00100000:1.0:1789760490.076026:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cd67777 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798055680:12345-0@lo:101: Request processed in 78us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.076032:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789760490.076067:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055680:0@lo:101: 00010000:00010000:1.0:1789760490.076075:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000072106473/0xc2b9a3a739856916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.076083:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000072106473/0xc2b9a3a739856916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760490.076120:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055808:0@lo:501: 00000100:00100000:1.0:1789760490.076144:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.076156:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b2e68e4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.076166:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798055808 00000100:00100000:1.0:1789760490.076169:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798055808 00000100:00100000:1.0:1789760490.076190:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789760490.076195:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002e2ca07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798055808:12345-0@lo:501: 00000100:00100000:1.0:1789760490.076401:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002e2ca07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798055808:12345-0@lo:501: Request processed in 206us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.076407:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789760490.076433:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055808:0@lo:501: 00000100:00100000:1.0:1789760490.076454:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055936:0@lo:503: 00000100:00100000:1.0:1789760490.076483:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.076495:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b2e68e4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.076505:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798055936 00000100:00100000:1.0:1789760490.076508:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798055936 00000100:00100000:1.0:1789760490.076525:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789760490.076530:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e03b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798055936:12345-0@lo:503: 00000100:00100000:1.0:1789760490.076777:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e03b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798055936:12345-0@lo:503: Request processed in 245us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.076810:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789760490.076847:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798055936:0@lo:503: 00000100:00100000:1.0:1789760490.079573:0:7295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7295:1876699798056064:0@lo:502: 00000100:00100000:1.0:1789760490.079643:0:7295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.079675:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798056064 00000100:00100000:1.0:1789760490.079682:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798056064 00000100:00100000:1.0:1789760490.079714:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789760490.079721:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040f6dbc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:7295:x1876699798056064:12345-0@lo:502: 00000100:00100000:1.0:1789760490.079972:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040f6dbc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:7295:x1876699798056064:12345-0@lo:502: Request processed in 251us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.079992:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789760490.080036:0:7295:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f93015b going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.080055:0:7295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7295:1876699798056064:0@lo:502: 00000020:01000000:1.0:1789760490.080078:0:7295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760490.080087:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760490.080089:0:7295:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789760490.080095:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789760490.080099:0:7295:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:1.0:1789760490.080118:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789760490.080131:0:7295:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000002aff33dd) 00000020:00000080:1.0:1789760490.080149:0:7295:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1789760490.080154:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789760490.080213:0:7295:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789760490.080218:0:7295:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789760490.080225:0:7295:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2b9a3a73985692b 00010000:00080000:1.0:1789760490.080252:0:7295:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000490e0793@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1789760490.081903:0:7295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789760490.083234:0:7295:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789760490.083245:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789760490.083271:0:7295:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789760490.083297:0:7295:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2b9a3a739856932 00000100:00080000:1.0:1789760490.083307:0:7295:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760490.083311:0:7295:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000490e0793 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1789760490.083341:0:7295:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fbaba8e0 x1876699798056192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789760490.083395:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1876699798056192:0@lo:38: 00000100:00100000:0.0:1789760490.083455:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789760490.083604:0:7295:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789760490.083674:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006feb15a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798056320:0@lo:400: 00000100:00100000:1.0:1789760490.083704:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.083737:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002ee5682 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798056448:0@lo:400: 00000100:00100000:1.0:1789760490.083762:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.083814:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798056320 00000100:00100000:1.0:1789760490.083820:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798056320 00000100:00100000:1.0:1789760490.083851:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798056448 00000100:00100000:1.0:1789760490.083854:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798056448 00000100:00100000:1.0:1789760490.083867:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760490.083873:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011ac7a8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798056320:12345-0@lo:400: 00000100:00100000:1.0:1789760490.083915:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011ac7a8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798056320:12345-0@lo:400: Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.083922:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760490.083935:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760490.083941:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a660a237 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798056448:12345-0@lo:400: 00000100:00100000:1.0:1789760490.083971:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a660a237 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798056448:12345-0@lo:400: Request processed in 31us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.083988:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789760490.084033:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000002ee5682 x1876699798056448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760490.084046:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002ee5682 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798056448:0@lo:400: 00010000:00080000:1.0:1789760490.084072:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006feb15a6 x1876699798056320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760490.084079:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006feb15a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798056320:0@lo:400: 00000040:01000000:1.0:1789760490.084114:0:7295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789760490.085529:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798056192 00000100:00100000:2.0:1789760490.085539:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798056192 00000100:00100000:2.0:1789760490.085569:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760490.085579:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095d9c0af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3460:x1876699798056192:12345-0@lo:38: 00010000:00080000:2.0:1789760490.085602:0:6471:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:2.0:1789760490.085645:0:6471:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2b9a3a739856939 00000004:00100000:2.0:1789760490.085660:0:6471:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789760490.085664:0:6471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789760490.089954:0:7298:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000e80c2270 x1876699798056576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760490.089971:0:7298:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f506247 going to sleep for 0 seconds 00000020:01000000:1.0:1789760490.091491:0:7295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760490.091501:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760490.091503:0:7295:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789760490.091506:0:7295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760490.091510:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760490.091511:0:7295:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760490.091513:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760490.091515:0:7295:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789760490.095393:0:7295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006feb15a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7295:1876699798056704:0@lo:502: 00000100:00100000:1.0:1789760490.095470:0:7295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.095508:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798056704 00000100:00100000:1.0:1789760490.095515:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798056704 00000100:00100000:1.0:1789760490.095569:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789760490.095577:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4e5c7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:7295:x1876699798056704:12345-0@lo:502: 00000100:00100000:1.0:1789760490.095782:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4e5c7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:7295:x1876699798056704:12345-0@lo:502: Request processed in 205us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.095817:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789760490.095865:0:7295:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ffb52e3 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.095885:0:7295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006feb15a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:7295:1876699798056704:0@lo:502: 00000020:01000000:1.0:1789760490.095912:0:7295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760490.095924:0:7295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760490.095926:0:7295:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760490.095932:0:7295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789760490.096395:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789760490.096413:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789760490.096421:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000072106473/0xc2b9a3a739856916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760490.096431:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000072106473/0xc2b9a3a739856916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760490.096441:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789760490.096443:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e550c219b8 from 1 10000000:01000000:3.0:1789760490.096446:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789760490.096469:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000073e095f/0xc2b9a3a739856940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760490.096476:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000073e095f/0xc2b9a3a739856940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760490.096484:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000073e095f/0xc2b9a3a739856940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760490.096505:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1a881e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798056832:0@lo:101: 00000100:00100000:3.0:1789760490.096548:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760490.096569:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a497ae9 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.100892:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798056832 00000100:00100000:1.0:1789760490.100906:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798056832 00000100:00100000:1.0:1789760490.100950:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789760490.100958:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070394313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798056832:12345-0@lo:101: 00010000:00010000:1.0:1789760490.100975:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760490.101003:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca37a9cc/0xc2b9a3a739856947 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856940 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.101223:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca37a9cc/0xc2b9a3a739856947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 18 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.101236:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca37a9cc/0xc2b9a3a739856947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 18 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.101244:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca37a9cc, rc 0) 00000100:00100000:1.0:1789760490.101356:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070394313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798056832:12345-0@lo:101: Request processed in 398us (4807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.101363:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789760490.102974:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1a881e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798056832:0@lo:101: 00010000:00010000:2.0:1789760490.103009:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000073e095f/0xc2b9a3a739856940 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760490.103092:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000073e095f/0xc2b9a3a739856940 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760490.103922:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006feb15a6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798056960:0@lo:501: 00000100:00100000:1.0:1789760490.103989:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.104156:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798056960 00000100:00100000:2.0:1789760490.104163:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798056960 00000100:00100000:2.0:1789760490.104200:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789760490.104207:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000361b3619 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798056960:12345-0@lo:501: 00000100:00100000:2.0:1789760490.104409:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000361b3619 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798056960:12345-0@lo:501: Request processed in 203us (430us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760490.104418:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789760490.104472:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f343b0c4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.104489:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006feb15a6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798056960:0@lo:501: 10000000:01000000:1.0:1789760490.104516:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789760490.104534:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000073e095f/0xc2b9a3a739856940 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760490.104555:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000073e095f/0xc2b9a3a739856940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789760490.111964:0:7285:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789760490.112050:0:7285:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789760490.112056:0:7285:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00080000:2.0:1789760490.182632:0:6471:0:(import.c:65:import_set_state_nolock()) 000000001c83a8f9 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760490.182719:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095d9c0af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3460:x1876699798056192:12345-0@lo:38: Request processed in 97139us (99263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760490.182730:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760490.184305:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789760490.184318:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789760490.184327:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789760490.184332:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789760490.184335:0:3460:0:(import.c:65:import_set_state_nolock()) 00000000490e0793 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789760490.184363:0:3460:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002f506247): req@00000000e80c2270 x1876699798056576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760490.184380:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbaba8e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1876699798056192:0@lo:38: 00000100:00100000:2.0:1789760490.184560:0:7298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.184614:0:7298:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f506247 going to sleep for 11 seconds 00000100:00100000:2.0:1789760490.184632:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798056576 00000100:00100000:2.0:1789760490.184639:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798056576 00000100:00100000:2.0:1789760490.184690:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760490.184700:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b09ac31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798056576:12345-0@lo:1000: 00000100:00100000:2.0:1789760490.184776:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b09ac31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798056576:12345-0@lo:1000: Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760490.184783:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760490.184833:0:7298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e80c2270 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798056576:0@lo:1000: 00000100:00100000:1.0:1789760490.185013:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9c6f082 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798057088:0@lo:41: 00000100:00100000:1.0:1789760490.185049:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.185514:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798057088 00000100:00100000:1.0:1789760490.185520:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798057088 00000100:00100000:1.0:1789760490.185549:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789760490.185555:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006feb15a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3464:x1876699798057088:12345-0@lo:41: 00000004:00000024:1.0:1789760490.185585:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760490.185632:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006feb15a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3464:x1876699798057088:12345-0@lo:41: Request processed in 77us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.185638:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:01000000:2.0:1789760490.186322:0:7298:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789760490.186365:0:7298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff2fc72c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057216:0@lo:1000: 00000100:00100000:2.0:1789760490.186411:0:7298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.186431:0:7298:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbc77c83 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.187258:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798057216 00000100:00100000:1.0:1789760490.187266:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798057216 00000100:00100000:1.0:1789760490.187306:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789760490.187314:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e1e5f23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798057216:12345-0@lo:1000: 00000100:00100000:1.0:1789760490.187478:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e1e5f23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798057216:12345-0@lo:1000: Request processed in 165us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.187485:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789760490.187522:0:7298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff2fc72c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057216:0@lo:1000: 00000100:00100000:1.0:1789760490.187577:0:7298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002ee5682 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057344:0@lo:700: 00000100:00100000:1.0:1789760490.187606:0:7298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.187625:0:7298:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003a02099 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.187658:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798057344 00000100:00100000:1.0:1789760490.187667:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798057344 00000100:00100000:1.0:1789760490.187695:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760490.187701:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074895551 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798057344:12345-0@lo:700: 00000100:00100000:0.0:1789760490.188011:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9c6f082 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798057088:0@lo:41: 00000100:00100000:1.0:1789760490.188849:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074895551 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798057344:12345-0@lo:700: Request processed in 1147us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.188860:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760490.188899:0:7298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002ee5682 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057344:0@lo:700: 00000100:00100000:2.0:1789760490.189016:0:7298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbb2b228 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057472:0@lo:1000: 00000100:00100000:2.0:1789760490.189065:0:7298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.189084:0:7298:0:(client.c:2715:ptlrpc_set_wait()) set 000000000cbc5a63 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.189338:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798057472 00000100:00100000:1.0:1789760490.189345:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798057472 00000100:00100000:1.0:1789760490.189385:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789760490.189393:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d89801bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798057472:12345-0@lo:1000: 00000100:00100000:1.0:1789760490.189461:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d89801bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798057472:12345-0@lo:1000: Request processed in 69us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.189468:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760490.189603:0:7298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbb2b228 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057472:0@lo:1000: 00000004:00080000:2.0:1789760490.189656:0:7298:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000004cc0fbb0 with version 0 00000020:00100000:2.0:1789760490.189671:0:7298:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760490.189677:0:7298:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000fbb2b228 x1876699798057728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760490.189691:0:7298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbb2b228 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057728:0@lo:1000: 00000100:00100000:2.0:1789760490.189718:0:7298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.189735:0:7298:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfb923ae going to sleep for 11 seconds 00000100:00100000:2.0:1789760490.189748:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798057728 00000100:00100000:2.0:1789760490.189758:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798057728 00000100:00100000:2.0:1789760490.189815:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760490.189822:0:6470:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789760490.189824:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046d937c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7298:x1876699798057728:12345-0@lo:1000: 00000100:00100000:1.0:1789760490.189831:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000001:00080000:1.0:1789760490.268515:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789760490.268533:0:7272:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789760490.273451:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046d937c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7298:x1876699798057728:12345-0@lo:1000: Request processed in 83620us (83724us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789760490.273473:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1789760490.273589:0:7298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789760490.273595:0:7298:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789760490.273610:0:7298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbb2b228 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057728:0@lo:1000: 00000100:00100000:0.0:1789760490.274761:0:7298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9c6f082 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057856:0@lo:1000: 00000100:00100000:2.0:1789760490.275650:0:7298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760490.275699:0:7298:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f506247 going to sleep for 11 seconds 00000100:00100000:1.0:1789760490.275746:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798057856 00000100:00100000:1.0:1789760490.275754:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798057856 00000100:00100000:1.0:1789760490.275826:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760490.275835:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004585fcfa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7298:x1876699798057856:12345-0@lo:1000: 00000100:00100000:1.0:1789760490.275914:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004585fcfa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7298:x1876699798057856:12345-0@lo:1000: Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760490.275922:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760490.276201:0:7298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9c6f082 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7298:1876699798057856:0@lo:1000: 00000040:00080000:2.0:1789760490.276225:0:7298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789760490.276261:0:7298:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000062cc794e with version 1 00000004:00080000:1.0:1789760490.277721:0:7296:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000082820897 version 1 rpc_version 1 00000020:00100000:1.0:1789760490.277766:0:7296:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789760490.277776:0:7296:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009c5036ab x1876699798058112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789760490.277824:0:7296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c5036ab pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7296:1876699798058112:0@lo:1000: 00000100:00100000:1.0:1789760490.277880:0:7296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760490.277910:0:7296:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f343b0c4 going to sleep for 11 seconds 00000100:00100000:3.0:1789760490.278750:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798058112 00000100:00100000:3.0:1789760490.278760:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798058112 00000040:00080000:2.0:1789760490.279540:0:7298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789760490.279614:0:7298:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789760490.279620:0:7298:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1789760490.280710:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760490.280725:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003935f27a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7296:x1876699798058112:12345-0@lo:1000: 00000001:00080000:1.0:1789760490.319669:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1789760490.320018:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003935f27a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7296:x1876699798058112:12345-0@lo:1000: Request processed in 39295us (42134us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789760490.320037:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1789760490.320200:0:7296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789760490.320205:0:7296:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789760490.320220:0:7296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c5036ab pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7296:1876699798058112:0@lo:1000: 00010000:00010000:2.0:1789760491.015420:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760492.039060:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760493.064575:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760494.086941:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760494.734532:0:7535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789760494.795637:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760494.804548:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad3390c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798058240:0@lo:41: 00000100:00100000:0.0:1789760494.804629:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760494.805180:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798058240 00000100:00100000:3.0:1789760494.805190:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798058240 00000100:00100000:3.0:1789760494.805239:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789760494.805246:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c6f082 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798058240:12345-0@lo:41: 00000004:00000024:3.0:1789760494.805287:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760494.805336:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c6f082 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798058240:12345-0@lo:41: Request processed in 90us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760494.805342:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789760494.805385:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad3390c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798058240:0@lo:41: 00010000:00010000:3.0:1789760495.111284:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760495.303060:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760495.303085:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c5036ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798058368:0@lo:41: 00000100:00100000:1.0:1789760495.303156:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760495.303217:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798058368 00000100:00100000:1.0:1789760495.303224:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798058368 00000100:00100000:1.0:1789760495.303263:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760495.303271:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea63f61c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798058368:12345-0@lo:41: 00000004:00000024:1.0:1789760495.303311:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760495.303352:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea63f61c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798058368:12345-0@lo:41: Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760495.303359:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760495.303400:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c5036ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798058368:0@lo:41: 00000100:00100000:2.0:1789760495.304777:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798058496:0@lo:400: 00000100:00100000:2.0:1789760495.304842:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760495.304878:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760495.304883:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbb2b228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798058624:0@lo:400: 00000100:00100000:2.0:1789760495.304907:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760495.304935:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff2fc72c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798058752:0@lo:400: 00000100:00100000:2.0:1789760495.304970:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760495.304989:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760495.304993:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a70ccb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798058880:0@lo:400: 00000100:00100000:2.0:1789760495.305014:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760495.305039:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798058496 00000100:00100000:2.0:1789760495.305045:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798058496 00000100:00100000:2.0:1789760495.305077:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789760495.305083:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db566c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3463:x1876699798058496:12345-0@lo:400: 00000100:00100000:2.0:1789760495.305124:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db566c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3463:x1876699798058496:12345-0@lo:400: Request processed in 42us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760495.305131:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789760495.305157:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798058624 00000100:00100000:2.0:1789760495.305161:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798058624 00000100:00100000:2.0:1789760495.305182:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798058880 00000100:00100000:2.0:1789760495.305185:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798058880 00000100:00100000:2.0:1789760495.305197:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760495.305202:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036a62878 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798058624:12345-0@lo:400: 00000100:00100000:2.0:1789760495.305229:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036a62878 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798058624:12345-0@lo:400: Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760495.305235:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760495.305245:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760495.305250:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033c29538 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798058880:12345-0@lo:400: 00000100:00100000:2.0:1789760495.305277:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033c29538 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798058880:12345-0@lo:400: Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760495.305282:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760495.305296:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798058752 00000100:00100000:2.0:1789760495.305299:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798058752 00000100:00100000:2.0:1789760495.305317:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760495.305322:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8ef68c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798058752:12345-0@lo:400: 00000100:00100000:2.0:1789760495.305348:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8ef68c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798058752:12345-0@lo:400: Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760495.305354:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789760495.305391:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001a70ccb9 x1876699798058880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760495.305404:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a70ccb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798058880:0@lo:400: 00000100:00100000:2.0:1789760495.306566:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff2fc72c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798058752:0@lo:400: 00010000:00080000:2.0:1789760495.307151:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fbb2b228 x1876699798058624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760495.307163:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbb2b228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798058624:0@lo:400: 00000100:00100000:2.0:1789760495.307174:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e570491c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798058496:0@lo:400: 00010000:00010000:2.0:1789760496.134956:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760497.159021:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760498.185763:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789760499.107561:0:7736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0d0be0b0 20000000:00000080:3.0:1789760499.107579:0:7736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e441e17c00 uarg=0000000000000000 20000000:01000000:3.0:1789760499.107613:0:7736:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789760499.107620:0:7736:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789760499.107630:0:7736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789760499.108296:0:7736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789760499.108308:0:7736:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789760499.136502:0:7736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760499.136779:0:7736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789760499.136891:0:7736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789760499.136955:0:7736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789760499.136972:0:7736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789760499.136989:0:7736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137006:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 17 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137012:0:7736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137018:0:7736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137054:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137068:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 17 pid: 6459 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760499.137081:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad3390c3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7736:1876699798059008:0@lo:104: 00000100:00100000:3.0:1789760499.137346:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760499.137403:0:7736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 17 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137411:0:7736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 17 pid: 6457 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760499.137427:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef461bbb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7736:1876699798059136:0@lo:104: 00000100:00100000:3.0:1789760499.137447:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efdbdeee going to sleep for 11 seconds 00000100:00100000:0.0:1789760499.137510:0:6449:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789760499.137528:0:6449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760499.137554:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798059008 00000100:00100000:0.0:1789760499.137565:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798059008 00000100:00100000:0.0:1789760499.137599:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798059136 00000100:00100000:0.0:1789760499.137601:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798059136 00000100:00100000:0.0:1789760499.137613:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760499.137620:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc741b2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:7736:x1876699798059008:12345-0@lo:104: 00010000:00010000:0.0:1789760499.137630:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760499.137685:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760499.137690:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc741b2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:7736:x1876699798059008:12345-0@lo:104: Request processed in 72us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760499.137697:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760499.137730:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760499.137736:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e80c2270 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:7736:x1876699798059136:12345-0@lo:104: 00010000:00010000:0.0:1789760499.137743:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760499.137772:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760499.137777:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e80c2270 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:7736:x1876699798059136:12345-0@lo:104: Request processed in 42us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760499.137782:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760499.137834:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad3390c3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7736:1876699798059008:0@lo:104: 00000100:00100000:0.0:1789760499.137843:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef461bbb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7736:1876699798059136:0@lo:104: 00010000:00010000:0.0:1789760499.137864:0:7736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137960:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760499.137966:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137972:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d11f7b2 already unused, calling callback (00000000cdd84c74) 10000000:00010000:3.0:1789760499.137975:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.137981:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760499.137987:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760499.137992:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760499.138014:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.138020:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760499.138035:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.138041:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000003d11f7b2/0xc2b9a3a7398568b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568bb expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.138051:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760499.138054:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.138065:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001d58dbb1 already unused, calling callback (00000000cdd84c74) 10000000:00010000:3.0:1789760499.138067:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.138074:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760499.138078:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760499.138083:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760499.138096:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.138102:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760499.138107:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.138111:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000001d58dbb1/0xc2b9a3a7398567c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398567cd expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.138125:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760499.138126:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760499.138127:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760499.138253:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad3390c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798059392:0@lo:103: 00000100:00100000:2.0:1789760499.138288:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760499.138325:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760499.138330:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef461bbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798059264:0@lo:103: 00000100:00100000:2.0:1789760499.138351:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760499.138374:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798059392 00000100:00100000:2.0:1789760499.138379:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798059392 00010000:00010000:2.0:1789760499.138397:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 18 pid: 6457 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760499.138416:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798059264 00000100:00100000:2.0:1789760499.138419:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798059264 00010000:00010000:2.0:1789760499.138428:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 19 pid: 6459 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760499.138440:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760499.138444:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a70ccb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:3464:x1876699798059392:12345-0@lo:103: 00010000:00010000:2.0:1789760499.138454:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760499.138457:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 19 pid: 6457 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138471:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 19 pid: 6457 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138481:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dbc44bfc/0xc2b9a3a7398567cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398567c6 expref: 19 pid: 6457 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138491:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760499.138519:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a70ccb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3464:x1876699798059392:12345-0@lo:103: Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760499.138524:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760499.138538:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760499.138543:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5fdd6ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:3464:x1876699798059264:12345-0@lo:103: 00010000:00010000:2.0:1789760499.138550:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760499.138553:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 17 pid: 6459 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138560:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 17 pid: 6459 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138569:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f4565ff/0xc2b9a3a7398568bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398568b4 expref: 17 pid: 6459 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138579:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138585:0:6451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138596:0:6451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138607:0:6451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138612:0:6451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138617:0:6451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138622:0:6451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a44f8d2e already unused, calling callback (0000000011508811) 00010000:00010000:2.0:1789760499.138625:0:6451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138631:0:6451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138641:0:6451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760499.138649:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760499.138672:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5fdd6ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:3464:x1876699798059264:12345-0@lo:103: Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760499.138678:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760499.138705:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef461bbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798059264:0@lo:103: 00000100:00100000:2.0:1789760499.138712:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad3390c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798059392:0@lo:103: 00010000:00010000:3.0:1789760499.139025:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760499.139088:0:7736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760499.139110:0:7736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760499.139116:0:7736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a44f8d2e/0xc2b9a3a73985694e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760499.207255:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760499.912942:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1a881e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798059520:0@lo:41: 00000100:00100000:2.0:1789760499.913025:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760499.913107:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798059520 00000100:00100000:2.0:1789760499.913122:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798059520 00000100:00100000:2.0:1789760499.913170:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760499.913178:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000975c2c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798059520:12345-0@lo:41: 00000004:00000024:2.0:1789760499.913214:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760499.913257:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000975c2c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798059520:12345-0@lo:41: Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760499.913265:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760499.913305:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1a881e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798059520:0@lo:41: 00010000:00010000:0.0:1789760500.231086:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760500.423350:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c5036ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798059648:0@lo:41: 00000100:00100000:3.0:1789760500.423434:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760500.423673:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798059648 00000100:00100000:1.0:1789760500.423680:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798059648 00000100:00100000:1.0:1789760500.423731:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760500.423738:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2f0b7f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798059648:12345-0@lo:41: 00000004:00000024:1.0:1789760500.423807:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760500.423851:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2f0b7f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798059648:12345-0@lo:41: Request processed in 114us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760500.423859:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760500.424246:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084895e81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798059776:0@lo:400: 00000100:00100000:3.0:1789760500.424283:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760500.424306:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760500.424311:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6329a38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798059904:0@lo:400: 00000100:00100000:3.0:1789760500.424335:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760500.424423:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798059776 00000100:00100000:1.0:1789760500.424428:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798059776 00000100:00100000:1.0:1789760500.424449:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789760500.424454:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e280ca9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:3463:x1876699798059776:12345-0@lo:400: 00000100:00100000:1.0:1789760500.424487:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e280ca9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:3463:x1876699798059776:12345-0@lo:400: Request processed in 33us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760500.424494:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789760500.424528:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084895e81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798059776:0@lo:400: 00000100:00100000:2.0:1789760500.424762:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2abcd78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798060032:0@lo:400: 00000100:00100000:2.0:1789760500.424809:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760500.424834:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798059904 00000100:00100000:2.0:1789760500.424838:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798059904 00000100:00100000:2.0:1789760500.424859:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798060032 00000100:00100000:2.0:1789760500.424862:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798060032 00000100:00100000:2.0:1789760500.424873:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760500.424878:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a536098 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798059904:12345-0@lo:400: 00000100:00100000:2.0:1789760500.424924:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a536098 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798059904:12345-0@lo:400: Request processed in 46us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760500.424930:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760500.424943:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760500.424947:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001de3c1c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798060032:12345-0@lo:400: 00000100:00100000:2.0:1789760500.424980:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001de3c1c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798060032:12345-0@lo:400: Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760500.424986:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760500.425001:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c5036ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798059648:0@lo:41: 00010000:00080000:2.0:1789760500.425029:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f2abcd78 x1876699798060032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789760500.425053:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e6329a38 x1876699798059904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760500.425064:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6329a38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798059904:0@lo:400: 00000100:00100000:2.0:1789760500.426511:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2abcd78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798060032:0@lo:400: 00010000:00010000:3.0:1789760501.256206:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760502.279770:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760503.309402:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760504.326979:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789760504.939888:0:8108:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789760504.939891:0:8108:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789760504.940292:0:8108:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000949e2fd7 00000020:01000004:0.0:1789760504.940308:0:8108:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789760504.940322:0:8108:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789760504.940342:0:8108:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000014e0cdfd) 00000020:00000080:0.0:1789760504.940360:0:8108:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789760504.959681:0:8108:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789760504.960459:0:8108:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789760505.007262:0:8108:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789760505.020278:0:8108:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789760505.020323:0:8108:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789760505.020515:0:8108:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789760505.020608:0:8108:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789760505.021023:0:8108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789760505.021038:0:8108:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789760505.021050:0:8108:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc2b9a3a73985695c 00000020:01000004:3.0:1789760505.021059:0:8108:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789760505.021079:0:8108:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789760505.021082:0:8108:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789760505.021088:0:8108:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789760505.021092:0:8108:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789760505.021103:0:8108:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000008d87ebaa) 00000020:00000080:3.0:1789760505.021113:0:8108:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789760505.022566:0:8108:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760505.022741:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789760505.022747:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789760505.029862:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789760505.029885:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 10000000:01000000:2.0:1789760505.031834:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789760505.031840:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e544828000 from 1 10000000:01000000:2.0:1789760505.031843:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760505.031895:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000eac1d235/0xc2b9a3a73985696a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.031907:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000eac1d235/0xc2b9a3a73985696a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.031917:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000eac1d235/0xc2b9a3a73985696a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.031938:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a993bedb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798060160:0@lo:101: 00000100:00100000:2.0:1789760505.032003:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.032046:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019f177cd going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.032148:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760505.032163:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798060288:0@lo:41: 00000100:00100000:3.0:1789760505.032199:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.032232:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798060288 00000100:00100000:3.0:1789760505.032253:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798060288 00000100:00100000:3.0:1789760505.032326:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760505.032334:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a474cbb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798060288:12345-0@lo:41: 00000004:00000024:3.0:1789760505.032537:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760505.032583:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a474cbb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798060288:12345-0@lo:41: Request processed in 250us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.032591:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760505.032640:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798060288:0@lo:41: 00000100:00100000:0.0:1789760505.032740:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798060160 00000100:00100000:0.0:1789760505.032747:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798060160 00000100:00100000:0.0:1789760505.032780:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789760505.032808:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c25233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798060160:12345-0@lo:101: 00010000:00010000:0.0:1789760505.032819:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760505.032841:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d58dbb1/0xc2b9a3a739856971 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a73985696a expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.032862:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d58dbb1/0xc2b9a3a739856971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.032884:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d58dbb1/0xc2b9a3a739856971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.032894:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d58dbb1, rc 0) 00000100:00100000:0.0:1789760505.032925:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c25233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798060160:12345-0@lo:101: Request processed in 139us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.032931:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789760505.033057:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a993bedb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798060160:0@lo:101: 00010000:00010000:2.0:1789760505.033071:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000eac1d235/0xc2b9a3a73985696a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.033079:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000eac1d235/0xc2b9a3a73985696a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.033153:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a993bedb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798060416:0@lo:501: 00000100:00100000:2.0:1789760505.033182:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.033214:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019f177cd going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.033344:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798060416 00000100:00100000:3.0:1789760505.033358:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798060416 00000100:00100000:3.0:1789760505.033389:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760505.033394:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adc6aa9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798060416:12345-0@lo:501: 00000100:00100000:3.0:1789760505.033643:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adc6aa9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798060416:12345-0@lo:501: Request processed in 249us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.033651:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789760505.033830:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a993bedb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798060416:0@lo:501: 00000100:00100000:2.0:1789760505.033858:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a993bedb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798060544:0@lo:503: 00000100:00100000:2.0:1789760505.034977:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.035017:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019f177cd going to sleep for 11 seconds 00000100:00100000:0.0:1789760505.035064:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798060544 00000100:00100000:0.0:1789760505.035071:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798060544 00000100:00100000:0.0:1789760505.035109:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789760505.035116:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000395948a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798060544:12345-0@lo:503: 00000100:00100000:0.0:1789760505.035317:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000395948a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798060544:12345-0@lo:503: Request processed in 201us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.035325:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789760505.035549:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a993bedb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798060544:0@lo:503: 00000100:00100000:3.0:1789760505.035707:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789760505.035716:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789760505.036813:0:8113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8113:1876699798060672:0@lo:502: 00000100:00100000:3.0:1789760505.036884:0:8113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.036916:0:8113:0:(client.c:2715:ptlrpc_set_wait()) set 00000000304b1376 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.037491:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798060672 00000100:00100000:2.0:1789760505.037498:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798060672 00000100:00100000:2.0:1789760505.037544:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789760505.037552:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055531d91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:8113:x1876699798060672:12345-0@lo:502: 00000100:00100000:2.0:1789760505.037770:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055531d91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:8113:x1876699798060672:12345-0@lo:502: Request processed in 219us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.037779:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789760505.038256:0:8113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006c840b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8113:1876699798060672:0@lo:502: 00000020:01000000:1.0:1789760505.038286:0:8113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760505.038295:0:8113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760505.038297:0:8113:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789760505.038305:0:8113:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e544828000 00000020:00000080:1.0:1789760505.038307:0:8113:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789760505.038492:0:8113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8113:1876699798060800:0@lo:502: 00000100:00100000:1.0:1789760505.038544:0:8113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760505.038574:0:8113:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441db0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.038642:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798060800 00000100:00100000:2.0:1789760505.038648:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798060800 00000100:00100000:0.0:1789760505.039173:0:8108:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760505.039474:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789760505.039487:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:8113:x1876699798060800:12345-0@lo:502: 00000100:00100000:2.0:1789760505.039703:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:8113:x1876699798060800:12345-0@lo:502: Request processed in 218us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.039710:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789760505.039815:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789760505.039822:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789760505.040373:0:8113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8113:1876699798060800:0@lo:502: 00000020:01000000:1.0:1789760505.040409:0:8113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760505.040417:0:8113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760505.040420:0:8113:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789760505.040426:0:8113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789760505.040699:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789760505.040722:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760505.040734:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.040755:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760505.040767:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789760505.040769:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e546616000 from 1 10000000:01000000:0.0:1789760505.040772:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789760505.040834:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.040843:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.040851:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760505.040879:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798060928:0@lo:101: 00000100:00100000:0.0:1789760505.040927:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.041324:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786480 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.041495:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798060928 00000100:00100000:3.0:1789760505.041502:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798060928 00000100:00100000:3.0:1789760505.041539:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789760505.041547:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798060928:12345-0@lo:101: 00010000:00010000:3.0:1789760505.041559:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760505.041571:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856978 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.041606:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.041617:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.041625:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541483800, rc 0) 00000100:00100000:3.0:1789760505.041679:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798060928:12345-0@lo:101: Request processed in 132us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.041685:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789760505.041877:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798060928:0@lo:101: 00010000:00010000:0.0:1789760505.041893:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.041903:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760505.041955:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798061056:0@lo:501: 00000100:00100000:0.0:1789760505.041983:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.041999:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786480 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.042072:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798061056 00000100:00100000:3.0:1789760505.042076:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798061056 00000100:00100000:3.0:1789760505.042093:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789760505.042098:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798061056:12345-0@lo:501: 00000100:00100000:3.0:1789760505.042510:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798061056:12345-0@lo:501: Request processed in 410us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.042517:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789760505.042846:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789760505.042854:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789760505.043382:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798061056:0@lo:501: 00000100:00100000:0.0:1789760505.043436:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798061184:0@lo:503: 00000100:00100000:0.0:1789760505.043482:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.043515:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786480 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.043572:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798061184 00000100:00100000:3.0:1789760505.043579:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798061184 00000100:00100000:3.0:1789760505.043617:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789760505.043625:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798061184:12345-0@lo:503: 00000100:00100000:3.0:1789760505.043837:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798061184:12345-0@lo:503: Request processed in 212us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.043845:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789760505.044069:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798061184:0@lo:503: 00000100:00100000:0.0:1789760505.045204:0:8117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8117:1876699798061312:0@lo:502: 00000100:00100000:0.0:1789760505.045256:0:8117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.045456:0:8117:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.045554:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798061312 00000100:00100000:2.0:1789760505.045561:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798061312 00000100:00100000:2.0:1789760505.045602:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789760505.045610:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8117:x1876699798061312:12345-0@lo:502: 00000100:00100000:2.0:1789760505.045822:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8117:x1876699798061312:12345-0@lo:502: Request processed in 212us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.045831:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789760505.045971:0:8117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8117:1876699798061312:0@lo:502: 00000020:01000000:0.0:1789760505.045996:0:8117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760505.046006:0:8117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760505.046009:0:8117:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789760505.046015:0:8117:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e546616000 00000020:00000080:0.0:1789760505.046018:0:8117:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789760505.046040:0:8117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8117:1876699798061440:0@lo:502: 00000100:00100000:0.0:1789760505.046078:0:8117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.046105:0:8117:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.046207:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798061440 00000100:00100000:2.0:1789760505.046213:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798061440 00000100:00100000:2.0:1789760505.046248:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789760505.046256:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8117:x1876699798061440:12345-0@lo:502: 00000100:00100000:2.0:1789760505.046532:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8117:x1876699798061440:12345-0@lo:502: Request processed in 277us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.046539:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789760505.049209:0:8117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8117:1876699798061440:0@lo:502: 00000020:01000000:0.0:1789760505.049258:0:8117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760505.049265:0:8117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760505.049268:0:8117:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789760505.049272:0:8117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789760505.051942:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789760505.053258:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760505.053274:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.053289:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760505.074534:0:8108:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760505.074770:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789760505.074778:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789760505.078293:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789760505.078307:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789760505.081858:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789760505.081880:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789760505.086277:0:8108:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760505.086475:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789760505.086481:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789760505.087482:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789760505.087497:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789760505.136624:0:8108:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760505.136858:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789760505.136887:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789760505.138183:0:8108:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789760505.138194:0:8108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789760505.138573:0:8108:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789760505.138595:0:8108:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789760505.138601:0:8108:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789760505.161743:0:8108:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789760505.161826:0:8108:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789760505.161831:0:8108:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789760505.161834:0:8108:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760505.161835:0:8108:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760505.161836:0:8108:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760505.161837:0:8108:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760505.161839:0:8108:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760505.161840:0:8108:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760505.161842:0:8108:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760505.161843:0:8108:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760505.161845:0:8108:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760505.161847:0:8108:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789760505.161851:0:8108:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789760505.161854:0:8108:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789760505.161855:0:8108:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760505.161856:0:8108:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760505.161857:0:8108:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760505.161858:0:8108:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760505.161859:0:8108:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760505.161860:0:8108:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760505.161861:0:8108:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760505.161863:0:8108:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760505.161864:0:8108:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760505.161875:0:8108:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789760505.161904:0:8108:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789760505.161923:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798061568:0@lo:253: 00000100:00100000:0.0:1789760505.161997:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.162105:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760505.162152:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798061568 00000100:00100000:1.0:1789760505.162160:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798061568 00000100:00100000:1.0:1789760505.162240:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789760505.162249:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8108:x1876699798061568:12345-0@lo:253: 20000000:01000000:1.0:1789760505.162278:0:6457:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789760505.162283:0:6457:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789760505.162288:0:6457:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789760505.162291:0:6457:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789760505.163456:0:6457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760505.163728:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789760505.163744:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789760505.163807:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789760505.163817:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789760505.163851:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789760505.163929:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789760505.164180:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789760505.164199:0:6457:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:1.0:1789760505.164201:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:1.0:1789760505.164249:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789760505.164257:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789760505.164309:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789760505.164317:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:1.0:1789760505.164347:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789760505.164356:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760505.164388:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789760505.164440:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789760505.165155:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1789760505.165173:0:6457:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:1.0:1789760505.165175:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:1.0:1789760505.165210:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1789760505.165218:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789760505.165268:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1789760505.165277:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:1.0:1789760505.165309:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1789760505.165318:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760505.165347:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1789760505.165411:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1789760505.166324:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1789760505.166344:0:6457:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:1.0:1789760505.166346:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:1.0:1789760505.166382:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1789760505.166391:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789760505.166424:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1789760505.166432:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:1.0:1789760505.166463:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1789760505.166472:0:6457:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760505.166588:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1789760505.166633:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1789760505.166657:0:6457:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789760505.166660:0:6457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789760505.166666:0:6457:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789760505.166667:0:6457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789760505.166670:0:6457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789760505.166681:0:6457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789760505.166683:0:6457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789760505.166717:0:6457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789760505.166719:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760505.167590:0:8125:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760505.167654:0:8125:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760505.167705:0:8125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789760505.168132:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789760505.168175:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789760505.168234:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1789760505.168248:0:6457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789760505.168250:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789760505.168657:0:8126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789760505.169082:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789760505.169117:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789760505.169176:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789760505.169189:0:6457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789760505.169191:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760505.169673:0:8127:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760505.169722:0:8127:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760505.169772:0:8127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789760505.170140:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789760505.170184:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789760505.170222:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789760505.170234:0:6457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789760505.170237:0:6457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760505.170744:0:8128:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760505.170853:0:8128:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760505.170918:0:8128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789760505.171157:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789760505.171198:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789760505.171255:0:6457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1789760505.171277:0:6457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789760505.171296:0:6457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171315:0:6457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e540030c00/0xc2b9a3a739856852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 18 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171334:0:6457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398568c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171341:0:6457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5820c6200/0xc2b9a3a739856901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171348:0:6457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5413d3200/0xc2b9a3a73985691d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171355:0:6457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 18 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171362:0:6457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171400:0:6457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 18 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171417:0:6457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856947 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 18 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.171433:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798061696:0@lo:104: 00000100:00100000:1.0:1789760505.171498:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760505.171655:0:6457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5413d3200/0xc2b9a3a73985691d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171665:0:6457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5413d3200/0xc2b9a3a73985691d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 18 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.171674:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798061824:0@lo:104: 00000100:00100000:1.0:1789760505.171706:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760505.171827:0:6457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5820c6200/0xc2b9a3a739856901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.171836:0:6457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5820c6200/0xc2b9a3a739856901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 18 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.171844:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798061952:0@lo:104: 00000100:00100000:1.0:1789760505.171877:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.171954:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798061696 00000100:00100000:0.0:1789760505.171961:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798061696 00000100:00100000:0.0:1789760505.172002:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798061824 00000100:00100000:0.0:1789760505.172006:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798061824 00000100:00100000:0.0:1789760505.172031:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760505.172040:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6457:x1876699798061696:12345-0@lo:104: 00010000:00010000:0.0:1789760505.172054:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172101:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760505.172108:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6457:x1876699798061696:12345-0@lo:104: Request processed in 69us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.172115:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760505.172132:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789760505.172138:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6457:x1876699798061824:12345-0@lo:104: 00010000:00010000:0.0:1789760505.172145:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172176:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760505.172181:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6457:x1876699798061824:12345-0@lo:104: Request processed in 44us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.172186:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789760505.172202:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760505.172208:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172214:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541482000 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760505.172218:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172225:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760505.172239:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760505.172246:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760505.172280:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172288:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760505.172305:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856940 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172312:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856940 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856947 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172324:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760505.172327:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172332:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d3e00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760505.172335:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172341:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760505.172346:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760505.172352:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760505.172371:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172376:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760505.172382:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856916 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172388:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985691d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.172397:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760505.172399:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760505.172401:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760505.172414:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798062080:0@lo:103: 00000100:00100000:0.0:1789760505.172441:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.172467:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760505.172472:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798062208:0@lo:103: 00000100:00100000:0.0:1789760505.172517:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760505.172755:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760505.172770:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798062080 00000100:00100000:2.0:1789760505.172775:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798062080 00010000:00010000:2.0:1789760505.172834:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856947 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 19 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.172853:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798062208 00000100:00100000:2.0:1789760505.172856:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798062208 00010000:00010000:2.0:1789760505.172877:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5413d3200/0xc2b9a3a73985691d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 20 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.172891:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760505.172897:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:3463:x1876699798062080:12345-0@lo:103: 00010000:00010000:2.0:1789760505.172906:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760505.172912:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856947 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 20 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.172921:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856947 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 20 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.172936:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760505.172969:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:3463:x1876699798062080:12345-0@lo:103: Request processed in 72us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.172975:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760505.172989:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760505.173002:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:3463:x1876699798062208:12345-0@lo:103: 00010000:00010000:2.0:1789760505.173010:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760505.173015:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5413d3200/0xc2b9a3a73985691d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 19 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.173023:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5413d3200/0xc2b9a3a73985691d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 19 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.173032:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760505.173054:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:3463:x1876699798062208:12345-0@lo:103: Request processed in 53us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.173061:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760505.173107:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798062208:0@lo:103: 00000100:00100000:2.0:1789760505.173115:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798062080:0@lo:103: 00010000:00010000:1.0:1789760505.173282:0:6457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398568c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.173293:0:6457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398568c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 18 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.173302:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798062336:0@lo:104: 00000100:00100000:1.0:1789760505.173327:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760505.173344:0:6457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e540030c00/0xc2b9a3a739856852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 18 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.173352:0:6457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e540030c00/0xc2b9a3a739856852 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 18 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.173359:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798062464:0@lo:104: 00000100:00100000:1.0:1789760505.173378:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760505.173387:0:6457:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441db0c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789760505.173399:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856947 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856940 expref: 18 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.173410:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798061696:0@lo:104: 00010000:00010000:1.0:1789760505.173429:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5413d3200/0xc2b9a3a73985691d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856916 expref: 17 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.173439:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798061824:0@lo:104: 00000100:00100000:0.0:1789760505.173485:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798061952 00000100:00100000:0.0:1789760505.173490:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798061952 00000100:00100000:0.0:1789760505.173510:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798062336 00000100:00100000:0.0:1789760505.173512:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798062336 00000100:00100000:0.0:1789760505.173589:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798062464 00000100:00100000:0.0:1789760505.173593:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798062464 00000100:00100000:0.0:1789760505.173610:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760505.173615:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:6457:x1876699798061952:12345-0@lo:104: 00010000:00010000:0.0:1789760505.173625:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541482a00/0xc2b9a3a7398568fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173677:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760505.173689:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:6457:x1876699798061952:12345-0@lo:104: Request processed in 73us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.173694:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760505.173708:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760505.173715:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6457:x1876699798062336:12345-0@lo:104: 00010000:00010000:0.0:1789760505.173722:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a7398568c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173753:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760505.173758:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6457:x1876699798062336:12345-0@lo:104: Request processed in 44us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.173764:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760505.173776:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789760505.173782:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6457:x1876699798062464:12345-0@lo:104: 00010000:00010000:0.0:1789760505.173814:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985684b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173844:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789760505.173849:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6457:x1876699798062464:12345-0@lo:104: Request processed in 67us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.173854:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789760505.173878:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789760505.173883:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541482a00/0xc2b9a3a7398568fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173890:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541482a00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760505.173893:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541482a00/0xc2b9a3a7398568fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173910:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541482a00/0xc2b9a3a7398568fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760505.173917:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541482a00/0xc2b9a3a7398568fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760505.173922:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760505.173941:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541482a00/0xc2b9a3a7398568fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173947:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760505.173961:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541482a00/0xc2b9a3a7398568fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173967:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541482a00/0xc2b9a3a7398568fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856901 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173979:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760505.173982:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a7398568c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173988:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540031a00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760505.173991:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a7398568c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.173997:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a7398568c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760505.174003:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a7398568c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760505.174014:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760505.174028:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a7398568c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.174034:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760505.174039:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a7398568c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.174045:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a7398568c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568c9 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.174055:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760505.174058:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985684b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.174064:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c7c00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760505.174067:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985684b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.174074:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985684b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760505.174080:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985684b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760505.174085:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760505.174096:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985684b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.174101:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760505.174118:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985684b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.174125:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985684b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856852 expref: -99 pid: 7262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.174140:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760505.174142:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760505.174144:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760505.174157:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798062592:0@lo:103: 00000100:00100000:0.0:1789760505.174185:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.174209:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760505.174214:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798062720:0@lo:103: 00000100:00100000:0.0:1789760505.174234:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760505.174305:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760505.174316:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760505.174325:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798062848:0@lo:103: 00000100:00100000:2.0:1789760505.174354:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.174383:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798062592 00000100:00100000:2.0:1789760505.174387:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798062592 00010000:00010000:2.0:1789760505.174402:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5820c6200/0xc2b9a3a739856901 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 17 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.174415:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798062720 00000100:00100000:2.0:1789760505.174418:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798062720 00010000:00010000:2.0:1789760505.174428:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398568c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 18 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.174449:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798062848 00000100:00100000:2.0:1789760505.174458:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798062848 00010000:00010000:2.0:1789760505.174473:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e540030c00/0xc2b9a3a739856852 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 19 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.174487:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760505.174492:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:3461:x1876699798062592:12345-0@lo:103: 00010000:00010000:2.0:1789760505.174500:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760505.174505:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5820c6200/0xc2b9a3a739856901 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 19 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174514:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5820c6200/0xc2b9a3a739856901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 19 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174538:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760505.174567:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:3461:x1876699798062592:12345-0@lo:103: Request processed in 75us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.174574:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760505.174589:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760505.174595:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3461:x1876699798062720:12345-0@lo:103: 00010000:00010000:2.0:1789760505.174603:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760505.174606:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398568c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 18 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174614:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398568c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 18 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174623:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760505.174641:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3461:x1876699798062720:12345-0@lo:103: Request processed in 48us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.174647:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760505.174663:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760505.174669:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545670850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:3464:x1876699798062848:12345-0@lo:103: 00010000:00010000:2.0:1789760505.174676:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760505.174680:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e540030c00/0xc2b9a3a739856852 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 17 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174689:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e540030c00/0xc2b9a3a739856852 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 17 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174699:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174707:0:6452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174721:0:6452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174729:0:6452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174735:0:6452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174741:0:6452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174747:0:6452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d2e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760505.174751:0:6452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174758:0:6452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174773:0:6452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.174782:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760505.174831:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545670850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:3464:x1876699798062848:12345-0@lo:103: Request processed in 161us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.174837:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789760505.174881:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760505.174898:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798062848:0@lo:103: 00000100:00100000:2.0:1789760505.174925:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798062720:0@lo:103: 00000100:00100000:2.0:1789760505.174933:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798062592:0@lo:103: 00010000:00010000:1.0:1789760505.175154:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5820c6200/0xc2b9a3a739856901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398568fa expref: 16 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.175165:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798061952:0@lo:104: 00010000:00010000:1.0:1789760505.175175:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398568c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398568c2 expref: 15 pid: 6459 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.175182:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798062336:0@lo:104: 00010000:00010000:1.0:1789760505.175190:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e540030c00/0xc2b9a3a739856852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a73985684b expref: 14 pid: 6457 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.175198:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6457:1876699798062464:0@lo:104: 00010000:00010000:1.0:1789760505.175218:0:6457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.175227:0:6457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.175232:0:6457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.175238:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856986 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760505.175250:0:6457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789760505.214397:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:8108:x1876699798061568:12345-0@lo:253: Request processed in 52141us (52391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.214409:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789760505.214600:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798061568:0@lo:253: 10000000:01000000:2.0:1789760505.214615:0:8108:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789760505.214618:0:8108:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789760505.214620:0:8108:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789760505.214621:0:8108:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760505.214622:0:8108:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789760505.214624:0:8108:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760505.214625:0:8108:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760505.214626:0:8108:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760505.214628:0:8108:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789760505.214629:0:8108:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760505.214630:0:8108:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789760505.214649:0:8108:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97e44128d800 from lustre-OST0000 10000000:01000000:2.0:1789760505.214731:0:8108:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789760505.214734:0:8108:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789760505.214742:0:8108:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97e550c219b8 local copy 10000000:01000000:2.0:1789760505.214745:0:8108:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789760505.214778:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.214819:0:8108:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.214829:0:8108:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.214847:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798062976:0@lo:101: 00000100:00100000:2.0:1789760505.214892:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.214964:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e55aba5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760505.215005:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798062976 00000100:00100000:0.0:1789760505.215011:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798062976 00000100:00100000:0.0:1789760505.215076:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789760505.215084:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:8108:x1876699798062976:12345-0@lo:101: 00010000:00010000:0.0:1789760505.215095:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760505.215106:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e540031a00/0xc2b9a3a739856994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a73985698d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.215126:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e540031a00/0xc2b9a3a739856994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a73985698d expref: 14 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.215137:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e540031a00/0xc2b9a3a739856994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985698d expref: 14 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.215153:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540031a00, rc 0) 00000100:00100000:0.0:1789760505.215272:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798062976:12345-0@lo:101: Request processed in 188us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.215278:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789760505.215342:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798062976:0@lo:101: 00010000:00010000:3.0:1789760505.215354:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.215363:0:8108:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760505.215586:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063104:0@lo:501: 00000100:00100000:3.0:1789760505.215622:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.215645:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789760505.215745:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798063104 00000100:00100000:1.0:1789760505.215750:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798063104 00000100:00100000:1.0:1789760505.215782:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789760505.215811:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063104:12345-0@lo:501: 00000100:00100000:1.0:1789760505.216014:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063104:12345-0@lo:501: Request processed in 205us (391us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760505.216021:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760505.216285:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063104:0@lo:501: 10000000:01000000:3.0:1789760505.216298:0:8108:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789760505.216323:0:8108:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789760505.216329:0:8108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.216338:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.216346:0:8108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.216371:0:8108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789760505.216389:0:8108:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e44128d800 10000000:01000000:3.0:1789760505.216394:0:8108:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789760505.216398:0:8108:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789760505.216401:0:8108:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789760505.216405:0:8108:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789760505.216407:0:8108:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789760505.216497:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.216505:0:8108:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.216514:0:8108:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760505.216585:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063232:0@lo:101: 00000100:00100000:3.0:1789760505.216612:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.216736:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467d0c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789760505.216811:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760505.216817:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.216826:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c7c00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760505.216830:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.216838:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760505.216846:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760505.216851:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760505.216879:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.216885:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760505.216900:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.216907:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a73985698d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856994 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.216927:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760505.216928:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760505.216930:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760505.216976:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798063360:0@lo:103: 00000100:00100000:3.0:1789760505.217001:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760505.217129:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798063360 00000100:00100000:1.0:1789760505.217134:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798063360 00000100:00100000:1.0:1789760505.217172:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760505.217179:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:3464:x1876699798063360:12345-0@lo:103: 00010000:00010000:1.0:1789760505.217188:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760505.217199:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e540031a00/0xc2b9a3a739856994 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a73985698d expref: 14 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.217272:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760505.217299:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:3464:x1876699798063360:12345-0@lo:103: Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760505.217306:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760505.217367:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798063360:0@lo:103: 00000100:00100000:0.0:1789760505.217492:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798063232 00000100:00100000:0.0:1789760505.217496:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798063232 00000100:00100000:0.0:1789760505.217812:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789760505.217822:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+13:8108:x1876699798063232:12345-0@lo:101: 00010000:00010000:0.0:1789760505.217833:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760505.217846:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a73985699b expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.217874:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 14 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.217884:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 14 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.217891:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540030c00, rc 0) 00000100:00100000:0.0:1789760505.217930:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063232:12345-0@lo:101: Request processed in 111us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.217935:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789760505.218024:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063232:0@lo:101: 00010000:00010000:1.0:1789760505.218037:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.218046:0:8108:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.218127:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063488:0@lo:501: 00000100:00100000:1.0:1789760505.218152:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760505.218350:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441db0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.218411:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798063488 00000100:00100000:3.0:1789760505.218415:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798063488 00000100:00100000:3.0:1789760505.218506:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789760505.218513:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063488:12345-0@lo:501: 00000100:00100000:3.0:1789760505.218844:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063488:12345-0@lo:501: Request processed in 330us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.218858:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789760505.219192:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063488:0@lo:501: 00000100:00100000:1.0:1789760505.219280:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063616:0@lo:503: 00000100:00100000:1.0:1789760505.219317:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760505.219341:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441db0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.219499:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798063616 00000100:00100000:3.0:1789760505.219504:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798063616 00000100:00100000:3.0:1789760505.219587:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789760505.219595:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063616:12345-0@lo:503: 00000100:00100000:3.0:1789760505.219859:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063616:12345-0@lo:503: Request processed in 265us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.219876:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789760505.220034:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063616:0@lo:503: 00000040:00080000:1.0:1789760505.220355:0:8108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760505.220412:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063744:0@lo:502: 00000100:00100000:1.0:1789760505.220577:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760505.220638:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5457270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.220743:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798063744 00000100:00100000:2.0:1789760505.220748:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798063744 00000100:00100000:0.0:1789760505.220859:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760505.221085:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063744:12345-0@lo:502: 00000100:00100000:1.0:1789760505.221349:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063744:12345-0@lo:502: Request processed in 483us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760505.221354:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789760505.221415:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063744:0@lo:502: 00000040:00080000:3.0:1789760505.222586:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789760505.222655:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789760505.222713:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789760505.222764:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789760505.222825:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789760505.222861:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789760505.222911:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063872:0@lo:502: 00000100:00100000:3.0:1789760505.222972:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.223066:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467d0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.223379:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798063872 00000100:00100000:2.0:1789760505.223386:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798063872 00000100:00100000:2.0:1789760505.223465:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789760505.223474:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063872:12345-0@lo:502: 00000100:00100000:2.0:1789760505.223663:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798063872:12345-0@lo:502: Request processed in 190us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.223679:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789760505.223762:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798063872:0@lo:502: 00000040:00080000:1.0:1789760505.223951:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789760505.223963:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789760505.224598:0:8129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789760505.224606:0:8129:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789760505.224613:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760505.224615:0:8129:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789760505.224620:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789760505.224632:0:8129:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97e545760000) 00000020:00000080:1.0:1789760505.224652:0:8129:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789760505.224656:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789760505.224783:0:8129:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e44128d800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789760505.224859:0:8129:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789760505.224875:0:8129:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc2b9a3a7398569b0 00010000:00010000:1.0:1789760505.230281:0:8129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789760505.231641:0:8129:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789760505.235146:0:8129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789760505.236235:0:8129:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789760505.241225:0:8129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789760505.241724:0:8129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789760505.243600:0:8129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789760505.243611:0:8129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760505.243616:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760505.243619:0:8129:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789760505.243622:0:8129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760505.243626:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760505.243627:0:8129:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760505.243631:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760505.243633:0:8129:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789760505.243680:0:8129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760505.243683:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760505.243685:0:8129:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760505.243688:0:8129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789760505.243929:0:8108:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789760505.243954:0:8108:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789760505.244008:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.244020:0:8108:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760505.244029:0:8108:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e44128d800 from 1 10000000:01000000:3.0:1789760505.244038:0:8108:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760505.244073:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.244082:0:8108:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.244094:0:8108:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760505.244140:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064000:0@lo:101: 00000100:00100000:3.0:1789760505.244205:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.244282:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467d0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.244670:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798064000 00000100:00100000:2.0:1789760505.244678:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798064000 00000100:00100000:2.0:1789760505.244757:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760505.244766:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798064000:12345-0@lo:101: 00010000:00010000:2.0:1789760505.244780:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760505.244808:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398569b7 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.244833:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 15 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.244856:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 15 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.244874:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5820c6000, rc 0) 00000100:00100000:2.0:1789760505.244919:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064000:12345-0@lo:101: Request processed in 154us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.244925:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789760505.245216:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064000:0@lo:101: 00010000:00010000:3.0:1789760505.245231:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.245241:0:8108:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760505.245331:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064128:0@lo:501: 00000100:00100000:3.0:1789760505.245359:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.245383:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467d0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.245485:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798064128 00000100:00100000:2.0:1789760505.245490:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798064128 00000100:00100000:2.0:1789760505.245519:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760505.245526:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064128:12345-0@lo:501: 00000100:00100000:2.0:1789760505.245730:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064128:12345-0@lo:501: Request processed in 204us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.245737:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760505.245774:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064128:0@lo:501: 00000100:00100000:2.0:1789760505.245818:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064256:0@lo:503: 00000100:00100000:2.0:1789760505.245855:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.245882:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467df540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.245896:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798064256 00000100:00100000:2.0:1789760505.245900:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798064256 00000100:00100000:2.0:1789760505.245919:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789760505.245925:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064256:12345-0@lo:503: 00000100:00100000:2.0:1789760505.246059:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064256:12345-0@lo:503: Request processed in 133us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.246066:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789760505.246370:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064256:0@lo:503: 00000040:00080000:2.0:1789760505.246616:0:8108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789760505.246669:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064384:0@lo:502: 00000100:00100000:2.0:1789760505.246704:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.246729:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467df540 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.249892:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798064384 00000100:00100000:3.0:1789760505.249906:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798064384 00000100:00100000:3.0:1789760505.249961:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789760505.249971:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064384:12345-0@lo:502: 00000100:00100000:3.0:1789760505.250223:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064384:12345-0@lo:502: Request processed in 253us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.250240:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789760505.253383:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064384:0@lo:502: 00000040:00080000:2.0:1789760505.254045:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789760505.254114:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789760505.254157:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064512:0@lo:502: 00000100:00100000:2.0:1789760505.254348:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.254380:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544bd4240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.257571:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798064512 00000100:00100000:3.0:1789760505.257590:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798064512 00000100:00100000:3.0:1789760505.257662:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789760505.257672:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064512:12345-0@lo:502: 00000100:00100000:3.0:1789760505.258112:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064512:12345-0@lo:502: Request processed in 439us (3762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.258120:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789760505.258858:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064512:0@lo:502: 00000040:00080000:0.0:1789760505.259031:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789760505.259046:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789760505.259659:0:8133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760505.259668:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760505.259670:0:8133:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789760505.259676:0:8133:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e44128d800 00000020:00000080:2.0:1789760505.259679:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789760505.259697:0:8133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760505.259701:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760505.259702:0:8133:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789760505.259705:0:8133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789760505.259893:0:8108:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789760505.259917:0:8108:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760505.259941:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.259952:0:8108:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760505.259988:0:8108:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789760505.259991:0:8108:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e44128d800 10000000:01000000:0.0:1789760505.259993:0:8108:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e44128d800 10000000:01000000:0.0:1789760505.259997:0:8108:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760505.260003:0:8108:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e44128d800 from 1 10000000:01000000:0.0:1789760505.260005:0:8108:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760505.260234:0:8108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.260244:0:8108:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.260254:0:8108:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760505.260274:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064640:0@lo:101: 00000100:00100000:0.0:1789760505.260328:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.260404:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.260510:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798064640 00000100:00100000:2.0:1789760505.260517:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798064640 00000100:00100000:2.0:1789760505.260596:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789760505.260607:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8108:x1876699798064640:12345-0@lo:101: 00010000:00010000:2.0:1789760505.260619:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760505.260631:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a7398569c5 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.260653:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 16 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.260673:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 16 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.260683:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5820c6200, rc 0) 00000100:00100000:2.0:1789760505.260729:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798064640:12345-0@lo:101: Request processed in 124us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.260736:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789760505.260836:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064640:0@lo:101: 00010000:00010000:0.0:1789760505.260850:0:8108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.260858:0:8108:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760505.260955:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064768:0@lo:501: 00000100:00100000:0.0:1789760505.260982:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.261074:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.261262:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798064768 00000100:00100000:3.0:1789760505.261268:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798064768 00000100:00100000:3.0:1789760505.261291:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789760505.261299:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798064768:12345-0@lo:501: 00000100:00100000:3.0:1789760505.261855:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798064768:12345-0@lo:501: Request processed in 554us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.261862:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789760505.261981:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064768:0@lo:501: 00000100:00100000:0.0:1789760505.262013:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064896:0@lo:503: 00000100:00100000:0.0:1789760505.262054:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.262082:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.262164:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798064896 00000100:00100000:2.0:1789760505.262169:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798064896 00000100:00100000:2.0:1789760505.262194:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789760505.262201:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798064896:12345-0@lo:503: 00000100:00100000:2.0:1789760505.262351:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798064896:12345-0@lo:503: Request processed in 151us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.262357:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789760505.263352:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798064896:0@lo:503: 00000040:00080000:0.0:1789760505.264497:0:8108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760505.264593:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798065024:0@lo:502: 00000100:00100000:0.0:1789760505.264862:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.264945:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760505.265540:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798065024 00000100:00100000:2.0:1789760505.265549:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798065024 00000100:00100000:2.0:1789760505.265817:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789760505.265827:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798065024:12345-0@lo:502: 00000100:00100000:2.0:1789760505.266097:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798065024:12345-0@lo:502: Request processed in 271us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.266105:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789760505.266263:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798065024:0@lo:502: 00000040:00080000:0.0:1789760505.266564:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789760505.266619:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789760505.266654:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789760505.266705:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789760505.266742:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789760505.266804:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789760505.266839:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789760505.266883:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789760505.266931:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789760505.266966:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789760505.266995:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789760505.267041:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789760505.267078:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789760505.267125:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789760505.267171:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789760505.267209:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789760505.267243:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789760505.267294:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789760505.267330:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789760505.267359:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789760505.267405:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789760505.267442:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789760505.267478:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789760505.267542:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789760505.267581:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789760505.267616:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789760505.267664:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789760505.267700:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789760505.267734:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789760505.267816:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789760505.267852:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789760505.267901:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789760505.267936:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789760505.268002:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789760505.268039:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789760505.268087:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789760505.268124:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1789760505.268164:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798065152:0@lo:502: 00000100:00100000:0.0:1789760505.268230:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.268263:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760505.268858:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798065152 00000100:00100000:3.0:1789760505.268876:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798065152 00000100:00100000:3.0:1789760505.268923:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789760505.268932:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798065152:12345-0@lo:502: 00000100:00100000:3.0:1789760505.269162:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798065152:12345-0@lo:502: Request processed in 230us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.269169:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789760505.269407:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798065152:0@lo:502: 00000040:00080000:0.0:1789760505.269593:0:8108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789760505.269605:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789760505.270778:0:8134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789760505.270942:0:8134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97e4489c99b8) 00000020:00000080:1.0:1789760505.270963:0:8134:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789760505.271035:0:8134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e44128d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789760505.271038:0:8134:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e44128d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789760505.271041:0:8134:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e44128d800 3 00010000:00080000:1.0:1789760505.271068:0:8134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e57fd9f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1789760505.275574:0:8134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1789760505.275883:0:8134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789760505.275921:0:8134:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789760505.275933:0:8134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc2b9a3a7398569da 00000100:00080000:0.0:1789760505.275943:0:8134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760505.275948:0:8134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97e57fd9f800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1789760505.275976:0:8134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e57b2a3b80 x1876699798065280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760505.275996:0:8134:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789760505.276095:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3460:1876699798065280:0@lo:38: 00000100:00100000:2.0:1789760505.276167:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.276221:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798065280 00000100:00100000:2.0:1789760505.276227:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798065280 00000100:00100000:2.0:1789760505.276256:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760505.276270:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3460:x1876699798065280:12345-0@lo:38: 00010000:00080000:2.0:1789760505.276290:0:6466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1789760505.276317:0:6466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc2b9a3a7398569e1 00000004:00100000:2.0:1789760505.276331:0:6466:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789760505.276358:0:6466:0:(import.c:65:import_set_state_nolock()) ffff97e4489b1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760505.276430:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1876699798065280:12345-0@lo:38: Request processed in 158us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.276437:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789760505.276470:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e57b2a3b80 x1876699798065280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760505.276480:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789760505.276486:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789760505.276492:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789760505.276495:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789760505.276497:0:3460:0:(import.c:65:import_set_state_nolock()) ffff97e57fd9f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789760505.276502:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3460:1876699798065280:0@lo:38: 00000020:01000004:2.0:1789760505.277599:0:8134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789760505.277629:0:8134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff97e448a94d28) 00000020:00000080:2.0:1789760505.277647:0:8134:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1789760505.277727:0:8134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e44128d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789760505.277731:0:8134:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e44128d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789760505.277733:0:8134:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e44128d800 3 00010000:00080000:2.0:1789760505.277758:0:8134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e4489b0000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1789760505.279453:0:8134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:3.0:1789760505.279805:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760505.279824:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798065664:0@lo:400: 00000100:00100000:3.0:1789760505.279897:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.279945:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798065664 00000100:00100000:3.0:1789760505.279959:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798065664 00000100:00100000:3.0:1789760505.280002:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789760505.280011:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798065664:12345-0@lo:400: 00000100:00100000:3.0:1789760505.280065:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798065664:12345-0@lo:400: Request processed in 54us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760505.280072:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789760505.280114:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798065664:0@lo:400: 00000100:00100000:3.0:1789760505.280220:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798065408:0@lo:400: 00000100:00100000:3.0:1789760505.280246:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760505.280266:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760505.280271:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798065536:0@lo:400: 00000100:00100000:3.0:1789760505.280296:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.288276:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798065408 00000100:00100000:2.0:1789760505.288292:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798065408 00000100:00100000:2.0:1789760505.288340:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798065536 00000100:00100000:2.0:1789760505.288357:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798065536 00000100:00100000:2.0:1789760505.288383:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760505.288391:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798065408:12345-0@lo:400: 00000100:00100000:2.0:1789760505.288487:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798065408:12345-0@lo:400: Request processed in 96us (8239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.288495:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760505.288511:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760505.288518:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798065536:12345-0@lo:400: 00000100:00100000:2.0:1789760505.288548:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798065536:12345-0@lo:400: Request processed in 32us (8251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.288554:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789760505.288621:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e5433dca80 x1876699798065536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760505.288637:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798065536:0@lo:400: 00010000:00080000:2.0:1789760505.288651:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e5433df100 x1876699798065408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760505.288659:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798065408:0@lo:400: 00000020:00000080:2.0:1789760505.288929:0:8134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789760505.288964:0:8134:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789760505.288974:0:8134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc2b9a3a7398569ef 00000100:00080000:2.0:1789760505.288981:0:8134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789760505.288986:0:8134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff97e4489b0000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1789760505.289011:0:8134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e5434b8000 x1876699798065792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760505.289037:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3460:1876699798065792:0@lo:38: 00000100:00100000:2.0:1789760505.289082:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760505.289122:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798065792 00000100:00100000:2.0:1789760505.289126:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798065792 00000100:00100000:2.0:1789760505.289144:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760505.289148:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1876699798065792:12345-0@lo:38: 00010000:00080000:2.0:1789760505.289166:0:6465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1789760505.289195:0:6465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc2b9a3a7398569f6 00000004:00100000:2.0:1789760505.289208:0:6465:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789760505.289233:0:6465:0:(import.c:65:import_set_state_nolock()) ffff97e4489b1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760505.289270:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1876699798065792:12345-0@lo:38: Request processed in 120us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.289276:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789760505.289304:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e5434b8000 x1876699798065792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760505.289311:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789760505.289317:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789760505.289323:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789760505.289327:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789760505.289329:0:3460:0:(import.c:65:import_set_state_nolock()) ffff97e4489b0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789760505.289334:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3460:1876699798065792:0@lo:38: 00000100:00080000:2.0:1789760505.289348:0:8134:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1789760505.291462:0:8134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1789760505.293023:0:8108:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789760505.293070:0:8108:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760505.293094:0:8108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.293107:0:8108:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789760505.293156:0:8108:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789760505.293158:0:8108:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760505.293159:0:8108:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760505.293160:0:8108:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760505.293162:0:8108:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760505.293163:0:8108:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760505.293165:0:8108:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760505.293166:0:8108:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760505.293168:0:8108:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760505.293169:0:8108:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760505.293171:0:8108:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789760505.293174:0:8108:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789760505.293177:0:8108:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789760505.293179:0:8108:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760505.293180:0:8108:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760505.293181:0:8108:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760505.293182:0:8108:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760505.293188:0:8108:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760505.293189:0:8108:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760505.293190:0:8108:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760505.293191:0:8108:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760505.293192:0:8108:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760505.293193:0:8108:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789760505.293218:0:8108:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789760505.293235:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798065920:0@lo:253: 00000100:00100000:0.0:1789760505.293489:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.293536:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760505.294067:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798065920 00000100:00100000:1.0:1789760505.294075:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798065920 00000100:00100000:1.0:1789760505.294189:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789760505.294200:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:8108:x1876699798065920:12345-0@lo:253: 20000000:01000000:1.0:1789760505.294228:0:6460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789760505.294242:0:6460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789760505.349083:0:6460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789760505.349104:0:6460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789760505.349185:0:6481:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789760505.349190:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789760505.349216:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.349252:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5820c7600/0xc2b9a3a7398568f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.349261:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5413d2000/0xc2b9a3a73985690f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.349268:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.349304:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5413d2000/0xc2b9a3a73985690f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.349320:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5413d2000/0xc2b9a3a73985690f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 16 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.349335:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798066048:0@lo:104: 00000100:00100000:2.0:1789760505.349406:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760505.349463:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5820c7600/0xc2b9a3a7398568f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.349471:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5820c7600/0xc2b9a3a7398568f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 16 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760505.349481:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798066176:0@lo:104: 00000100:00100000:2.0:1789760505.349500:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f070300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760505.349571:0:6449:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789760505.349590:0:6449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.349618:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798066048 00000100:00100000:0.0:1789760505.349626:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798066048 00000100:00100000:0.0:1789760505.349659:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798066176 00000100:00100000:0.0:1789760505.349662:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798066176 00000100:00100000:3.0:1789760505.349677:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760505.349696:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a751450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6481:x1876699798066048:12345-0@lo:104: 00010000:00010000:3.0:1789760505.349710:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760505.349774:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760505.349781:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a751450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6481:x1876699798066048:12345-0@lo:104: Request processed in 94us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.349885:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798066048:0@lo:104: 00010000:00010000:1.0:1789760505.349891:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760505.349900:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.349909:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d3a00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760505.349914:0:6453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.349934:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760505.349943:0:6453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760505.349949:0:6453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760505.349984:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.349992:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760505.350010:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856908 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.350017:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985690f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.350030:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760505.350032:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760505.350033:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760505.350045:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798066304:0@lo:103: 00000100:00100000:1.0:1789760505.350075:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760505.353217:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760505.353988:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798066304 00000100:00100000:1.0:1789760505.354015:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798066304 00010000:00010000:1.0:1789760505.354054:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5413d2000/0xc2b9a3a73985690f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 17 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760505.354105:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760505.354113:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:3464:x1876699798066304:12345-0@lo:103: 00010000:00010000:1.0:1789760505.354126:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760505.354131:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5413d2000/0xc2b9a3a73985690f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 17 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.354142:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5413d2000/0xc2b9a3a73985690f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 17 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.354157:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5413d2000/0xc2b9a3a73985690f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856908 expref: 17 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.354173:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760505.354246:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:3464:x1876699798066304:12345-0@lo:103: Request processed in 134us (4170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760505.354253:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760505.354298:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798066304:0@lo:103: 00000100:00100000:3.0:1789760505.355505:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760505.357133:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760505.357163:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6481:x1876699798066176:12345-0@lo:104: 00010000:00010000:2.0:1789760505.357182:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e540030600/0xc2b9a3a7398568ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760505.357282:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760505.357288:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6481:x1876699798066176:12345-0@lo:104: Request processed in 131us (7697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760505.357296:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789760505.357515:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760505.357530:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e540030600/0xc2b9a3a7398568ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.357539:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030600 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760505.357543:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e540030600/0xc2b9a3a7398568ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.357551:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e540030600/0xc2b9a3a7398568ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760505.357566:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e540030600/0xc2b9a3a7398568ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760505.357572:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760505.357611:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e540030600/0xc2b9a3a7398568ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760505.357620:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798066176:0@lo:104: 00010000:00010000:1.0:1789760505.357629:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760505.357649:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.357651:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e540030600/0xc2b9a3a7398568ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.357668:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e540030600/0xc2b9a3a7398568ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398568f3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.357686:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760505.357688:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760505.357690:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760505.357703:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798066432:0@lo:103: 00000100:00100000:1.0:1789760505.357740:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.357915:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798066432 00000100:00100000:0.0:1789760505.357921:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798066432 00010000:00010000:0.0:1789760505.357943:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5820c7600/0xc2b9a3a7398568f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 16 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760505.357974:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789760505.357981:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:3461:x1876699798066432:12345-0@lo:103: 00010000:00010000:0.0:1789760505.357991:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760505.357997:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5820c7600/0xc2b9a3a7398568f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 16 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358019:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5820c7600/0xc2b9a3a7398568f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 16 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358034:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5820c7600/0xc2b9a3a7398568f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398568ec expref: 16 pid: 6460 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358047:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358055:0:6451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789760505.358076:0:6451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008886028s 00010000:00010000:0.0:1789760505.358081:0:6451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358088:0:6451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358095:0:6451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358101:0:6451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358106:0:6451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c6e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760505.358110:0:6451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358117:0:6451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358144:0:6451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760505.358154:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760505.358173:0:6481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.358182:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760505.358189:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a7398569fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760505.358191:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:3461:x1876699798066432:12345-0@lo:103: Request processed in 210us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.358206:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789760505.358238:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798066432:0@lo:103: 00000100:00100000:0.0:1789760505.363881:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:8108:x1876699798065920:12345-0@lo:253: Request processed in 69665us (70374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.363895:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789760505.364027:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8108:1876699798065920:0@lo:253: 10000000:01000000:2.0:1789760505.364044:0:8108:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789760505.364047:0:8108:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789760505.364049:0:8108:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789760505.364050:0:8108:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760505.364051:0:8108:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760505.364053:0:8108:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760505.364054:0:8108:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760505.364055:0:8108:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760505.364057:0:8108:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760505.364059:0:8108:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760505.364061:0:8108:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760505.364062:0:8108:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789760505.364077:0:8108:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789760505.375640:0:8108:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760505.376019:0:8108:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760505.376288:0:8108:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760505.376462:0:8108:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760505.376675:0:8108:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760505.377090:0:8108:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789760505.381376:0:8108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789760505.546709:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760505.546735:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798066560:0@lo:41: 00000100:00100000:0.0:1789760505.547062:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760505.547331:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798066560 00000100:00100000:0.0:1789760505.547339:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798066560 00000100:00100000:0.0:1789760505.547433:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760505.547444:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798066560:12345-0@lo:41: 00000004:00000024:0.0:1789760505.547477:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789760505.547536:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798066560:12345-0@lo:41: Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760505.547543:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760505.548890:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798066560:0@lo:41: 00002000:00080000:1.0:1789760505.615769:0:8108:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789760505.615776:0:8108:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789760505.615829:0:8108:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789760505.615916:0:8108:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789760505.615930:0:8108:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789760505.615957:0:8108:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789760506.380848:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760507.404621:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760508.427101:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760509.448121:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760510.158994:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798066688:0@lo:41: 00000100:00100000:1.0:1789760510.159099:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.161083:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798066688 00000100:00100000:2.0:1789760510.161096:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798066688 00000100:00100000:2.0:1789760510.161158:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789760510.161169:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798066688:12345-0@lo:41: 00000004:00000024:2.0:1789760510.161208:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760510.161306:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798066688:12345-0@lo:41: Request processed in 138us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.161323:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789760510.161374:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798066688:0@lo:41: 00010000:00010000:1.0:1789760510.477373:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789760510.663018:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789760510.663025:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e544828000 from 30 10000000:01000000:1.0:1789760510.663030:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760510.663075:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760510.663086:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760510.663098:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760510.663120:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798066816:0@lo:101: 00000100:00100000:1.0:1789760510.663184:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.663224:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760510.663872:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798066816 00000100:00100000:2.0:1789760510.663880:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798066816 00000100:00100000:2.0:1789760510.663920:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789760510.663929:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:6462:x1876699798066816:12345-0@lo:101: 00010000:00010000:2.0:1789760510.663943:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760510.663956:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856a04 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.663979:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 15 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.663990:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 15 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.663999:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5820c7600, rc 0) 00000100:00100000:2.0:1789760510.664039:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798066816:12345-0@lo:101: Request processed in 111us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.664047:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789760510.664594:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798066816:0@lo:101: 00010000:00010000:1.0:1789760510.664610:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760510.664620:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760510.664821:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798067072:0@lo:501: 00000100:00100000:1.0:1789760510.664865:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.664891:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760510.664905:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798067072 00000100:00100000:1.0:1789760510.664927:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798067072 00000100:00100000:1.0:1789760510.664959:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789760510.664966:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798067072:12345-0@lo:501: 00000100:00100000:1.0:1789760510.665256:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798067072:12345-0@lo:501: Request processed in 289us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.665264:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789760510.665365:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798067072:0@lo:501: 00000100:00100000:1.0:1789760510.665390:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798067200:0@lo:503: 00000100:00100000:1.0:1789760510.665426:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.665445:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760510.665457:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798067200 00000100:00100000:1.0:1789760510.665460:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798067200 00000100:00100000:1.0:1789760510.665482:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789760510.665489:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798067200:12345-0@lo:503: 00000100:00100000:1.0:1789760510.665739:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798067200:12345-0@lo:503: Request processed in 250us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.665745:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789760510.665783:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798067200:0@lo:503: 00000100:00100000:2.0:1789760510.666211:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798066944:0@lo:41: 00000100:00100000:2.0:1789760510.666254:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.666292:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798066944 00000100:00100000:0.0:1789760510.666299:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798066944 00000100:00100000:2.0:1789760510.666306:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798067712:0@lo:400: 00000100:00100000:2.0:1789760510.666335:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.666345:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789760510.666356:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798066944:12345-0@lo:41: 00000004:00000024:0.0:1789760510.666389:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760510.666454:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760510.666464:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798067584:0@lo:400: 00000100:00100000:0.0:1789760510.666468:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798066944:12345-0@lo:41: Request processed in 113us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.666477:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789760510.666494:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.666531:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798066944:0@lo:41: 00000100:00100000:2.0:1789760510.666714:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798067456:0@lo:400: 00000100:00100000:2.0:1789760510.666740:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.666758:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789760510.666762:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798067328:0@lo:400: 00000100:00100000:2.0:1789760510.666782:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.666818:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798067840:0@lo:400: 00000100:00100000:2.0:1789760510.666850:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.666871:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798067712 00000100:00100000:2.0:1789760510.666874:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798067712 00000100:00100000:2.0:1789760510.666901:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798067456 00000100:00100000:2.0:1789760510.666904:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798067456 00000100:00100000:2.0:1789760510.666915:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798067328 00000100:00100000:2.0:1789760510.666917:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798067328 00000100:00100000:2.0:1789760510.666926:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798067840 00000100:00100000:2.0:1789760510.666928:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798067840 00000100:00100000:2.0:1789760510.666941:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760510.666947:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798067712:12345-0@lo:400: 00000100:00100000:2.0:1789760510.666983:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798067712:12345-0@lo:400: Request processed in 36us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.666990:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760510.667003:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760510.667009:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798067456:12345-0@lo:400: 00000100:00100000:2.0:1789760510.667037:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798067456:12345-0@lo:400: Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.667043:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760510.667068:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760510.667074:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798067328:12345-0@lo:400: 00000100:00100000:2.0:1789760510.667109:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798067328:12345-0@lo:400: Request processed in 35us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.667115:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760510.667127:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760510.667133:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798067840:12345-0@lo:400: 00000100:00100000:2.0:1789760510.667156:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798067840:12345-0@lo:400: Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.667161:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789760510.667193:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5434bad80 x1876699798067712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760510.667203:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798067712:0@lo:400: 00010000:00080000:2.0:1789760510.667226:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5434b8a80 x1876699798067328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760510.667235:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798067328:0@lo:400: 00010000:00080000:2.0:1789760510.667244:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5434b8e00 x1876699798067840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760510.667252:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798067840:0@lo:400: 00010000:00080000:2.0:1789760510.667261:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5434bb100 x1876699798067456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760510.667269:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798067456:0@lo:400: 00000100:00100000:1.0:1789760510.667724:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798067584 00000100:00100000:1.0:1789760510.667731:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798067584 00000100:00100000:1.0:1789760510.667777:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760510.667784:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798067584:12345-0@lo:400: 00000100:00100000:1.0:1789760510.667862:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798067584:12345-0@lo:400: Request processed in 79us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.667868:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789760510.667886:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760510.667890:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760510.667910:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798067584:0@lo:400: 00000100:00100000:1.0:1789760510.668123:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8423:1876699798067968:0@lo:502: 00000100:00100000:1.0:1789760510.668166:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.668190:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798067968 00000100:00100000:1.0:1789760510.668194:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798067968 00000100:00100000:1.0:1789760510.668219:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789760510.668225:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8423:x1876699798067968:12345-0@lo:502: 00000100:00100000:1.0:1789760510.672948:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8423:x1876699798067968:12345-0@lo:502: Request processed in 4714us (4772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.672961:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789760510.673025:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760510.673049:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8423:1876699798067968:0@lo:502: 00000100:00100000:1.0:1789760510.673112:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8423:1876699798068096:0@lo:502: 00000100:00100000:1.0:1789760510.673153:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.673181:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.673610:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798068096 00000100:00100000:0.0:1789760510.673627:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798068096 00000100:00100000:0.0:1789760510.673678:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789760510.673688:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8423:x1876699798068096:12345-0@lo:502: 00000100:00100000:0.0:1789760510.673932:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:8423:x1876699798068096:12345-0@lo:502: Request processed in 245us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.673939:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789760510.673988:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8423:1876699798068096:0@lo:502: 00000040:00080000:0.0:1789760510.674014:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789760510.674090:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789760510.674106:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760510.674115:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.674126:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760510.674147:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789760510.674150:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e544828000 from 5 10000000:01000000:0.0:1789760510.674153:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789760510.674182:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.674191:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.674200:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760510.674214:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068224:0@lo:101: 00000100:00100000:0.0:1789760510.674245:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.674268:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690900 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.674283:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798068224 00000100:00100000:0.0:1789760510.674287:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798068224 00000100:00100000:0.0:1789760510.674311:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789760510.674317:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798068224:12345-0@lo:101: 00010000:00010000:0.0:1789760510.674338:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760510.674351:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856a12 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.674371:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 16 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.674381:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 16 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.674400:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540030600, rc 0) 00000100:00100000:0.0:1789760510.674429:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798068224:12345-0@lo:101: Request processed in 111us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.674434:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789760510.674478:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068224:0@lo:101: 00010000:00010000:0.0:1789760510.674491:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.674500:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760510.674808:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068352:0@lo:256: 00000100:00100000:0.0:1789760510.674855:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.674873:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690900 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.674890:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798068352 00000100:00100000:0.0:1789760510.674895:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798068352 00000100:00100000:0.0:1789760510.674928:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789760510.674936:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798068352:12345-0@lo:256: 20000000:01000000:0.0:1789760510.674950:0:6460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789760510.674965:0:6460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789760510.674968:0:6460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789760510.675072:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798068352:12345-0@lo:256: Request processed in 137us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.675079:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789760510.675377:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068352:0@lo:256: 10000000:01000000:1.0:1789760510.675419:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789760510.675426:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760510.675440:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760510.675448:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789760510.675450:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789760510.675453:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789760510.675472:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760510.675479:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760510.675487:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760510.675499:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068480:0@lo:101: 00000100:00100000:1.0:1789760510.675754:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.675782:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.675961:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798068480 00000100:00100000:0.0:1789760510.675967:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798068480 00000100:00100000:0.0:1789760510.676001:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789760510.676008:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798068480:12345-0@lo:101: 00010000:00010000:0.0:1789760510.676018:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760510.676028:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856a20 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.676117:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.676129:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.676136:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540031c00, rc 0) 00000100:00100000:0.0:1789760510.676172:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798068480:12345-0@lo:101: Request processed in 164us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.676177:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789760510.676209:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068480:0@lo:101: 00010000:00010000:0.0:1789760510.676220:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.676228:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760510.676274:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068608:0@lo:501: 00000100:00100000:0.0:1789760510.676300:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.676314:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5486909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.676440:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798068608 00000100:00100000:0.0:1789760510.676445:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798068608 00000100:00100000:0.0:1789760510.676468:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789760510.676481:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798068608:12345-0@lo:501: 00000100:00100000:0.0:1789760510.676965:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798068608:12345-0@lo:501: Request processed in 483us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.677344:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068608:0@lo:501: 00000100:00100000:1.0:1789760510.677382:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068736:0@lo:503: 00000100:00100000:1.0:1789760510.677427:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.677449:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.677853:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789760510.677884:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798068736 00000100:00100000:0.0:1789760510.677889:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798068736 00000100:00100000:0.0:1789760510.677913:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789760510.677921:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798068736:12345-0@lo:503: 00000100:00100000:0.0:1789760510.679242:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798068736:12345-0@lo:503: Request processed in 1316us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.679252:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789760510.681196:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798068736:0@lo:503: 00000100:00100000:3.0:1789760510.686221:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8425:1876699798068864:0@lo:502: 00000100:00100000:3.0:1789760510.686328:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.686381:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760510.686445:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798068864 00000100:00100000:1.0:1789760510.686453:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798068864 00000100:00100000:1.0:1789760510.686502:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789760510.686512:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:8425:x1876699798068864:12345-0@lo:502: 00000100:00100000:1.0:1789760510.686960:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:8425:x1876699798068864:12345-0@lo:502: Request processed in 447us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.686968:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789760510.687345:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8425:1876699798068864:0@lo:502: 00000020:01000000:3.0:1789760510.688158:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789760510.688173:0:8425:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:3.0:1789760510.688178:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760510.688181:0:8425:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789760510.688187:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789760510.688191:0:8425:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1789760510.688587:0:8425:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789760510.688594:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760510.688609:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff97e44118b370) 00000020:00000080:3.0:1789760510.688631:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789760510.688638:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789760510.688714:0:8425:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789760510.688719:0:8425:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789760510.688725:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc2b9a3a739856a35 00010000:00080000:3.0:1789760510.688752:0:8425:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e4444c8000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1789760510.688991:0:8425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789760510.759396:0:8425:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789760510.759430:0:8425:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789760510.759947:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760510.760104:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760510.760154:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789760510.760208:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789760510.765110:0:8429:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789760510.765118:0:8429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789760510.765688:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789760510.765700:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789760510.765757:0:8425:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789760510.765942:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc2b9a3a739856a3c 00000100:00080000:0.0:1789760510.765952:0:8425:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760510.765958:0:8425:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97e4444c8000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1789760510.765994:0:8425:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e57b2a3800 x1876699798068992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760510.766021:0:8425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789760510.766105:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3460:1876699798068992:0@lo:8: 00000100:00100000:3.0:1789760510.766173:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.766282:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798068992 00000100:00100000:1.0:1789760510.766289:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798068992 00000100:00100000:1.0:1789760510.766319:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760510.766395:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3460:x1876699798068992:12345-0@lo:8: 00010000:00080000:1.0:1789760510.766424:0:8110:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1789760510.766444:0:8110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc2b9a3a739856a43 00002000:00100000:1.0:1789760510.766470:0:8110:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff97e448ad2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789760510.766474:0:8110:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789760510.766575:0:8110:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789760510.766670:0:8110:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789760510.766884:0:8110:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789760510.766908:0:8110:0:(import.c:65:import_set_state_nolock()) ffff97e448ad3800 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1789760510.767280:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760510.767287:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760510.767289:0:8425:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789760510.767293:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760510.767297:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760510.767298:0:8425:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760510.767301:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760510.767304:0:8425:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789760510.767343:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8425:1876699798069120:0@lo:502: 00000100:00100000:0.0:1789760510.767391:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.767413:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.767433:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798069120 00000100:00100000:0.0:1789760510.767437:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798069120 00000100:00100000:0.0:1789760510.767470:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789760510.767477:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:8425:x1876699798069120:12345-0@lo:502: 00000100:00100000:0.0:1789760510.767674:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:8425:x1876699798069120:12345-0@lo:502: Request processed in 197us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.767682:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789760510.767741:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8425:1876699798069120:0@lo:502: 00000020:01000000:0.0:1789760510.767766:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760510.767770:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760510.767771:0:8425:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760510.767778:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1789760510.768122:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1789760510.768153:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789760510.768163:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.768173:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760510.768183:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789760510.768186:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e546616000 from 30 10000000:01000000:0.0:1789760510.768189:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760510.768226:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.768244:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.768254:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760510.768268:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798069248:0@lo:101: 00000100:00100000:0.0:1789760510.768299:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.768316:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.768331:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798069248 00000100:00100000:0.0:1789760510.768335:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798069248 00000100:00100000:0.0:1789760510.768361:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789760510.768368:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798069248:12345-0@lo:101: 00010000:00010000:0.0:1789760510.768377:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760510.768388:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856a4a expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.768408:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.768419:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 18 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.768427:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dcc00, rc 0) 00000100:00100000:0.0:1789760510.768463:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798069248:12345-0@lo:101: Request processed in 96us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.768469:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789760510.768502:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798069248:0@lo:101: 00010000:00010000:0.0:1789760510.768520:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760510.768528:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760510.768567:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798069376:0@lo:501: 00000100:00100000:0.0:1789760510.768590:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.768603:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.768614:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798069376 00000100:00100000:0.0:1789760510.768618:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798069376 00000100:00100000:0.0:1789760510.768638:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789760510.768645:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798069376:12345-0@lo:501: 00000100:00100000:0.0:1789760510.768872:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798069376:12345-0@lo:501: Request processed in 226us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760510.768879:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789760510.769680:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798069376:0@lo:501: 00000100:00100000:0.0:1789760510.769725:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798069504:0@lo:503: 00000100:00100000:0.0:1789760510.769780:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.769970:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760510.769994:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798069504 00000100:00100000:0.0:1789760510.770000:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798069504 00000100:00100000:0.0:1789760510.770048:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789760510.770058:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798069504:12345-0@lo:503: 00000100:00100000:1.0:1789760510.770113:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3460:x1876699798068992:12345-0@lo:8: Request processed in 3717us (3937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.770125:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760510.770217:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b2a3800 x1876699798068992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760510.770229:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789760510.770245:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789760510.770253:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1789760510.770255:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798069504:12345-0@lo:503: Request processed in 197us (473us total) trans 0 rc 0/0 00000100:00080000:2.0:1789760510.770259:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789760510.770264:0:3460:0:(import.c:65:import_set_state_nolock()) ffff97e4444c8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789760510.770266:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000004:00080000:2.0:1789760510.770277:0:3460:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789760510.770285:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3460:1876699798068992:0@lo:8: 00000004:00080000:2.0:1789760510.770311:0:8429:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789760510.770335:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798069504:0@lo:503: 00000100:00100000:0.0:1789760510.770338:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8431:1876699798069632:0@lo:700: 00000100:00100000:0.0:1789760510.770375:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789760510.770432:0:8429:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 186954642774ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789760510.770535:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760510.771513:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8432:1876699798069760:0@lo:502: 00000100:00100000:3.0:1789760510.771565:0:8121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798069632 00000100:00100000:1.0:1789760510.771571:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.771574:0:8121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798069632 00000100:00100000:1.0:1789760510.771615:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.771624:0:8121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760510.771636:0:8121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8431:x1876699798069632:12345-0@lo:700: 00000100:00100000:3.0:1789760510.771666:0:8121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8121:1876699798069888:0@lo:700: 00000100:00100000:3.0:1789760510.771697:0:8121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.771724:0:8121:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21840 going to sleep for 11 seconds 00000100:00080000:3.0:1789760510.771740:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760510.771862:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798069888 00000100:00100000:1.0:1789760510.771868:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798069888 00000100:00100000:1.0:1789760510.771917:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760510.771925:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8121:x1876699798069888:12345-0@lo:700: 00000100:00100000:1.0:1789760510.772557:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798069760 00000100:00100000:1.0:1789760510.772563:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798069760 00000100:00100000:1.0:1789760510.772600:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789760510.772608:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8432:x1876699798069760:12345-0@lo:502: 00000100:00100000:1.0:1789760510.773218:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8432:x1876699798069760:12345-0@lo:502: Request processed in 608us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.773227:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789760510.773294:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8432:1876699798069760:0@lo:502: 00000100:00100000:1.0:1789760510.773362:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8432:1876699798070016:0@lo:502: 00000100:00100000:1.0:1789760510.773403:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760510.773433:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54508c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.776466:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798070016 00000100:00100000:3.0:1789760510.776479:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798070016 00000100:00100000:3.0:1789760510.776532:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789760510.776541:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8432:x1876699798070016:12345-0@lo:502: 00000100:00100000:3.0:1789760510.778560:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:8432:x1876699798070016:12345-0@lo:502: Request processed in 2010us (5146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.778575:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789760510.782021:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8432:1876699798070016:0@lo:502: 00000040:00080000:2.0:1789760510.782069:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789760510.782138:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789760510.782160:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789760510.782171:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.782183:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760510.782193:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789760510.782195:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e546616000 from 5 10000000:01000000:2.0:1789760510.782198:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789760510.782233:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.782243:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.782253:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760510.782285:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070144:0@lo:101: 00000100:00100000:2.0:1789760510.782345:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.782381:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760510.782400:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798070144 00000100:00100000:2.0:1789760510.782405:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798070144 00000100:00100000:2.0:1789760510.782446:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789760510.782454:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798070144:12345-0@lo:101: 00010000:00010000:2.0:1789760510.782468:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760510.782479:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856a58 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.782501:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 19 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.782510:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 19 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.782519:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5820c6e00, rc 0) 00000100:00100000:2.0:1789760510.782554:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798070144:12345-0@lo:101: Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.782560:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789760510.782597:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070144:0@lo:101: 00010000:00010000:2.0:1789760510.782608:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.782617:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760510.782666:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070272:0@lo:256: 00000100:00100000:2.0:1789760510.782714:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.784810:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760510.785047:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798070272 00000100:00100000:2.0:1789760510.785056:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798070272 00000100:00100000:2.0:1789760510.785105:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789760510.785116:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798070272:12345-0@lo:256: 20000000:01000000:2.0:1789760510.785138:0:6457:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789760510.785155:0:6457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789760510.785159:0:6457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789760510.785291:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798070272:12345-0@lo:256: Request processed in 177us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.785299:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789760510.785346:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070272:0@lo:256: 10000000:01000000:2.0:1789760510.785394:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789760510.785404:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.785414:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760510.785423:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789760510.785425:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789760510.785428:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789760510.785466:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.785483:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.785494:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760510.785511:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070400:0@lo:101: 00000100:00100000:2.0:1789760510.785543:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.785568:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760510.785581:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798070400 00000100:00100000:2.0:1789760510.785585:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798070400 00000100:00100000:2.0:1789760510.785606:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789760510.785612:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798070400:12345-0@lo:101: 00010000:00010000:2.0:1789760510.785619:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760510.785630:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856a66 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.785650:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 20 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.785660:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 20 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.785668:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8f800, rc 0) 00000100:00100000:2.0:1789760510.785695:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798070400:12345-0@lo:101: Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.786957:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789760510.787023:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070400:0@lo:101: 00010000:00010000:2.0:1789760510.787051:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760510.787063:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760510.787122:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070528:0@lo:501: 00000100:00100000:2.0:1789760510.787165:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.787196:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760510.787436:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798070528 00000100:00100000:2.0:1789760510.787442:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798070528 00000100:00100000:2.0:1789760510.787476:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789760510.787486:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798070528:12345-0@lo:501: 00000100:00100000:2.0:1789760510.789153:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798070528:12345-0@lo:501: Request processed in 1663us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.789166:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789760510.789228:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070528:0@lo:501: 00000100:00100000:2.0:1789760510.789280:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070656:0@lo:503: 00000100:00100000:2.0:1789760510.789332:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.789359:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798070656 00000100:00100000:3.0:1789760510.789367:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798070656 00000100:00100000:2.0:1789760510.789370:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.789408:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789760510.789417:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798070656:12345-0@lo:503: 00000100:00100000:3.0:1789760510.789728:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798070656:12345-0@lo:503: Request processed in 312us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.789735:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789760510.790101:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798070656:0@lo:503: 00000100:00100000:3.0:1789760510.790715:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8434:1876699798070784:0@lo:502: 00000100:00100000:3.0:1789760510.790761:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.790803:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798070784 00000100:00100000:3.0:1789760510.790808:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798070784 00000100:00100000:3.0:1789760510.790849:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789760510.790857:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:8434:x1876699798070784:12345-0@lo:502: 00000100:00100000:3.0:1789760510.794148:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:8434:x1876699798070784:12345-0@lo:502: Request processed in 3283us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.794161:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789760510.794220:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.794245:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8434:1876699798070784:0@lo:502: 00000020:01000000:3.0:1789760510.794280:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789760510.794293:0:8434:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789760510.794299:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760510.794301:0:8434:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789760510.794308:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789760510.794312:0:8434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1789760510.794332:0:8434:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789760510.794335:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760510.794349:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97e441188000) 00000020:00000080:3.0:1789760510.794370:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789760510.794375:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789760510.794448:0:8434:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789760510.794453:0:8434:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789760510.794458:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2b9a3a739856a7b 00010000:00080000:3.0:1789760510.794499:0:8434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e441fee000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1789760510.794729:0:8434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1789760510.811240:0:6472:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1789760510.819412:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8121:x1876699798069888:12345-0@lo:700: Request processed in 47482us (47707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.819425:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789760510.819707:0:8121:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5433df800 x1876699798069888/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760526 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760510.819724:0:8121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8121:1876699798069888:0@lo:700: 40000000:02000000:1.0:1789760510.819740:0:8121:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000004:00080000:2.0:1789760510.852626:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:01000000:3.0:1789760510.876857:0:8434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789760510.877455:0:8434:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789760510.880309:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760510.880547:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760510.880600:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789760510.880654:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789760510.885227:0:8438:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789760510.885234:0:8438:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789760510.885644:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789760510.885656:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789760510.887089:0:8434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789760510.887119:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2b9a3a739856a82 00000100:00080000:3.0:1789760510.887130:0:8434:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760510.887136:0:8434:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97e441fee000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1789760510.887174:0:8434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e5433dc380 x1876699798070912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789760510.887195:0:8434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789760510.887276:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760510.887281:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760510.887283:0:8434:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789760510.887286:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760510.887290:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760510.887291:0:8434:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789760510.887294:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760510.887296:0:8434:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789760510.887322:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8434:1876699798071040:0@lo:502: 00000100:00100000:3.0:1789760510.887393:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.887429:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.887445:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1876699798070912:0@lo:8: 00000100:00100000:3.0:1789760510.887474:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.887587:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798071040 00000100:00100000:3.0:1789760510.887594:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798071040 00000100:00100000:3.0:1789760510.887630:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789760510.887638:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:8434:x1876699798071040:12345-0@lo:502: 00000100:00100000:3.0:1789760510.887884:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:8434:x1876699798071040:12345-0@lo:502: Request processed in 245us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.887892:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789760510.887932:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798070912 00000100:00100000:3.0:1789760510.887936:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798070912 00000100:00100000:3.0:1789760510.887954:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760510.887958:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3460:x1876699798070912:12345-0@lo:8: 00010000:00080000:3.0:1789760510.887981:0:8114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1789760510.888005:0:8114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2b9a3a739856a89 00002000:00100000:3.0:1789760510.888017:0:8114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97e57f84d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789760510.888021:0:8114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789760510.888029:0:8114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789760510.888217:0:8114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789760510.888239:0:8114:0:(import.c:65:import_set_state_nolock()) ffff97e57f84c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760510.888281:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3460:x1876699798070912:12345-0@lo:8: Request processed in 321us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.888288:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760510.888308:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798071168:0@lo:400: 00000100:00100000:3.0:1789760510.888336:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.888358:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798071680:0@lo:400: 00000100:00100000:3.0:1789760510.888378:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.888397:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760510.888402:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798071552:0@lo:400: 00000100:00100000:3.0:1789760510.888426:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.888455:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798071296:0@lo:400: 00000100:00100000:3.0:1789760510.888478:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.888496:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798071808:0@lo:400: 00000100:00100000:3.0:1789760510.888532:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.888549:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789760510.888555:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798071424:0@lo:400: 00000100:00100000:3.0:1789760510.888574:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.888585:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798071936:0@lo:400: 00000100:00100000:3.0:1789760510.888604:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.888638:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798071936 00000100:00100000:3.0:1789760510.888642:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798071936 00000100:00100000:3.0:1789760510.888668:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760510.888675:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3463:x1876699798071936:12345-0@lo:400: 00000100:00100000:3.0:1789760510.888711:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3463:x1876699798071936:12345-0@lo:400: Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.888723:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789760510.888759:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5433dc380 x1876699798070912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760510.888768:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789760510.888775:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789760510.888782:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789760510.888811:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789760510.888814:0:3460:0:(import.c:65:import_set_state_nolock()) ffff97e441fee000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789760510.890350:0:3460:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789760510.890363:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1876699798070912:0@lo:8: 00000100:00100000:3.0:1789760510.890406:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798071168 00000100:00100000:3.0:1789760510.890413:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798071168 00000100:00100000:3.0:1789760510.890446:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798071680 00000100:00100000:3.0:1789760510.890449:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798071680 00000100:00100000:3.0:1789760510.890459:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798071808 00000100:00100000:3.0:1789760510.890461:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798071808 00000100:00100000:3.0:1789760510.890470:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798071424 00000100:00100000:3.0:1789760510.890473:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798071424 00000100:00100000:3.0:1789760510.890486:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760510.890493:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798071168:12345-0@lo:400: 00000100:00100000:3.0:1789760510.890565:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798071168:12345-0@lo:400: Request processed in 71us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.890572:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760510.890587:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789760510.890592:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798071680:12345-0@lo:400: 00000100:00100000:3.0:1789760510.890617:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798071680:12345-0@lo:400: Request processed in 25us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.890636:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789760510.890647:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760510.890653:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798071808:12345-0@lo:400: 00000100:00100000:3.0:1789760510.890681:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798071808:12345-0@lo:400: Request processed in 28us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.890687:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789760510.890839:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5433dd180 x1876699798071168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760510.890854:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798071168:0@lo:400: 00010000:00080000:2.0:1789760510.890866:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5433df100 x1876699798071680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760510.890881:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798071680:0@lo:400: 00000100:00100000:3.0:1789760510.892092:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789760510.892116:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798071424:12345-0@lo:400: 00000100:00100000:3.0:1789760510.892185:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798071424:12345-0@lo:400: Request processed in 77us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.892191:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789760510.892230:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798071552 00000100:00100000:3.0:1789760510.892237:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798071552 00000100:00100000:3.0:1789760510.892269:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798071296 00000100:00100000:3.0:1789760510.892272:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798071296 00000100:00100000:3.0:1789760510.892287:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760510.892293:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798071552:12345-0@lo:400: 00000100:00100000:3.0:1789760510.892329:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798071552:12345-0@lo:400: Request processed in 37us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.892336:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760510.892349:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789760510.892355:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798071296:12345-0@lo:400: 00000100:00100000:3.0:1789760510.892382:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798071296:12345-0@lo:400: Request processed in 28us (3903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.892388:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789760510.892440:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5433dd500 x1876699798071424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760510.892463:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798071424:0@lo:400: 00010000:00080000:3.0:1789760510.892478:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f874000 x1876699798071936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760510.892486:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798071936:0@lo:400: 00000100:00100000:3.0:1789760510.892497:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798071296:0@lo:400: 00010000:00080000:3.0:1789760510.892507:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5433dca80 x1876699798071808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760510.892514:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798071808:0@lo:400: 00000100:00100000:3.0:1789760510.892560:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798071552:0@lo:400: 00000100:00100000:3.0:1789760510.892581:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:8434:1876699798071040:0@lo:502: 00000020:01000000:3.0:1789760510.892609:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760510.892615:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760510.892618:0:8434:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789760510.892624:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789760510.894109:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789760510.894133:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789760510.894143:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760510.894153:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760510.894163:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789760510.894165:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e550c219b8 from 1 10000000:01000000:3.0:1789760510.894175:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789760510.894206:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760510.894214:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760510.894223:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760510.894243:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798072064:0@lo:101: 00000100:00100000:3.0:1789760510.894296:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.894330:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.894348:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798072064 00000100:00100000:3.0:1789760510.894353:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798072064 00000100:00100000:3.0:1789760510.894388:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789760510.894395:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798072064:12345-0@lo:101: 00010000:00010000:3.0:1789760510.894406:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760510.894417:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856a90 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760510.894438:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760510.894448:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760510.894457:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541483a00, rc 0) 00000100:00100000:3.0:1789760510.894493:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798072064:12345-0@lo:101: Request processed in 98us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.894507:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789760510.894550:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798072064:0@lo:101: 00010000:00010000:3.0:1789760510.894561:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760510.894570:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760510.894610:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798072192:0@lo:501: 00000100:00100000:3.0:1789760510.894633:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760510.894655:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86240 going to sleep for 11 seconds 00000004:00080000:3.0:1789760510.894669:0:8438:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789760510.894902:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798072192 00000100:00100000:0.0:1789760510.894907:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798072192 00000100:00100000:0.0:1789760510.894932:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789760510.894938:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798072192:12345-0@lo:501: 00000004:00080000:3.0:1789760510.895449:0:8438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 187079660399ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789760510.895708:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798072192:0@lo:501: 00000100:00100000:0.0:1789760510.895710:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798072192:12345-0@lo:501: Request processed in 770us (1073us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760510.895721:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 10000000:01000000:1.0:1789760510.895746:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789760510.895761:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760510.895771:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789760510.906918:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789760510.907135:0:8121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8431:x1876699798069632:12345-0@lo:700: Request processed in 135498us (136756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.907150:0:8121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789760510.907266:0:8431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b2a0000 x1876699798069632/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760526 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760510.907282:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8431:1876699798069632:0@lo:700: 00000100:00100000:2.0:1789760510.955980:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798072320:0@lo:13: 00000004:00080000:1.0:1789760510.956092:0:8431:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789760510.956117:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8431:1876699798072448:0@lo:7: 00000100:00100000:1.0:1789760510.956170:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.956259:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760510.956318:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798072320 00000100:00100000:2.0:1789760510.956325:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798072320 00000100:00100000:2.0:1789760510.956368:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760510.956376:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798072320:12345-0@lo:13: 00002000:00000024:2.0:1789760510.956406:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789760510.956450:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798072320:12345-0@lo:13: Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760510.956456:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760510.956695:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760510.956721:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798072448 00000100:00100000:1.0:1789760510.956726:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798072448 00000100:00100000:1.0:1789760510.956760:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760510.956768:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8431:x1876699798072448:12345-0@lo:7: 00010000:00080000:2.0:1789760510.957138:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b1de300 x1876699798072320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760510.957159:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798072320:0@lo:13: 00000004:00080000:0.0:1789760510.962674:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789760510.972152:0:8110:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789760510.972160:0:8110:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789760510.972267:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8431:x1876699798072448:12345-0@lo:7: Request processed in 15495us (16091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760510.972277:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789760510.972407:0:8431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b1dfb80 x1876699798072448/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760526 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760510.972422:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8431:1876699798072448:0@lo:7: 00000004:00080000:0.0:1789760510.972436:0:8431:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789760510.972469:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8431:1876699798072576:0@lo:5: 00000100:00100000:0.0:1789760510.972500:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.972526:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690480 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.972529:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798072576 00000100:00100000:3.0:1789760510.972537:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798072576 00000100:00100000:3.0:1789760510.972581:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760510.972591:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8431:x1876699798072576:12345-0@lo:5: 00002000:00080000:3.0:1789760510.972624:0:8114:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789760510.972712:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8431:x1876699798072576:12345-0@lo:5: Request processed in 122us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.972718:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789760510.973307:0:8431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b2a0a80 x1876699798072576/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760526 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760510.973319:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8431:1876699798072576:0@lo:5: 00000004:00080000:0.0:1789760510.973330:0:8431:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789760510.973359:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8431:1876699798072704:0@lo:5: 00000100:00100000:0.0:1789760510.973391:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.973421:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690480 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.973615:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798072704 00000100:00100000:3.0:1789760510.973621:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798072704 00000100:00100000:3.0:1789760510.973660:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760510.973667:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8431:x1876699798072704:12345-0@lo:5: 00002000:00080000:3.0:1789760510.973704:0:8110:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789760510.979098:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8431:x1876699798072704:12345-0@lo:5: Request processed in 5423us (5699us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789760510.979111:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789760510.979293:0:8431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b2a0a80 x1876699798072704/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760526 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760510.979310:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8431:1876699798072704:0@lo:5: 00000004:00080000:0.0:1789760510.979324:0:8431:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789760510.979363:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8431:1876699798072832:0@lo:900: 00000100:00100000:0.0:1789760510.979398:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760510.979429:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760510.979543:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798072832 00000100:00100000:3.0:1789760510.979550:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798072832 00000100:00100000:3.0:1789760510.979593:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760510.979601:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8431:x1876699798072832:12345-0@lo:900: 00000100:00100000:3.0:1789760510.980310:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8431:x1876699798072832:12345-0@lo:900: Request processed in 707us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760510.980317:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789760510.980715:0:8431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b2a2d80 x1876699798072832/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789760526 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760510.980729:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8431:1876699798072832:0@lo:900: 00000004:00080000:2.0:1789760511.017879:0:8439:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789760511.017909:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8439:1876699798073088:0@lo:7: 00000100:00100000:2.0:1789760511.017976:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760511.018015:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789760511.018029:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760511.018039:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798072960:0@lo:13: 00000100:00100000:0.0:1789760511.018047:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798073088 00000100:00100000:0.0:1789760511.018054:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798073088 00000100:00100000:2.0:1789760511.018062:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760511.018087:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798072960 00000100:00100000:2.0:1789760511.018090:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798072960 00000100:00100000:0.0:1789760511.018115:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760511.018115:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760511.018123:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8439:x1876699798073088:12345-0@lo:7: 00000100:00100000:2.0:1789760511.018127:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3461:x1876699798072960:12345-0@lo:13: 00002000:00000024:2.0:1789760511.018144:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789760511.018185:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3461:x1876699798072960:12345-0@lo:13: Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760511.018192:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789760511.018229:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5434b8e00 x1876699798072960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760511.018247:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798072960:0@lo:13: 00000100:00080000:1.0:1789760511.019858:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1789760511.029632:0:8114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789760511.029640:0:8114:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789760511.029735:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8439:x1876699798073088:12345-0@lo:7: Request processed in 11608us (11753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760511.029745:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789760511.030519:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e5434b8a80 x1876699798073088/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760527 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760511.030535:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8439:1876699798073088:0@lo:7: 00000004:00080000:3.0:1789760511.030547:0:8439:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789760511.030584:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8439:1876699798073216:0@lo:5: 00000100:00100000:3.0:1789760511.030627:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760511.030675:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760511.031282:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798073216 00000100:00100000:1.0:1789760511.031291:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798073216 00000100:00100000:1.0:1789760511.031352:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789760511.031361:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8439:x1876699798073216:12345-0@lo:5: 00002000:00080000:1.0:1789760511.031386:0:8110:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789760511.031395:0:8110:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789760511.031996:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8439:x1876699798073216:12345-0@lo:5: Request processed in 634us (1365us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789760511.032004:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789760511.032281:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f874e00 x1876699798073216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760527 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760511.032297:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8439:1876699798073216:0@lo:5: 00000004:00080000:3.0:1789760511.032308:0:8439:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789760511.032341:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8439:1876699798073344:0@lo:700: 00000100:00100000:3.0:1789760511.032372:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760511.032592:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760511.032711:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798073344 00000100:00100000:1.0:1789760511.032718:0:8122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798073344 00000100:00100000:1.0:1789760511.032812:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760511.032830:0:8122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8439:x1876699798073344:12345-0@lo:700: 00000100:00100000:1.0:1789760511.098346:0:8122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8439:x1876699798073344:12345-0@lo:700: Request processed in 65518us (65964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760511.098359:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789760511.098418:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f875880 x1876699798073344/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760527 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760511.098435:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8439:1876699798073344:0@lo:700: 00000001:00080000:2.0:1789760511.098959:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1789760511.098969:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789760511.098974:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1789760511.134806:0:8439:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1789760511.141425:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8439:1876699798073472:0@lo:5: 00000100:00100000:0.0:1789760511.141558:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760511.141660:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798073472 00000100:00100000:3.0:1789760511.141668:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798073472 00000100:00100000:3.0:1789760511.141744:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760511.141753:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8439:x1876699798073472:12345-0@lo:5: 00000100:00100000:1.0:1789760511.143870:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a35a9c0 going to sleep for 11 seconds 00002000:00080000:3.0:1789760511.152973:0:8114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789760511.152993:0:8114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789760511.161450:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8439:x1876699798073472:12345-0@lo:5: Request processed in 19688us (19948us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789760511.161463:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789760511.161675:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b2a2d80 x1876699798073472/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760527 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760511.161689:0:8439:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789760511.161704:0:8439:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97e57b2a2d80 x1876699798073472/t4294967299(4294967299) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760527 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760511.161731:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8439:1876699798073472:0@lo:5: 00000004:00080000:0.0:1789760511.161745:0:8439:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1789760511.494886:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760511.564281:0:8493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789760512.519019:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760513.543324:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760514.566914:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760515.272273:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760515.272308:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798073600:0@lo:41: 00000100:00100000:1.0:1789760515.272396:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760515.272488:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798073600 00000100:00100000:1.0:1789760515.272497:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798073600 00000100:00100000:1.0:1789760515.272554:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789760515.272565:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798073600:12345-0@lo:41: 00000004:00000024:1.0:1789760515.272617:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789760515.272675:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798073600:12345-0@lo:41: Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760515.272693:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789760515.272760:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798073600:0@lo:41: 00010000:00010000:2.0:1789760515.591966:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760515.783155:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760515.783180:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798073728:0@lo:41: 00000100:00100000:3.0:1789760515.783246:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760515.783342:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798073728 00000100:00100000:0.0:1789760515.783350:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798073728 00000100:00100000:0.0:1789760515.783399:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789760515.783407:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798073728:12345-0@lo:41: 00000004:00000024:0.0:1789760515.783442:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789760515.783488:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798073728:12345-0@lo:41: Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760515.783495:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760515.783594:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798073728:0@lo:41: 00000001:00080000:2.0:1789760516.170009:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1789760516.295748:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798073856:0@lo:400: 00000100:00100000:1.0:1789760516.295864:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.295913:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798074368:0@lo:400: 00000100:00100000:1.0:1789760516.295940:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.295959:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798074880:0@lo:400: 00000100:00100000:1.0:1789760516.295981:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.296012:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789760516.296017:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798073984:0@lo:400: 00000100:00100000:1.0:1789760516.296038:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.296057:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798074496:0@lo:400: 00000100:00100000:1.0:1789760516.296076:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.296102:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798074112:0@lo:400: 00000100:00100000:1.0:1789760516.296123:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.296140:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798074624:0@lo:400: 00000100:00100000:1.0:1789760516.296176:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.296194:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789760516.296200:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798074240:0@lo:400: 00000100:00100000:1.0:1789760516.296225:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.296235:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798074752:0@lo:400: 00000100:00100000:1.0:1789760516.296254:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760516.296254:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798073856 00000100:00100000:3.0:1789760516.296261:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798073856 00000100:00100000:1.0:1789760516.296295:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798074368 00000100:00100000:1.0:1789760516.296298:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798074368 00000100:00100000:3.0:1789760516.296304:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789760516.296323:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:3461:x1876699798073856:12345-0@lo:400: 00000100:00100000:1.0:1789760516.296329:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798074112 00000100:00100000:1.0:1789760516.296331:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798074112 00000100:00100000:1.0:1789760516.296342:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789760516.296348:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798074368:12345-0@lo:400: 00000100:00100000:3.0:1789760516.296373:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:3461:x1876699798073856:12345-0@lo:400: Request processed in 50us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760516.296376:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798074368:12345-0@lo:400: Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760516.296380:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789760516.296381:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789760516.296394:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760516.296399:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798074112:12345-0@lo:400: 00000100:00100000:3.0:1789760516.296408:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798073984 00000100:00100000:3.0:1789760516.296411:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798073984 00000100:00100000:1.0:1789760516.296428:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798074112:12345-0@lo:400: Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760516.296428:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798074496 00000100:00100000:3.0:1789760516.296431:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798074496 00000100:00100000:1.0:1789760516.296434:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789760516.296450:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798074624 00000100:00100000:3.0:1789760516.296453:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798074624 00000100:00100000:1.0:1789760516.296462:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798074880 00000100:00100000:3.0:1789760516.296464:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798074240 00000100:00100000:1.0:1789760516.296465:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798074880 00000100:00100000:3.0:1789760516.296466:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798074240 00000100:00100000:3.0:1789760516.296476:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789760516.296481:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798073984:12345-0@lo:400: 00000100:00100000:1.0:1789760516.296485:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798074752 00000100:00100000:1.0:1789760516.296487:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798074752 00000100:00100000:1.0:1789760516.296498:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760516.296504:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798074880:12345-0@lo:400: 00000100:00100000:3.0:1789760516.296516:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798073984:12345-0@lo:400: Request processed in 35us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760516.296523:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760516.296527:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798074880:12345-0@lo:400: Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760516.296532:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760516.296533:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760516.296538:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798074496:12345-0@lo:400: 00000100:00100000:1.0:1789760516.296541:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760516.296545:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798074752:12345-0@lo:400: 00000100:00100000:3.0:1789760516.296561:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798074496:12345-0@lo:400: Request processed in 23us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760516.296564:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798074752:12345-0@lo:400: Request processed in 19us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760516.296567:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760516.296569:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760516.296577:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760516.296582:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798074624:12345-0@lo:400: 00000100:00100000:3.0:1789760516.296607:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798074624:12345-0@lo:400: Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760516.296612:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789760516.296614:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f88f800 x1876699798074752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760516.296621:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789760516.296627:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798074240:12345-0@lo:400: 00000100:00100000:1.0:1789760516.296635:0:3463:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789760516.296649:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798074752:0@lo:400: 00000100:00100000:3.0:1789760516.296649:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798074240:12345-0@lo:400: Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760516.296654:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760516.296662:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798074112:0@lo:400: 00010000:00080000:1.0:1789760516.296672:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f88ce00 x1876699798074624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760516.296680:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798074624:0@lo:400: 00010000:00080000:3.0:1789760516.296683:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b1de300 x1876699798073984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760516.296691:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798073984:0@lo:400: 00010000:00080000:1.0:1789760516.296696:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b1dd500 x1876699798074240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789760516.296699:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f88ed80 x1876699798074496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760516.296704:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798074240:0@lo:400: 00000100:00100000:3.0:1789760516.296707:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798074496:0@lo:400: 00000100:00100000:3.0:1789760516.296725:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798073856:0@lo:400: 00000100:00100000:3.0:1789760516.296733:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798074368:0@lo:400: 00010000:00080000:3.0:1789760516.296741:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f88d880 x1876699798074880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760516.296747:0:3461:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789760516.296755:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798074880:0@lo:400: 00000100:00080000:3.0:1789760516.296773:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760516.296778:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760516.296779:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760516.298008:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798075008:0@lo:13: 00000100:00100000:1.0:1789760516.298055:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760516.298095:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798075008 00000100:00100000:1.0:1789760516.298100:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798075008 00000100:00100000:1.0:1789760516.298130:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760516.298137:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798075008:12345-0@lo:13: 00002000:00000024:1.0:1789760516.298165:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760516.298209:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798075008:12345-0@lo:13: Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760516.298215:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789760516.298674:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f88ce00 x1876699798075008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760516.298743:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798075136:0@lo:13: 00000100:00100000:0.0:1789760516.298773:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760516.298968:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798075008:0@lo:13: 00000100:00100000:0.0:1789760516.299008:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798075136 00000100:00100000:0.0:1789760516.299013:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798075136 00000100:00100000:0.0:1789760516.299053:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760516.299060:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798075136:12345-0@lo:13: 00002000:00000024:0.0:1789760516.299072:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760516.299104:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798075136:12345-0@lo:13: Request processed in 45us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760516.299110:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789760516.299143:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b2a3480 x1876699798075136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760516.299156:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798075136:0@lo:13: 00010000:00010000:1.0:1789760516.617182:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760517.642696:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760518.664413:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760519.689600:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760520.391196:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798075264:0@lo:41: 00000100:00100000:0.0:1789760520.391272:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760520.391391:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798075264 00000100:00100000:3.0:1789760520.391400:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798075264 00000100:00100000:3.0:1789760520.391449:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789760520.391459:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798075264:12345-0@lo:41: 00000004:00000024:3.0:1789760520.391497:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760520.391544:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798075264:12345-0@lo:41: Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760520.391550:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760520.391649:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798075264:0@lo:41: 00010000:00010000:2.0:1789760520.711326:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760520.903037:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798075392:0@lo:41: 00000100:00100000:3.0:1789760520.903110:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760520.903237:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798075392 00000100:00100000:2.0:1789760520.903246:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798075392 00000100:00100000:2.0:1789760520.903297:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760520.903306:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798075392:12345-0@lo:41: 00000004:00000024:2.0:1789760520.903346:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760520.903399:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798075392:12345-0@lo:41: Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760520.903405:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760520.903516:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798075392:0@lo:41: 00000100:00100000:0.0:1789760521.415531:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798075520:0@lo:13: 00000100:00100000:0.0:1789760521.415599:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760521.415668:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798075520 00000100:00100000:0.0:1789760521.415675:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798075520 00000100:00100000:0.0:1789760521.415720:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760521.415729:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798075520:12345-0@lo:13: 00002000:00000024:0.0:1789760521.415773:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760521.415832:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798075520:12345-0@lo:13: Request processed in 104us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760521.415839:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789760521.415884:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57b2a1c00 x1876699798075520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760521.415902:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798075520:0@lo:13: 00000100:00080000:3.0:1789760521.416188:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760521.416200:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760521.416210:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798075648:0@lo:13: 00000100:00100000:3.0:1789760521.416254:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.416291:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798075648 00000100:00100000:3.0:1789760521.416295:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798075648 00000100:00100000:3.0:1789760521.416325:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760521.416332:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798075648:12345-0@lo:13: 00002000:00000024:3.0:1789760521.416344:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760521.416375:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798075648:12345-0@lo:13: Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.416382:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789760521.416399:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760521.416417:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f877b80 x1876699798075648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760521.416429:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798075648:0@lo:13: 00000100:00100000:3.0:1789760521.417964:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798075776:0@lo:400: 00000100:00100000:3.0:1789760521.418020:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.418056:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798076288:0@lo:400: 00000100:00100000:3.0:1789760521.418082:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.418104:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760521.418110:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798076160:0@lo:400: 00000100:00100000:3.0:1789760521.418131:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.418155:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798075776 00000100:00100000:3.0:1789760521.418161:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798075776 00000100:00100000:3.0:1789760521.418198:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789760521.418207:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:3464:x1876699798075776:12345-0@lo:400: 00000100:00100000:3.0:1789760521.418250:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:3464:x1876699798075776:12345-0@lo:400: Request processed in 44us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.418269:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789760521.418297:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798076288 00000100:00100000:3.0:1789760521.418301:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798076288 00000100:00100000:3.0:1789760521.418382:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798076160 00000100:00100000:3.0:1789760521.418386:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798076160 00000100:00100000:3.0:1789760521.418403:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760521.418409:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798076288:12345-0@lo:400: 00000100:00100000:3.0:1789760521.418441:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798076288:12345-0@lo:400: Request processed in 33us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.418447:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760521.418460:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760521.418466:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798076160:12345-0@lo:400: 00000100:00100000:3.0:1789760521.419685:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798076160:12345-0@lo:400: Request processed in 1215us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.419694:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789760521.419732:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760521.419758:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798076032:0@lo:400: 00000100:00100000:3.0:1789760521.419811:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.419837:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789760521.419842:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798075904:0@lo:400: 00000100:00100000:3.0:1789760521.419863:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.419877:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798076416:0@lo:400: 00000100:00100000:3.0:1789760521.419894:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.419914:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798076032 00000100:00100000:3.0:1789760521.419920:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798076032 00000100:00100000:3.0:1789760521.419952:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789760521.419959:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798076032:12345-0@lo:400: 00000100:00100000:3.0:1789760521.420023:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798076032:12345-0@lo:400: Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.420029:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789760521.420047:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798075904 00000100:00100000:3.0:1789760521.420050:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798075904 00000100:00100000:3.0:1789760521.420068:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798076416 00000100:00100000:3.0:1789760521.420070:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798076416 00000100:00100000:3.0:1789760521.420088:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760521.420093:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798075904:12345-0@lo:400: 00000100:00100000:3.0:1789760521.420121:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798075904:12345-0@lo:400: Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.420127:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760521.420137:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760521.420142:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798076416:12345-0@lo:400: 00000100:00100000:3.0:1789760521.420164:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798076416:12345-0@lo:400: Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.420169:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789760521.420181:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789760521.420210:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f874e00 x1876699798076160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760521.420224:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798076160:0@lo:400: 00000100:00100000:3.0:1789760521.420235:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798075776:0@lo:400: 00010000:00080000:3.0:1789760521.420245:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f875880 x1876699798076288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760521.420253:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798076288:0@lo:400: 00010000:00080000:3.0:1789760521.420293:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f875180 x1876699798075904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760521.420302:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798075904:0@lo:400: 00010000:00080000:3.0:1789760521.420311:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e57f874000 x1876699798076416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760521.420319:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798076416:0@lo:400: 00000100:00100000:3.0:1789760521.420327:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798076032:0@lo:400: 00000020:01000004:2.0:1789760521.487483:0:9064:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789760521.487487:0:9064:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789760521.487625:0:9064:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97e4489b2000 00000020:01000004:2.0:1789760521.487643:0:9064:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789760521.487657:0:9064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789760521.487671:0:9064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97e448a93370) 00000020:00000080:2.0:1789760521.487688:0:9064:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789760521.517639:0:9064:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789760521.520088:0:9064:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789760521.556433:0:9064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789760521.569413:0:9064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789760521.569452:0:9064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789760521.569600:0:9064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789760521.569629:0:9064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789760521.570222:0:9064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789760521.570235:0:9064:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789760521.570247:0:9064:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc2b9a3a739856aa5 00000020:01000004:3.0:1789760521.570254:0:9064:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789760521.571611:0:9064:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789760521.571617:0:9064:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789760521.571626:0:9064:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789760521.571654:0:9064:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789760521.571658:0:9064:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789760521.602328:0:9064:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789760521.602364:0:9064:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789760521.602368:0:9064:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789760521.602373:0:9064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760521.602375:0:9064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760521.602376:0:9064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760521.602377:0:9064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760521.602378:0:9064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760521.602379:0:9064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760521.602380:0:9064:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760521.602381:0:9064:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760521.602383:0:9064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760521.602384:0:9064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760521.602387:0:9064:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789760521.602389:0:9064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760521.602390:0:9064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760521.602391:0:9064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760521.602392:0:9064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760521.602392:0:9064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760521.602393:0:9064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760521.602394:0:9064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760521.602395:0:9064:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760521.602396:0:9064:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760521.602397:0:9064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760521.602397:0:9064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760521.602422:0:9064:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789760521.602440:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798076544:0@lo:253: 00000100:00100000:1.0:1789760521.602505:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.602614:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54534ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760521.602662:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798076544 00000100:00100000:3.0:1789760521.602670:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798076544 00000100:00100000:3.0:1789760521.604642:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789760521.604664:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9064:x1876699798076544:12345-0@lo:253: 20000000:01000000:3.0:1789760521.604702:0:6460:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789760521.604707:0:6460:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789760521.604712:0:6460:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789760521.604716:0:6460:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789760521.606391:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760521.606667:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789760521.606684:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789760521.606725:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789760521.606732:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789760521.606774:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789760521.606989:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789760521.607427:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789760521.607447:0:6460:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:3.0:1789760521.607449:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1789760521.607479:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789760521.607485:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760521.607525:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789760521.607532:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1789760521.607559:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789760521.607568:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760521.607599:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789760521.607673:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789760521.608467:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789760521.608486:0:6460:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:3.0:1789760521.608489:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1789760521.608525:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789760521.608533:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760521.608578:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789760521.608586:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1789760521.608617:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789760521.608624:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760521.608651:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789760521.608697:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789760521.609469:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1789760521.609486:0:6460:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:3.0:1789760521.609495:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1789760521.609538:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1789760521.609547:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789760521.609583:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1789760521.609591:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1789760521.609625:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1789760521.609635:0:6460:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760521.609687:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1789760521.609729:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1789760521.610545:0:6460:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789760521.610550:0:6460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789760521.610555:0:6460:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789760521.610557:0:6460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789760521.610559:0:6460:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789760521.610571:0:6460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789760521.610574:0:6460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789760521.610619:0:6460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789760521.610622:0:6460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789760521.611228:0:9066:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789760521.611304:0:9066:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789760521.611371:0:9066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1789760521.611703:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1789760521.612076:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1789760521.612147:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1789760521.612159:0:6460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789760521.612162:0:6460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789760521.612942:0:9067:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789760521.613001:0:9067:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789760521.613030:0:9067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789760521.613313:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789760521.613356:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1789760521.613421:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1789760521.613436:0:6460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789760521.613438:0:6460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789760521.614711:0:9068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1789760521.615091:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1789760521.615137:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1789760521.615206:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1789760521.615219:0:6460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789760521.615222:0:6460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789760521.618425:0:9069:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789760521.618520:0:9069:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789760521.618579:0:9069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789760521.622343:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789760521.622460:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789760521.622503:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1789760521.622516:0:6460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789760521.622519:0:6460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789760521.627044:0:9070:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1789760521.627133:0:9070:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1789760521.627196:0:9070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1789760521.627533:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1789760521.627572:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1789760521.627631:0:6460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:3.0:1789760521.627649:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789760521.627668:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627686:0:6460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 21 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627694:0:6460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627701:0:6460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627708:0:6460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 21 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627715:0:6460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 21 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627722:0:6460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 21 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627728:0:6460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627757:0:6460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627823:0:6460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627837:0:6460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 21 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.627851:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798076672:0@lo:104: 00000100:00100000:3.0:1789760521.627915:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760521.627965:0:6460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 21 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.627973:0:6460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 21 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.627982:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798076800:0@lo:104: 00000100:00100000:3.0:1789760521.628016:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760521.628044:0:6460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 21 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.628053:0:6460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 21 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.628062:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798076928:0@lo:104: 00000100:00100000:3.0:1789760521.628082:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760521.628098:0:6460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 21 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.628112:0:6460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 21 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.628122:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798077056:0@lo:104: 00000100:00100000:3.0:1789760521.628143:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760521.628161:0:6460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.628169:0:6460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 21 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.628177:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798077184:0@lo:104: 00000100:00100000:3.0:1789760521.628207:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760521.628228:0:6460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.628236:0:6460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 21 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.628244:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798077312:0@lo:104: 00000100:00100000:3.0:1789760521.628275:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760521.628291:0:6460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 21 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.628299:0:6460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 21 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.628307:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798077440:0@lo:104: 00000100:00100000:3.0:1789760521.628334:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f3a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.628429:0:6449:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789760521.628447:0:6449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.628459:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798076672 00000100:00100000:1.0:1789760521.628465:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798076672 00000100:00100000:1.0:1789760521.628497:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798076800 00000100:00100000:1.0:1789760521.628500:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798076800 00000100:00100000:1.0:1789760521.628510:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798076928 00000100:00100000:1.0:1789760521.628512:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798076928 00000100:00100000:1.0:1789760521.628530:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798077056 00000100:00100000:1.0:1789760521.628533:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798077056 00000100:00100000:1.0:1789760521.628540:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798077184 00000100:00100000:1.0:1789760521.628542:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798077184 00000100:00100000:1.0:1789760521.628548:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798077312 00000100:00100000:1.0:1789760521.628550:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798077312 00000100:00100000:1.0:1789760521.628557:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798077440 00000100:00100000:1.0:1789760521.628558:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798077440 00000100:00100000:1.0:1789760521.628583:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760521.628592:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6460:x1876699798076672:12345-0@lo:104: 00010000:00010000:1.0:1789760521.628603:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.628649:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760521.628655:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:6460:x1876699798076672:12345-0@lo:104: Request processed in 65us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.628662:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760521.628677:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760521.628683:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+8:6460:x1876699798076800:12345-0@lo:104: 00010000:00010000:1.0:1789760521.628690:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.628734:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789760521.628739:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+8:6460:x1876699798076800:12345-0@lo:104: Request processed in 57us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.628764:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760521.628777:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760521.628783:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+7:6460:x1876699798076928:12345-0@lo:104: 00010000:00010000:1.0:1789760521.628808:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.628845:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789760521.628851:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+7:6460:x1876699798076928:12345-0@lo:104: Request processed in 69us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.628857:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760521.628869:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760521.628876:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:6460:x1876699798077056:12345-0@lo:104: 00010000:00010000:1.0:1789760521.628883:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.628907:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789760521.628912:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:6460:x1876699798077056:12345-0@lo:104: Request processed in 38us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.628916:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760521.628927:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760521.628931:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:6460:x1876699798077184:12345-0@lo:104: 00010000:00010000:1.0:1789760521.628938:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.628959:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789760521.628963:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:6460:x1876699798077184:12345-0@lo:104: Request processed in 33us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.628969:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760521.628979:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760521.628984:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4489be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6460:x1876699798077312:12345-0@lo:104: 00010000:00010000:1.0:1789760521.628990:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629020:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789760521.629024:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4489be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6460:x1876699798077312:12345-0@lo:104: Request processed in 41us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.629030:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760521.629055:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760521.629061:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6460:x1876699798077440:12345-0@lo:104: 00010000:00010000:1.0:1789760521.629069:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629092:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789760521.629096:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6460:x1876699798077440:12345-0@lo:104: Request processed in 37us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.629101:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789760521.629117:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789760521.629122:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629129:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483e00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760521.629133:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629141:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760521.629148:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760521.629154:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760521.629189:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629194:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760521.629210:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629216:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856a90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a97 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629228:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789760521.629232:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629237:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ee00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760521.629239:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629245:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760521.629250:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760521.629255:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760521.629266:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629271:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760521.629292:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629309:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856a66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a6d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629318:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789760521.629321:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629326:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dd400 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760521.629329:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629335:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760521.629341:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760521.629346:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760521.629358:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629364:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760521.629369:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629376:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e4486dd400/0xc2b9a3a739856a4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a51 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629388:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789760521.629396:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629401:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d2800 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760521.629404:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629410:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760521.629416:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760521.629420:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760521.629434:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629439:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760521.629445:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629451:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5413d2800/0xc2b9a3a739856a20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a27 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629459:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789760521.629462:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629467:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d3000 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760521.629470:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629485:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760521.629491:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760521.629495:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760521.629508:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629514:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760521.629518:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629525:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a0b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629534:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789760521.629537:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629541:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540031400 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760521.629544:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629550:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760521.629555:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760521.629566:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760521.629578:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629584:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760521.629588:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629594:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e540031400/0xc2b9a3a7398569c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569cc expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629603:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760521.629606:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629611:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483600 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:1.0:1789760521.629613:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629620:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760521.629626:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760521.629630:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760521.629640:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629644:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760521.629654:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629659:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a73985699b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569a2 expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.629673:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760521.629674:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760521.629676:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760521.629696:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798077568:0@lo:103: 00000100:00100000:1.0:1789760521.629726:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.629763:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798078080:0@lo:103: 00000100:00100000:1.0:1789760521.629779:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.629828:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760521.629834:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798077952:0@lo:103: 00000100:00100000:1.0:1789760521.629854:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.629881:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798077824:0@lo:103: 00000100:00100000:1.0:1789760521.629909:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.629918:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798078336:0@lo:103: 00000100:00100000:1.0:1789760521.629936:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.629945:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789760521.629950:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798077696:0@lo:103: 00000100:00100000:1.0:1789760521.629968:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.629977:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798078208:0@lo:103: 00000100:00100000:1.0:1789760521.630007:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.630029:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798077568 00000100:00100000:1.0:1789760521.630035:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798077568 00010000:00010000:1.0:1789760521.630063:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 22 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.630079:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798078080 00000100:00100000:1.0:1789760521.630082:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798078080 00010000:00010000:1.0:1789760521.630092:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 23 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.630101:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798077952 00000100:00100000:1.0:1789760521.630104:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798077952 00010000:00010000:1.0:1789760521.630112:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 24 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.630122:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798077824 00000100:00100000:1.0:1789760521.630124:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798077824 00010000:00010000:1.0:1789760521.630132:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 25 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.630141:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798078336 00000100:00100000:1.0:1789760521.630144:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798078336 00010000:00010000:1.0:1789760521.630153:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 26 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.630161:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798077696 00000100:00100000:1.0:1789760521.630163:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798077696 00010000:00010000:1.0:1789760521.630172:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 27 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.630181:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798078208 00000100:00100000:1.0:1789760521.630184:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798078208 00010000:00010000:1.0:1789760521.630193:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 28 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.630204:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760521.630218:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+28:3462:x1876699798077568:12345-0@lo:103: 00010000:00010000:1.0:1789760521.630229:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.630235:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 28 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630246:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 28 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630261:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.630290:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+28:3462:x1876699798077568:12345-0@lo:103: Request processed in 73us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.630297:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760521.630313:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760521.630318:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+27:3462:x1876699798078080:12345-0@lo:103: 00010000:00010000:1.0:1789760521.630325:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.630330:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 27 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630337:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 27 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630346:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.630365:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+27:3462:x1876699798078080:12345-0@lo:103: Request processed in 47us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.630371:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760521.630382:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760521.630387:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+26:3462:x1876699798077952:12345-0@lo:103: 00010000:00010000:1.0:1789760521.630393:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.630403:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 26 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630411:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 26 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630421:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.630442:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+26:3462:x1876699798077952:12345-0@lo:103: Request processed in 55us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.630448:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760521.630459:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760521.630464:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545672050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+25:3464:x1876699798077824:12345-0@lo:103: 00010000:00010000:1.0:1789760521.630470:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.630475:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 25 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630482:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 25 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630491:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.630515:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545672050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+25:3464:x1876699798077824:12345-0@lo:103: Request processed in 50us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.630520:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760521.630556:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760521.630563:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798078336:12345-0@lo:103: 00010000:00010000:1.0:1789760521.630569:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.630573:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 24 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630589:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 24 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630598:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.630620:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798078336:12345-0@lo:103: Request processed in 58us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.630626:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760521.630639:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760521.630645:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:3464:x1876699798077696:12345-0@lo:103: 00010000:00010000:1.0:1789760521.630651:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.630655:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 23 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630663:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 23 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630671:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.630690:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:3464:x1876699798077696:12345-0@lo:103: Request processed in 46us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.630696:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760521.630707:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760521.630713:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:3464:x1876699798078208:12345-0@lo:103: 00010000:00010000:1.0:1789760521.630720:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.630724:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 22 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630731:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 22 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630763:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630770:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630784:0:6450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630814:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630820:0:6450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630827:0:6450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630832:0:6450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760521.630836:0:6450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630843:0:6450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630852:0:6450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.630861:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.630884:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:3464:x1876699798078208:12345-0@lo:103: Request processed in 171us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.630898:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760521.630938:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798077696:0@lo:103: 00000100:00100000:1.0:1789760521.630947:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798078208:0@lo:103: 00000100:00100000:1.0:1789760521.630954:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798077824:0@lo:103: 00000100:00100000:1.0:1789760521.630960:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798078336:0@lo:103: 00000100:00100000:1.0:1789760521.630988:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798077952:0@lo:103: 00000100:00100000:1.0:1789760521.630995:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798077568:0@lo:103: 00000100:00100000:1.0:1789760521.631001:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798078080:0@lo:103: 00010000:00010000:3.0:1789760521.631131:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856a97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856a90 expref: 21 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.631144:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798076672:0@lo:104: 00010000:00010000:3.0:1789760521.631155:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8f800/0xc2b9a3a739856a6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856a66 expref: 20 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.631164:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798076800:0@lo:104: 00010000:00010000:3.0:1789760521.631172:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e4486dcc00/0xc2b9a3a739856a51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856a4a expref: 19 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.631179:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798076928:0@lo:104: 00010000:00010000:3.0:1789760521.631189:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e540031c00/0xc2b9a3a739856a27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856a20 expref: 18 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.631198:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798077056:0@lo:104: 00010000:00010000:3.0:1789760521.631207:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5820c7600/0xc2b9a3a739856a0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856a04 expref: 17 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.631217:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798077184:0@lo:104: 00010000:00010000:3.0:1789760521.631226:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5820c6200/0xc2b9a3a7398569cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398569c5 expref: 16 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.631235:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798077312:0@lo:104: 00010000:00010000:3.0:1789760521.631244:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e540030c00/0xc2b9a3a7398569a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a73985699b expref: 15 pid: 6460 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.631264:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6460:1876699798077440:0@lo:104: 00010000:00010000:3.0:1789760521.631287:0:6460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.631295:0:6460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.631300:0:6460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.631306:0:6460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789760521.631318:0:6460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1789760521.631561:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760521.631567:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760521.671579:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:9064:x1876699798076544:12345-0@lo:253: Request processed in 66915us (69063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.671593:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789760521.671755:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798076544:0@lo:253: 10000000:01000000:0.0:1789760521.671770:0:9064:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789760521.671773:0:9064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760521.671775:0:9064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789760521.671776:0:9064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760521.671777:0:9064:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789760521.671779:0:9064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760521.671780:0:9064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760521.671781:0:9064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760521.671783:0:9064:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789760521.671784:0:9064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760521.671814:0:9064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789760521.671840:0:9064:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97e4489b2000 from lustre-OST0001 10000000:01000000:0.0:1789760521.671862:0:9064:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789760521.671865:0:9064:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789760521.671874:0:9064:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97e550c219b8 local copy 10000000:01000000:0.0:1789760521.671877:0:9064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789760521.671912:0:9064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760521.671923:0:9064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760521.671932:0:9064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760521.671949:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798078464:0@lo:101: 00000100:00100000:0.0:1789760521.671982:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760521.672017:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760521.672071:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798078464 00000100:00100000:3.0:1789760521.672077:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798078464 00000100:00100000:3.0:1789760521.672117:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760521.672124:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+14:9064:x1876699798078464:12345-0@lo:101: 00010000:00010000:3.0:1789760521.672136:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760521.672148:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856ab3 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.672171:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856ab3 expref: 15 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.672180:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856ab3 expref: 15 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.672203:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541483000, rc 0) 00000100:00100000:3.0:1789760521.672235:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798078464:12345-0@lo:101: Request processed in 111us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.672240:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789760521.672326:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798078464:0@lo:101: 00010000:00010000:1.0:1789760521.672338:0:9064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.672346:0:9064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.672592:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798078592:0@lo:501: 00000100:00100000:1.0:1789760521.672618:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.672638:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54534fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760521.672687:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798078592 00000100:00100000:3.0:1789760521.672691:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798078592 00000100:00100000:3.0:1789760521.672721:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789760521.672726:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798078592:12345-0@lo:501: 00000100:00100000:3.0:1789760521.672942:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798078592:12345-0@lo:501: Request processed in 214us (321us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760521.672949:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789760521.673032:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798078592:0@lo:501: 10000000:01000000:1.0:1789760521.673046:0:9064:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789760521.673071:0:9064:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789760521.673075:0:9064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673089:0:9064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673096:0:9064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673119:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789760521.673142:0:9064:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e4489b2000 10000000:01000000:1.0:1789760521.673147:0:9064:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789760521.673153:0:9064:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789760521.673155:0:9064:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789760521.673160:0:9064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789760521.673162:0:9064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789760521.673177:0:9064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673184:0:9064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673192:0:9064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.673202:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798078720:0@lo:101: 00000100:00100000:1.0:1789760521.673228:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.673249:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54534fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.673262:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798078720 00000100:00100000:1.0:1789760521.673266:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798078720 00000100:00100000:1.0:1789760521.673289:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789760521.673296:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798078720:12345-0@lo:101: 00010000:00010000:1.0:1789760521.673310:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760521.673320:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856ac1 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673336:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673344:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673351:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d2800, rc 0) 00000100:00100000:1.0:1789760521.673377:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798078720:12345-0@lo:101: Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.673383:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789760521.673536:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798078720:0@lo:101: 00010000:00010000:1.0:1789760521.673547:0:9064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.673556:0:9064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.673610:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798078848:0@lo:501: 00000100:00100000:1.0:1789760521.673635:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760521.673751:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760521.673758:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.673766:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486ddc00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760521.673769:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.673777:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760521.673783:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760521.673806:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760521.673826:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.673843:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760521.673861:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.673868:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856ab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc2b9a3a739856aba expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.673883:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760521.673885:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760521.673887:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760521.673951:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54534fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.673968:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798078976:0@lo:103: 00000100:00100000:1.0:1789760521.673994:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.674027:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798078976 00000100:00100000:1.0:1789760521.674031:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798078976 00000100:00100000:1.0:1789760521.674067:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760521.674074:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:3461:x1876699798078976:12345-0@lo:103: 00010000:00010000:1.0:1789760521.674082:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.674094:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e541483000/0xc2b9a3a739856aba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739856ab3 expref: 16 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.674103:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.674132:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:3461:x1876699798078976:12345-0@lo:103: Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.674139:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760521.674169:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798078976:0@lo:103: 00000100:00100000:0.0:1789760521.674595:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798078848 00000100:00100000:0.0:1789760521.674601:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798078848 00000100:00100000:2.0:1789760521.674755:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789760521.674765:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798078848:12345-0@lo:501: 00000100:00100000:2.0:1789760521.675047:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798078848:12345-0@lo:501: Request processed in 283us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760521.675055:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789760521.675138:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798078848:0@lo:501: 00000100:00100000:3.0:1789760521.675172:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079104:0@lo:503: 00000100:00100000:3.0:1789760521.675215:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.675428:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f3a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.675542:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798079104 00000100:00100000:1.0:1789760521.675547:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798079104 00000100:00100000:1.0:1789760521.675569:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789760521.675575:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798079104:12345-0@lo:503: 00000100:00100000:1.0:1789760521.675725:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798079104:12345-0@lo:503: Request processed in 149us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.675732:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789760521.675871:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079104:0@lo:503: 00000040:00080000:3.0:1789760521.676146:0:9064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760521.676204:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079232:0@lo:502: 00000100:00100000:3.0:1789760521.676243:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.676263:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f3a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.676644:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798079232 00000100:00100000:1.0:1789760521.676650:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798079232 00000100:00100000:1.0:1789760521.676676:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789760521.676683:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798079232:12345-0@lo:502: 00000100:00100000:1.0:1789760521.676884:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798079232:12345-0@lo:502: Request processed in 200us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.676891:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789760521.677151:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079232:0@lo:502: 00000040:00080000:3.0:1789760521.677478:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789760521.677530:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789760521.677565:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789760521.677610:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789760521.677644:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789760521.677678:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789760521.677717:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079360:0@lo:502: 00000100:00100000:3.0:1789760521.677776:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.677895:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f3a9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760521.677958:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798079360 00000100:00100000:0.0:1789760521.677964:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798079360 00000100:00100000:1.0:1789760521.678058:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789760521.678068:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798079360:12345-0@lo:502: 00000100:00100000:1.0:1789760521.678271:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798079360:12345-0@lo:502: Request processed in 205us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.678279:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789760521.678478:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079360:0@lo:502: 00000040:00080000:3.0:1789760521.678576:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789760521.678587:0:9064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789760521.679292:0:9072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789760521.679299:0:9072:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789760521.679306:0:9072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760521.679308:0:9072:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789760521.679313:0:9072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789760521.679326:0:9072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97e4489ccd28) 00000020:00000080:1.0:1789760521.679351:0:9072:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789760521.679357:0:9072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789760521.679499:0:9072:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e4489b2000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789760521.679507:0:9072:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789760521.679514:0:9072:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc2b9a3a739856ad6 00010000:00010000:1.0:1789760521.688525:0:9072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789760521.688924:0:9072:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789760521.692928:0:9072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789760521.693289:0:9072:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789760521.698167:0:9072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789760521.698651:0:9072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789760521.700829:0:9072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789760521.700840:0:9072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760521.700846:0:9072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760521.700848:0:9072:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789760521.700851:0:9072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760521.700855:0:9072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760521.700856:0:9072:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760521.700859:0:9072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760521.700860:0:9072:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789760521.700910:0:9072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760521.700914:0:9072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760521.700915:0:9072:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760521.700918:0:9072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789760521.701526:0:9064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789760521.701554:0:9064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789760521.701581:0:9064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.701594:0:9064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760521.701602:0:9064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e4489b2000 from 1 10000000:01000000:1.0:1789760521.701605:0:9064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760521.701636:0:9064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.701655:0:9064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.701666:0:9064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.701689:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079488:0@lo:101: 00000100:00100000:1.0:1789760521.701763:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760521.701869:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798079488 00000100:00100000:0.0:1789760521.701877:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798079488 00000100:00100000:0.0:1789760521.701918:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789760521.701926:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798079488:12345-0@lo:101: 00010000:00010000:0.0:1789760521.701938:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760521.701950:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856add expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760521.701972:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856add expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760521.701982:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856add expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760521.701989:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dc400, rc 0) 00000100:00100000:0.0:1789760521.702023:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798079488:12345-0@lo:101: Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760521.702029:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789760521.702783:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54534f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789760521.702850:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079488:0@lo:101: 00010000:00010000:2.0:1789760521.702867:0:9064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760521.702880:0:9064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760521.702999:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079616:0@lo:501: 00000100:00100000:2.0:1789760521.703046:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760521.703253:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798079616 00000100:00100000:0.0:1789760521.703259:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798079616 00000100:00100000:0.0:1789760521.703289:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789760521.703297:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798079616:12345-0@lo:501: 00000100:00100000:0.0:1789760521.703522:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798079616:12345-0@lo:501: Request processed in 225us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760521.703529:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789760521.703726:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760521.703752:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079616:0@lo:501: 00000100:00100000:2.0:1789760521.703812:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079744:0@lo:503: 00000100:00100000:2.0:1789760521.703851:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760521.703868:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760521.703982:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798079744 00000100:00100000:0.0:1789760521.703986:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798079744 00000100:00100000:0.0:1789760521.705290:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789760521.705306:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798079744:12345-0@lo:503: 00000100:00100000:0.0:1789760521.705655:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798079744:12345-0@lo:503: Request processed in 353us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760521.705663:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789760521.707566:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079744:0@lo:503: 00000040:00080000:3.0:1789760521.707901:0:9064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760521.707973:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079872:0@lo:502: 00000100:00100000:3.0:1789760521.708038:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.710112:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f3a99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.712500:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798079872 00000100:00100000:1.0:1789760521.712513:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798079872 00000100:00100000:1.0:1789760521.712560:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789760521.712570:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798079872:12345-0@lo:502: 00000100:00100000:1.0:1789760521.712879:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798079872:12345-0@lo:502: Request processed in 310us (4840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.712889:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789760521.713014:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798079872:0@lo:502: 00000040:00080000:3.0:1789760521.713540:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789760521.713599:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789760521.713637:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080000:0@lo:502: 00000100:00100000:3.0:1789760521.713683:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.713705:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.713782:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798080000 00000100:00100000:1.0:1789760521.713811:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798080000 00000100:00100000:1.0:1789760521.713836:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789760521.713842:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798080000:12345-0@lo:502: 00000100:00100000:1.0:1789760521.713972:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798080000:12345-0@lo:502: Request processed in 129us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.713980:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789760521.714085:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080000:0@lo:502: 00000040:00080000:3.0:1789760521.714360:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789760521.714369:0:9064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789760521.715152:0:9076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760521.715162:0:9076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760521.715165:0:9076:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789760521.715171:0:9076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e4489b2000 00000020:00000080:3.0:1789760521.715173:0:9076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789760521.715193:0:9076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760521.715197:0:9076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760521.715205:0:9076:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789760521.715208:0:9076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789760521.715393:0:9064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789760521.715480:0:9064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760521.715501:0:9064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760521.715513:0:9064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760521.715557:0:9064:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789760521.715560:0:9064:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e4489b2000 10000000:01000000:0.0:1789760521.715563:0:9064:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e4489b2000 10000000:01000000:0.0:1789760521.715567:0:9064:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760521.715572:0:9064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e4489b2000 from 1 10000000:01000000:0.0:1789760521.715575:0:9064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760521.715604:0:9064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760521.715618:0:9064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760521.715627:0:9064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760521.715646:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080128:0@lo:101: 00000100:00100000:0.0:1789760521.715693:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760521.715727:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.716462:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798080128 00000100:00100000:1.0:1789760521.716469:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798080128 00000100:00100000:1.0:1789760521.716520:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789760521.716528:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9064:x1876699798080128:12345-0@lo:101: 00010000:00010000:1.0:1789760521.716550:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760521.716564:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856aeb expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.716587:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 17 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.716596:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 17 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.716603:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d2000, rc 0) 00000100:00100000:1.0:1789760521.716916:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080128:12345-0@lo:101: Request processed in 260us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.716924:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789760521.717035:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080128:0@lo:101: 00010000:00010000:3.0:1789760521.717053:0:9064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.717062:0:9064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.717161:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080256:0@lo:501: 00000100:00100000:3.0:1789760521.717193:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.717235:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760521.717308:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798080256 00000100:00100000:2.0:1789760521.717313:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798080256 00000100:00100000:2.0:1789760521.717344:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789760521.717351:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080256:12345-0@lo:501: 00000100:00100000:2.0:1789760521.717658:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080256:12345-0@lo:501: Request processed in 307us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760521.717664:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789760521.717892:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080256:0@lo:501: 00000100:00100000:3.0:1789760521.717922:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080384:0@lo:503: 00000100:00100000:3.0:1789760521.717960:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.718028:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786540 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.718104:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798080384 00000100:00100000:1.0:1789760521.718110:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798080384 00000100:00100000:1.0:1789760521.718329:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789760521.718339:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080384:12345-0@lo:503: 00000100:00100000:1.0:1789760521.718594:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080384:12345-0@lo:503: Request processed in 257us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.718622:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080384:0@lo:503: 00000040:00080000:3.0:1789760521.718943:0:9064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760521.719004:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080512:0@lo:502: 00000100:00100000:3.0:1789760521.719039:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.719051:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760521.719108:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798080512 00000100:00100000:2.0:1789760521.719113:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798080512 00000100:00100000:1.0:1789760521.721088:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789760521.721244:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789760521.721259:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080512:12345-0@lo:502: 00000100:00100000:2.0:1789760521.721608:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080512:12345-0@lo:502: Request processed in 352us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760521.721615:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789760521.721692:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080512:0@lo:502: 00000040:00080000:3.0:1789760521.722046:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789760521.722112:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789760521.722147:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789760521.722197:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789760521.722235:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789760521.722296:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789760521.722331:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789760521.722366:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789760521.722428:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789760521.722466:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789760521.722499:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789760521.722545:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789760521.722580:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789760521.722614:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789760521.722661:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789760521.722700:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789760521.722735:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789760521.722852:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789760521.722892:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789760521.722926:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789760521.722973:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789760521.723010:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789760521.723044:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789760521.723092:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789760521.723126:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789760521.723157:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789760521.723199:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789760521.723233:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789760521.723264:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789760521.723309:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789760521.723343:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789760521.723375:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789760521.723407:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789760521.723466:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789760521.723502:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789760521.723547:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789760521.723582:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1789760521.723615:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789760521.723675:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1789760521.723712:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1789760521.723757:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1789760521.723816:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1789760521.723880:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1789760521.723918:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1789760521.723950:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1789760521.723997:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1789760521.724046:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080640:0@lo:502: 00000100:00100000:3.0:1789760521.724137:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.732878:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786540 going to sleep for 11 seconds 00000100:00100000:1.0:1789760521.733512:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798080640 00000100:00100000:1.0:1789760521.733523:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798080640 00000100:00100000:1.0:1789760521.733575:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789760521.733585:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080640:12345-0@lo:502: 00000100:00100000:1.0:1789760521.734073:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798080640:12345-0@lo:502: Request processed in 488us (9935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.734081:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789760521.734627:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798080640:0@lo:502: 00000040:00080000:3.0:1789760521.734765:0:9064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1789760521.734780:0:9064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00010000:00010000:3.0:1789760521.735323:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789760521.736128:0:9077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789760521.736143:0:9077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97e4489cb370) 00000020:00000080:1.0:1789760521.736167:0:9077:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789760521.736307:0:9077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e4489b2000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789760521.736312:0:9077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e4489b2000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789760521.736314:0:9077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e4489b2000 3 00010000:00080000:1.0:1789760521.736344:0:9077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e448585000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1789760521.739359:0:9077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789760521.739651:0:9077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789760521.739709:0:9077:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789760521.739725:0:9077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc2b9a3a739856b00 00000100:00080000:2.0:1789760521.739736:0:9077:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789760521.739751:0:9077:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97e448585000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1789760521.739815:0:9077:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e5434b8e00 x1876699798080768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789760521.739853:0:9077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789760521.740177:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3460:1876699798080768:0@lo:38: 00000100:00100000:0.0:1789760521.740256:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789760521.740406:0:9078:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff97e5434b8a80 x1876699798080896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760521.740417:0:9078:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21f00 going to sleep for 0 seconds 00000100:00100000:3.0:1789760521.742635:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798080768 00000100:00100000:3.0:1789760521.742649:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798080768 00000100:00100000:3.0:1789760521.742703:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760521.742712:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1876699798080768:12345-0@lo:38: 00010000:00080000:3.0:1789760521.742768:0:6465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:3.0:1789760521.742817:0:6465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc2b9a3a739856b07 00000020:01000004:1.0:1789760521.743187:0:9077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789760521.743205:0:9077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff97e4489c8000) 00000020:00000080:1.0:1789760521.743292:0:9077:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1789760521.743388:0:9077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e4489b2000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789760521.743392:0:9077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e4489b2000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789760521.743470:0:9077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e4489b2000 3 00010000:00080000:1.0:1789760521.743501:0:9077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e4410b7000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1789760521.745501:0:9077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1789760521.745783:0:9077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789760521.746091:0:9077:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789760521.746104:0:9077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc2b9a3a739856b15 00000100:00080000:1.0:1789760521.746114:0:9077:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760521.746120:0:9077:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff97e4410b7000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1789760521.746153:0:9077:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e57b1dd500 x1876699798081024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789760521.746190:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3460:1876699798081024:0@lo:38: 00000100:00100000:1.0:1789760521.746332:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789760521.746923:0:9077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789760521.747356:0:6467:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789760521.747366:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00100000:3.0:1789760521.747393:0:6465:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789760521.748109:0:6465:0:(import.c:65:import_set_state_nolock()) ffff97e441fec000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760521.748192:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1876699798080768:12345-0@lo:38: Request processed in 5478us (7934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.748203:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760521.748299:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798081024 00000100:00100000:3.0:1789760521.748313:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798081024 00000100:00100000:3.0:1789760521.748348:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760521.748355:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3460:x1876699798081024:12345-0@lo:38: 00010000:00080000:3.0:1789760521.748377:0:6466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00010000:00080000:1.0:1789760521.748525:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b8e00 x1876699798080768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760521.748536:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760521.748551:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789760521.748559:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789760521.748564:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789760521.748566:0:3460:0:(import.c:65:import_set_state_nolock()) ffff97e448585000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789760521.748573:0:3460:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fdaff1b0): req@ffff97e5434b8a80 x1876699798080896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760521.748592:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3460:1876699798080768:0@lo:38: 00000100:00100000:1.0:1789760521.748665:0:9078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.748686:0:9078:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21f00 going to sleep for 11 seconds 00000020:00000080:3.0:1789760521.748935:0:6466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc2b9a3a739856b1c 00000004:00100000:3.0:1789760521.748947:0:6466:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789760521.748968:0:6466:0:(import.c:65:import_set_state_nolock()) ffff97e441fe8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760521.750185:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1876699798081024:12345-0@lo:38: Request processed in 1822us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.750194:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760521.750245:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798080896 00000100:00100000:3.0:1789760521.750253:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798080896 00000100:00100000:3.0:1789760521.750305:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760521.750313:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9078:x1876699798080896:12345-0@lo:901: 00000100:00100000:3.0:1789760521.750846:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9078:x1876699798080896:12345-0@lo:901: Request processed in 532us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.750853:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789760521.750903:0:9078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b8a80 x1876699798080896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789760537 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760521.750915:0:9078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9078:1876699798080896:0@lo:901: 00000100:00080000:2.0:1789760521.751465:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789760521.751764:0:9077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1789760521.752314:0:9064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789760521.752340:0:9064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760521.752366:0:9064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.752376:0:9064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789760521.752902:0:9064:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789760521.752906:0:9064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789760521.752907:0:9064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760521.752908:0:9064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760521.752909:0:9064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760521.752911:0:9064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760521.752912:0:9064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789760521.752913:0:9064:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760521.752915:0:9064:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760521.752916:0:9064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760521.752917:0:9064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789760521.752920:0:9064:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789760521.752923:0:9064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789760521.752924:0:9064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789760521.752925:0:9064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760521.752926:0:9064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760521.752927:0:9064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760521.752928:0:9064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760521.752929:0:9064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789760521.752931:0:9064:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760521.752932:0:9064:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760521.752933:0:9064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760521.752934:0:9064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789760521.752958:0:9064:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789760521.752973:0:9064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798081152:0@lo:253: 00000100:00100000:3.0:1789760521.753052:0:9064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.753092:0:9064:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e546786540 going to sleep for 11 seconds 00010000:00080000:1.0:1789760521.753367:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dd500 x1876699798081024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760521.753379:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760521.753388:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789760521.753471:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789760521.753477:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789760521.753480:0:3460:0:(import.c:65:import_set_state_nolock()) ffff97e4410b7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789760521.753488:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3460:1876699798081024:0@lo:38: 00000100:00100000:0.0:1789760521.754518:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798081152 00000100:00100000:0.0:1789760521.754527:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798081152 00000100:00100000:0.0:1789760521.754572:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789760521.754580:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9064:x1876699798081152:12345-0@lo:253: 20000000:01000000:0.0:1789760521.754606:0:6460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789760521.754619:0:6460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789760521.789505:0:6460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789760521.789523:0:6460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789760521.789675:0:6481:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789760521.789680:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789760521.789701:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.789720:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 17 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.789728:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.789763:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.789818:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.789905:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 17 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.789919:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798081280:0@lo:104: 00000100:00100000:1.0:1789760521.789979:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760521.790031:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 17 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.790039:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 17 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.790046:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798081408:0@lo:104: 00000100:00100000:1.0:1789760521.790065:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.790087:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e4491013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760521.790319:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798081280 00000100:00100000:3.0:1789760521.790327:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798081280 00000100:00100000:3.0:1789760521.790361:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798081408 00000100:00100000:3.0:1789760521.790364:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798081408 00000100:00100000:3.0:1789760521.790379:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760521.790388:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6481:x1876699798081280:12345-0@lo:104: 00010000:00010000:3.0:1789760521.790411:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790473:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760521.790480:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:6481:x1876699798081280:12345-0@lo:104: Request processed in 93us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.790487:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760521.790504:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760521.790511:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6481:x1876699798081408:12345-0@lo:104: 00010000:00010000:3.0:1789760521.790518:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790551:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789760521.790556:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:6481:x1876699798081408:12345-0@lo:104: Request processed in 46us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.790561:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789760521.790577:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760521.790583:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790591:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c7c00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760521.790595:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790604:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760521.790610:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760521.790615:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760521.790649:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790655:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760521.790671:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790677:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5820c7c00/0xc2b9a3a739856a58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a5f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790689:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760521.790692:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790698:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540031a00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760521.790700:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790706:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760521.790712:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760521.790717:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760521.790728:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790733:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760521.790759:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790775:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e540031a00/0xc2b9a3a739856a12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856a19 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.790808:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760521.790810:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760521.790812:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760521.790818:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760521.790949:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798081664:0@lo:103: 00000100:00100000:3.0:1789760521.790979:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760521.791017:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798081664 00000100:00100000:3.0:1789760521.791021:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798081664 00010000:00010000:3.0:1789760521.791037:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 18 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760521.791057:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760521.791063:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3463:x1876699798081664:12345-0@lo:103: 00010000:00010000:3.0:1789760521.791072:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760521.791077:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 18 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.791085:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 18 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760521.791099:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760521.791125:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3463:x1876699798081664:12345-0@lo:103: Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760521.791130:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760521.791167:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798081664:0@lo:103: 00000100:00100000:1.0:1789760521.791477:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798081536:0@lo:103: 00000100:00100000:1.0:1789760521.791505:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760521.791542:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798081536 00000100:00100000:1.0:1789760521.791546:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798081536 00010000:00010000:1.0:1789760521.791562:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 18 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.791588:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760521.791601:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3462:x1876699798081536:12345-0@lo:103: 00010000:00010000:1.0:1789760521.791609:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760521.791614:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 18 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791623:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 18 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791636:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791644:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760521.791657:0:6450:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008886028s 00010000:00010000:1.0:1789760521.791662:0:6450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791669:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791677:0:6450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791683:0:6450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791689:0:6450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d3e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760521.791693:0:6450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791702:0:6450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791717:0:6450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.791727:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760521.791767:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:3462:x1876699798081536:12345-0@lo:103: Request processed in 167us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760521.791774:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760521.791819:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798081536:0@lo:103: 00010000:00010000:1.0:1789760521.792080:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5820c6e00/0xc2b9a3a739856a5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856a58 expref: 17 pid: 6459 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.792092:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798081280:0@lo:104: 00010000:00010000:1.0:1789760521.792102:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e540030600/0xc2b9a3a739856a19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856a12 expref: 16 pid: 6457 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760521.792111:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6481:1876699798081408:0@lo:104: 00010000:00010000:1.0:1789760521.792124:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.792133:0:6481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.792139:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760521.792146:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5413d3e00/0xc2b9a3a739856b23 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760521.799216:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:9064:x1876699798081152:12345-0@lo:253: Request processed in 44626us (46154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760521.799303:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789760521.799409:0:9064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9064:1876699798081152:0@lo:253: 10000000:01000000:3.0:1789760521.799424:0:9064:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789760521.799427:0:9064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789760521.799428:0:9064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789760521.799429:0:9064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760521.799430:0:9064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760521.799431:0:9064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760521.799432:0:9064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760521.799434:0:9064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789760521.799435:0:9064:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760521.799436:0:9064:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760521.799438:0:9064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760521.799439:0:9064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789760521.799453:0:9064:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789760521.806183:0:9064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760521.806623:0:9064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789760521.807036:0:9064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760521.807455:0:9064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789760521.807671:0:9064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760521.808085:0:9064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789760521.809461:0:9064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789760521.997350:0:9064:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789760521.997358:0:9064:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789760521.997455:0:9064:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789760521.997516:0:9064:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789760521.997530:0:9064:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789760521.997555:0:9064:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789760522.759191:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760523.784013:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760524.810134:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760525.511071:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760525.511095:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798081792:0@lo:41: 00000100:00100000:0.0:1789760525.511168:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760525.511270:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798081792 00000100:00100000:3.0:1789760525.511277:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798081792 00000100:00100000:3.0:1789760525.511338:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789760525.511347:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798081792:12345-0@lo:41: 00000004:00000024:3.0:1789760525.511382:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760525.511429:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798081792:12345-0@lo:41: Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760525.511556:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798081792:0@lo:41: 00000100:00100000:3.0:1789760525.511699:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789760525.832027:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760526.024065:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760526.024089:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798081920:0@lo:41: 00000100:00100000:3.0:1789760526.024157:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760526.024218:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798081920 00000100:00100000:3.0:1789760526.024226:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798081920 00000100:00100000:3.0:1789760526.024269:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789760526.024286:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798081920:12345-0@lo:41: 00000004:00000024:3.0:1789760526.024324:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760526.024382:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798081920:12345-0@lo:41: Request processed in 97us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760526.024389:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789760526.024434:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798081920:0@lo:41: 00000100:00100000:2.0:1789760526.536543:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760526.536582:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798082048:0@lo:13: 00000100:00100000:2.0:1789760526.536736:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760526.536879:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798082048 00000100:00100000:2.0:1789760526.536888:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798082048 00000100:00100000:2.0:1789760526.536940:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760526.536951:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798082048:12345-0@lo:13: 00002000:00000024:2.0:1789760526.537466:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760526.537525:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798082048:12345-0@lo:13: Request processed in 576us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760526.537543:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789760526.537566:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789760526.537593:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b8a80 x1876699798082048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760526.537687:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798082048:0@lo:13: 00000100:00100000:2.0:1789760526.540925:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798082176:0@lo:13: 00000100:00100000:2.0:1789760526.541454:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760526.541704:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798082176 00000100:00100000:3.0:1789760526.541721:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798082176 00000100:00100000:3.0:1789760526.541782:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760526.541808:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798082176:12345-0@lo:13: 00002000:00000024:3.0:1789760526.541831:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760526.541881:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798082176:12345-0@lo:13: Request processed in 75us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760526.541888:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789760526.541906:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760526.541930:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a0a80 x1876699798082176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760526.541950:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798082176:0@lo:13: 00010000:00010000:2.0:1789760526.860211:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760527.047086:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798082688:0@lo:400: 00000100:00100000:1.0:1789760527.047155:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047210:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798083200:0@lo:400: 00000100:00100000:1.0:1789760527.047234:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047263:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789760527.047268:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798082304:0@lo:400: 00000100:00100000:1.0:1789760527.047293:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047309:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798082816:0@lo:400: 00000100:00100000:1.0:1789760527.047331:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047349:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798083328:0@lo:400: 00000100:00100000:1.0:1789760527.047369:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047393:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798082432:0@lo:400: 00000100:00100000:1.0:1789760527.047413:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047428:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798082944:0@lo:400: 00000100:00100000:1.0:1789760527.047460:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047478:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798083456:0@lo:400: 00000100:00100000:1.0:1789760527.047499:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047520:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789760527.047526:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798082560:0@lo:400: 00000100:00100000:1.0:1789760527.047557:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047575:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798083072:0@lo:400: 00000100:00100000:1.0:1789760527.047593:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047602:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798083584:0@lo:400: 00000100:00100000:1.0:1789760527.047620:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760527.047644:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798082688 00000100:00100000:1.0:1789760527.047650:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798082688 00000100:00100000:1.0:1789760527.047684:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798082432 00000100:00100000:1.0:1789760527.047687:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798082432 00000100:00100000:1.0:1789760527.047698:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798082944 00000100:00100000:1.0:1789760527.047700:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798082944 00000100:00100000:1.0:1789760527.047737:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798083456 00000100:00100000:1.0:1789760527.047740:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798083456 00000100:00100000:1.0:1789760527.047755:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798083072 00000100:00100000:1.0:1789760527.047757:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798083072 00000100:00100000:1.0:1789760527.047767:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798083584 00000100:00100000:1.0:1789760527.047769:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798083584 00000100:00100000:1.0:1789760527.047783:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760527.047808:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798082688:12345-0@lo:400: 00000100:00100000:1.0:1789760527.047860:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798082688:12345-0@lo:400: Request processed in 53us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.047867:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760527.047883:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789760527.047889:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798082432:12345-0@lo:400: 00000100:00100000:1.0:1789760527.047919:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798082432:12345-0@lo:400: Request processed in 31us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.047924:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789760527.047935:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789760527.047940:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798082944:12345-0@lo:400: 00000100:00100000:1.0:1789760527.047975:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798082944:12345-0@lo:400: Request processed in 35us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.047981:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789760527.047993:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789760527.048000:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798083456:12345-0@lo:400: 00000100:00100000:1.0:1789760527.048023:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798083456:12345-0@lo:400: Request processed in 24us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.048028:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789760527.048038:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789760527.048043:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798083072:12345-0@lo:400: 00000100:00100000:1.0:1789760527.048066:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798083072:12345-0@lo:400: Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.048071:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789760527.048082:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760527.048087:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798083584:12345-0@lo:400: 00000100:00100000:1.0:1789760527.048109:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798083584:12345-0@lo:400: Request processed in 23us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.048114:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760527.048132:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798083200 00000100:00100000:1.0:1789760527.048135:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798083200 00000100:00100000:1.0:1789760527.048156:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798083328 00000100:00100000:1.0:1789760527.048158:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798083328 00000100:00100000:1.0:1789760527.048171:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760527.048175:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798083200:12345-0@lo:400: 00000100:00100000:1.0:1789760527.048201:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798083200:12345-0@lo:400: Request processed in 25us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.048216:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760527.048227:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760527.048233:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798083328:12345-0@lo:400: 00000100:00100000:1.0:1789760527.048262:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798083328:12345-0@lo:400: Request processed in 29us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.048267:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760527.048284:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798082816 00000100:00100000:1.0:1789760527.048287:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798082816 00000100:00100000:1.0:1789760527.048309:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798082560 00000100:00100000:1.0:1789760527.048312:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798082560 00000100:00100000:1.0:1789760527.048323:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789760527.048328:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798082816:12345-0@lo:400: 00000100:00100000:1.0:1789760527.048357:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798082816:12345-0@lo:400: Request processed in 29us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.048362:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789760527.048374:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760527.048379:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798082560:12345-0@lo:400: 00000100:00100000:1.0:1789760527.048405:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798082560:12345-0@lo:400: Request processed in 26us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760527.048411:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789760527.048438:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760527.048442:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760527.048473:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798082560:0@lo:400: 00010000:00080000:1.0:1789760527.048487:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dd500 x1876699798083072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760527.048496:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798083072:0@lo:400: 00010000:00080000:1.0:1789760527.048514:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433dd180 x1876699798083584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760527.048523:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798083584:0@lo:400: 00010000:00080000:1.0:1789760527.048532:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f88e680 x1876699798082432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760527.048540:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798082432:0@lo:400: 00010000:00080000:1.0:1789760527.048549:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f88ca80 x1876699798082944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760527.048556:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798082944:0@lo:400: 00010000:00080000:1.0:1789760527.048565:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433ded80 x1876699798083456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760527.048571:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798083456:0@lo:400: 00000100:00100000:1.0:1789760527.048612:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798082816:0@lo:400: 00010000:00080000:1.0:1789760527.048622:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433df100 x1876699798083328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760527.048630:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798083328:0@lo:400: 00010000:00080000:1.0:1789760527.048639:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f88f100 x1876699798082688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760527.048646:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798082688:0@lo:400: 00010000:00080000:1.0:1789760527.048654:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433dc380 x1876699798083200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760527.048661:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798083200:0@lo:400: 00000100:00100000:2.0:1789760527.049622:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798082304 00000100:00100000:2.0:1789760527.049631:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798082304 00000100:00100000:2.0:1789760527.049675:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789760527.049682:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:3463:x1876699798082304:12345-0@lo:400: 00000100:00100000:2.0:1789760527.049752:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:3463:x1876699798082304:12345-0@lo:400: Request processed in 70us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760527.049758:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789760527.049848:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798082304:0@lo:400: 00000001:02000400:3.0:1789760527.356950:0:9422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789760527.878961:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760528.906011:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789760529.606913:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760529.606920:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e44128d800 from 39 10000000:01000000:3.0:1789760529.606926:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760529.606989:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.607000:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.607025:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760529.607048:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798083712:0@lo:101: 00000100:00100000:3.0:1789760529.607295:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.607359:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760529.607846:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798083712 00000100:00100000:2.0:1789760529.607854:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798083712 00000100:00100000:2.0:1789760529.607913:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789760529.607924:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798083712:12345-0@lo:101: 00010000:00010000:2.0:1789760529.607946:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760529.608327:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856b2a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.608356:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.608378:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 16 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.608387:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8f600, rc 0) 00000100:00100000:2.0:1789760529.608458:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798083712:12345-0@lo:101: Request processed in 535us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.608464:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789760529.608505:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798083712:0@lo:101: 00010000:00010000:0.0:1789760529.608523:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760529.608545:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760529.608608:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798083840:0@lo:501: 00000100:00100000:0.0:1789760529.615906:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.616036:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448cebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760529.624870:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798083840 00000100:00100000:2.0:1789760529.624885:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798083840 00000100:00100000:2.0:1789760529.624948:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789760529.624957:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798083840:12345-0@lo:501: 00000100:00100000:2.0:1789760529.625369:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798083840:12345-0@lo:501: Request processed in 412us (9469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.625377:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789760529.625535:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798083840:0@lo:501: 00000100:00100000:0.0:1789760529.625577:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798083968:0@lo:503: 00000100:00100000:0.0:1789760529.625618:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.625648:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448cebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760529.625655:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798083968 00000100:00100000:3.0:1789760529.625662:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798083968 00000100:00100000:3.0:1789760529.625701:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789760529.625708:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798083968:12345-0@lo:503: 00000100:00100000:3.0:1789760529.626154:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798083968:12345-0@lo:503: Request processed in 445us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760529.626162:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789760529.626171:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798083968:0@lo:503: 00000100:00100000:1.0:1789760529.636966:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9527:1876699798084096:0@lo:502: 00000100:00100000:1.0:1789760529.637071:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.637117:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449101180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.637252:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798084096 00000100:00100000:0.0:1789760529.637260:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798084096 00000100:00100000:0.0:1789760529.637309:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789760529.637318:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9527:x1876699798084096:12345-0@lo:502: 00000100:00100000:0.0:1789760529.637661:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9527:x1876699798084096:12345-0@lo:502: Request processed in 343us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.637669:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789760529.637957:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9527:1876699798084096:0@lo:502: 00000100:00100000:1.0:1789760529.638020:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9527:1876699798084224:0@lo:502: 00000100:00100000:1.0:1789760529.638071:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.638100:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449101180 going to sleep for 11 seconds 00000100:00100000:3.0:1789760529.638259:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798084224 00000100:00100000:3.0:1789760529.638266:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798084224 00000100:00100000:3.0:1789760529.638304:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789760529.638312:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9527:x1876699798084224:12345-0@lo:502: 00000100:00100000:3.0:1789760529.638493:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9527:x1876699798084224:12345-0@lo:502: Request processed in 181us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760529.638500:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789760529.638764:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9527:1876699798084224:0@lo:502: 00000040:00080000:1.0:1789760529.638815:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789760529.639546:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789760529.639644:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760529.639655:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.639667:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760529.639700:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789760529.639702:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789760529.639705:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789760529.639733:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.639740:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.639749:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760529.639767:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798084352:0@lo:101: 00000100:00100000:3.0:1789760529.639843:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.639889:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54534f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760529.640120:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798084352 00000100:00100000:2.0:1789760529.640129:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798084352 00000100:00100000:2.0:1789760529.640217:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789760529.640227:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798084352:12345-0@lo:101: 00010000:00010000:2.0:1789760529.640239:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760529.640251:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856b38 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.640271:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 17 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.640282:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 17 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.640301:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e800, rc 0) 00000100:00100000:2.0:1789760529.640347:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798084352:12345-0@lo:101: Request processed in 122us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.640353:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789760529.640425:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798084352:0@lo:101: 00010000:00010000:3.0:1789760529.640450:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.640460:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760529.640509:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798084480:0@lo:501: 00000100:00100000:3.0:1789760529.640538:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.646584:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54534f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.646893:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798084480 00000100:00100000:0.0:1789760529.646903:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798084480 00000100:00100000:0.0:1789760529.646989:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789760529.646999:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798084480:12345-0@lo:501: 00000100:00100000:0.0:1789760529.647291:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798084480:12345-0@lo:501: Request processed in 293us (6751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.647298:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789760529.647753:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798084480:0@lo:501: 00000100:00100000:3.0:1789760529.647820:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798084608:0@lo:503: 00000100:00100000:3.0:1789760529.647873:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.647908:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54534f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.650343:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798084608 00000100:00100000:0.0:1789760529.650357:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798084608 00000100:00100000:0.0:1789760529.650423:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789760529.650432:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798084608:12345-0@lo:503: 00000100:00100000:0.0:1789760529.651314:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798084608:12345-0@lo:503: Request processed in 879us (3436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.651323:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789760529.655422:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798084608:0@lo:503: 00000100:00100000:0.0:1789760529.656414:0:9528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9528:1876699798084736:0@lo:502: 00000100:00100000:0.0:1789760529.656626:0:9528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.656723:0:9528:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448cebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760529.660515:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798084736 00000100:00100000:2.0:1789760529.660529:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798084736 00000100:00100000:3.0:1789760529.660891:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789760529.660903:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9528:x1876699798084736:12345-0@lo:502: 00000100:00100000:3.0:1789760529.661470:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9528:x1876699798084736:12345-0@lo:502: Request processed in 568us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760529.661478:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789760529.661768:0:9528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9528:1876699798084736:0@lo:502: 00000020:01000000:1.0:1789760529.662158:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760529.662168:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760529.662170:0:9528:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760529.662176:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760529.662178:0:9528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789760529.662210:0:9528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9528:1876699798084864:0@lo:502: 00000100:00100000:1.0:1789760529.662265:0:9528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.663102:0:9528:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449101180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.666989:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798084864 00000100:00100000:0.0:1789760529.667005:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798084864 00000100:00100000:2.0:1789760529.667172:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789760529.667184:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9528:x1876699798084864:12345-0@lo:502: 00000100:00100000:2.0:1789760529.667457:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9528:x1876699798084864:12345-0@lo:502: Request processed in 275us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.667465:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789760529.668567:0:9528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9528:1876699798084864:0@lo:502: 00000020:01000000:1.0:1789760529.668607:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760529.668615:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760529.668617:0:9528:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760529.668622:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789760529.669090:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789760529.669111:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789760529.669120:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.669130:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760529.669140:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789760529.669143:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e544828000 from 39 10000000:01000000:2.0:1789760529.669146:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789760529.669180:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.669187:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.669209:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760529.669231:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798084992:0@lo:101: 00000100:00100000:2.0:1789760529.669282:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.669323:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.673224:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798084992 00000100:00100000:1.0:1789760529.673239:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798084992 00000100:00100000:1.0:1789760529.673288:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760529.673297:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798084992:12345-0@lo:101: 00010000:00010000:1.0:1789760529.673327:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760529.673344:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856b46 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.673371:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 18 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.673382:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 18 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.673390:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d2200, rc 0) 00000100:00100000:1.0:1789760529.673471:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798084992:12345-0@lo:101: Request processed in 175us (4187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.673477:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789760529.673860:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798084992:0@lo:101: 00010000:00010000:2.0:1789760529.673878:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.673888:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760529.673954:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085120:0@lo:501: 00000100:00100000:2.0:1789760529.674002:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.674032:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.674235:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798085120 00000100:00100000:1.0:1789760529.674241:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798085120 00000100:00100000:1.0:1789760529.674483:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760529.674492:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798085120:12345-0@lo:501: 00000100:00100000:1.0:1789760529.674773:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798085120:12345-0@lo:501: Request processed in 282us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.674780:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789760529.675504:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085120:0@lo:501: 00000100:00100000:2.0:1789760529.675544:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085248:0@lo:503: 00000100:00100000:2.0:1789760529.675604:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.675637:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.676165:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798085248 00000100:00100000:1.0:1789760529.676172:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798085248 00000100:00100000:1.0:1789760529.676207:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789760529.676215:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798085248:12345-0@lo:503: 00000100:00100000:1.0:1789760529.676380:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798085248:12345-0@lo:503: Request processed in 166us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.676387:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789760529.676888:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085248:0@lo:503: 00000100:00100000:3.0:1789760529.679944:0:9529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9529:1876699798085376:0@lo:502: 00000100:00100000:3.0:1789760529.680107:0:9529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.680290:0:9529:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54329d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.681291:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798085376 00000100:00100000:0.0:1789760529.681302:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798085376 00000100:00100000:0.0:1789760529.681359:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789760529.681369:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9529:x1876699798085376:12345-0@lo:502: 00000100:00100000:0.0:1789760529.681672:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9529:x1876699798085376:12345-0@lo:502: Request processed in 304us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.681680:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789760529.681766:0:9529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9529:1876699798085376:0@lo:502: 00000100:00100000:3.0:1789760529.681869:0:9529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9529:1876699798085504:0@lo:502: 00000100:00100000:3.0:1789760529.681919:0:9529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.681947:0:9529:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467df600 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.682306:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798085504 00000100:00100000:1.0:1789760529.682312:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798085504 00000100:00100000:1.0:1789760529.682349:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789760529.682357:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9529:x1876699798085504:12345-0@lo:502: 00000100:00100000:1.0:1789760529.682532:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9529:x1876699798085504:12345-0@lo:502: Request processed in 176us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.682539:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789760529.682720:0:9529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9529:1876699798085504:0@lo:502: 00000040:00080000:0.0:1789760529.682757:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789760529.683232:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789760529.683252:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760529.683260:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.683271:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760529.683279:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789760529.683281:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e544828000 from 6 10000000:01000000:1.0:1789760529.683284:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789760529.683311:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.683319:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.683328:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856b54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760529.683343:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085632:0@lo:101: 00000100:00100000:1.0:1789760529.683380:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.683410:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449101a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.683888:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798085632 00000100:00100000:0.0:1789760529.683895:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798085632 00000100:00100000:0.0:1789760529.683932:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789760529.683941:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798085632:12345-0@lo:101: 00010000:00010000:0.0:1789760529.683952:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760529.683966:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dd600/0xc2b9a3a739856b5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856b54 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760529.683996:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dd600/0xc2b9a3a739856b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856b54 expref: 19 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760529.684006:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dd600/0xc2b9a3a739856b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b54 expref: 19 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760529.684016:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dd600, rc 0) 00000100:00100000:0.0:1789760529.684069:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798085632:12345-0@lo:101: Request processed in 128us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.684074:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789760529.684192:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085632:0@lo:101: 00010000:00010000:2.0:1789760529.684206:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856b54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b5b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.684226:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856b54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856b5b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760529.684273:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085760:0@lo:256: 00000100:00100000:2.0:1789760529.684305:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.684336:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760529.684475:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798085760 00000100:00100000:3.0:1789760529.684480:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798085760 00000100:00100000:3.0:1789760529.684520:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789760529.684528:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798085760:12345-0@lo:256: 20000000:01000000:3.0:1789760529.684541:0:6457:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789760529.685422:0:6457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789760529.685427:0:6457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789760529.685534:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798085760:12345-0@lo:256: Request processed in 1005us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760529.685543:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789760529.687209:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085760:0@lo:256: 10000000:01000000:2.0:1789760529.687273:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789760529.687283:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856b54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b5b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.687294:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5413d3e00/0xc2b9a3a739856b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b5b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760529.687304:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789760529.687306:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1789760529.687309:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789760529.687338:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.687346:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.687355:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760529.687373:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085888:0@lo:101: 00000100:00100000:2.0:1789760529.687430:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.687466:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760529.687526:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798085888 00000100:00100000:3.0:1789760529.687539:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798085888 00000100:00100000:3.0:1789760529.688302:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789760529.688316:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798085888:12345-0@lo:101: 00010000:00010000:3.0:1789760529.688329:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760529.688343:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856b62 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.688366:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 20 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.688378:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 20 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.688385:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541483000, rc 0) 00000100:00100000:3.0:1789760529.688433:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798085888:12345-0@lo:101: Request processed in 122us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760529.688439:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789760529.689364:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798085888:0@lo:101: 00010000:00010000:2.0:1789760529.689383:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.689392:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760529.689472:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798086016:0@lo:501: 00000100:00100000:2.0:1789760529.689509:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.689532:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760529.690198:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798086016 00000100:00100000:3.0:1789760529.690206:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798086016 00000100:00100000:3.0:1789760529.690250:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789760529.690259:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798086016:12345-0@lo:501: 00000100:00100000:3.0:1789760529.690528:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798086016:12345-0@lo:501: Request processed in 270us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760529.690536:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789760529.691205:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798086016:0@lo:501: 00000100:00100000:2.0:1789760529.691250:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798086144:0@lo:503: 00000100:00100000:2.0:1789760529.691297:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.691334:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.691648:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798086144 00000100:00100000:1.0:1789760529.691654:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798086144 00000100:00100000:1.0:1789760529.691704:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789760529.691713:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798086144:12345-0@lo:503: 00000100:00100000:1.0:1789760529.693662:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798086144:12345-0@lo:503: Request processed in 1943us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.693673:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789760529.694115:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798086144:0@lo:503: 00000100:00100000:2.0:1789760529.694572:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9530:1876699798086272:0@lo:502: 00000100:00100000:2.0:1789760529.694632:0:9530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.694670:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f070300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.694814:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798086272 00000100:00100000:0.0:1789760529.694821:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798086272 00000100:00100000:0.0:1789760529.694866:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789760529.694875:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:9530:x1876699798086272:12345-0@lo:502: 00000100:00100000:0.0:1789760529.695347:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:9530:x1876699798086272:12345-0@lo:502: Request processed in 472us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.695355:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789760529.695530:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9530:1876699798086272:0@lo:502: 00000020:01000000:2.0:1789760529.695567:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789760529.695574:0:9530:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1789760529.695581:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760529.695583:0:9530:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789760529.695589:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789760529.695599:0:9530:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:2.0:1789760529.695621:0:9530:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789760529.695623:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789760529.695636:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff97e448a90000) 00000020:00000080:2.0:1789760529.695657:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789760529.695661:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789760529.695922:0:9530:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789760529.695929:0:9530:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789760529.695936:0:9530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc2b9a3a739856b77 00010000:00080000:2.0:1789760529.695968:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e544997800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1789760529.696399:0:9530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789760529.697415:0:9530:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789760529.697428:0:9530:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789760529.699665:0:9530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789760529.701677:0:9530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789760529.701755:0:9530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789760529.701852:0:9530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:3.0:1789760529.704997:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789760529.705011:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789760529.705048:0:9530:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000040:00080000:2.0:1789760529.705448:0:9531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789760529.705453:0:9531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789760529.705914:0:9530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc2b9a3a739856b7e 00000100:00080000:3.0:1789760529.705925:0:9530:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760529.705938:0:9530:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97e544997800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1789760529.706656:0:9530:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e449749f80 x1876699798086400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789760529.706731:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3460:1876699798086400:0@lo:8: 00000100:00100000:1.0:1789760529.706823:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.706917:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798086400 00000100:00100000:2.0:1789760529.706924:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798086400 00000100:00100000:2.0:1789760529.706969:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760529.706977:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3460:x1876699798086400:12345-0@lo:8: 00010000:00080000:2.0:1789760529.707011:0:8112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1789760529.707039:0:8112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc2b9a3a739856b85 00002000:00100000:2.0:1789760529.707052:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff97e543263800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789760529.707056:0:8112:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1789760529.707069:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789760529.707179:0:8112:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789760529.707330:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789760529.707353:0:8112:0:(import.c:65:import_set_state_nolock()) ffff97e543260000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789760529.707882:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789760529.707963:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760529.707970:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760529.707972:0:9530:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789760529.707975:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760529.707979:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760529.707981:0:9530:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789760529.707984:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760529.707986:0:9530:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789760529.708016:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9530:1876699798086528:0@lo:502: 00000100:00100000:3.0:1789760529.708083:0:9530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.708114:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.708292:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798086784:0@lo:400: 00000100:00100000:0.0:1789760529.708325:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708345:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798087296:0@lo:400: 00000100:00100000:0.0:1789760529.708370:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708385:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798087808:0@lo:400: 00000100:00100000:0.0:1789760529.708406:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708432:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789760529.708437:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798086656:0@lo:400: 00000100:00100000:0.0:1789760529.708459:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708485:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798087168:0@lo:400: 00000100:00100000:0.0:1789760529.708508:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708525:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798087680:0@lo:400: 00000100:00100000:0.0:1789760529.708545:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708565:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798086912:0@lo:400: 00000100:00100000:0.0:1789760529.708586:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708597:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798087424:0@lo:400: 00000100:00100000:0.0:1789760529.708617:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708636:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789760529.708642:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798087040:0@lo:400: 00000100:00100000:0.0:1789760529.708661:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708678:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798087552:0@lo:400: 00000100:00100000:0.0:1789760529.708714:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760529.708742:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798086784 00000100:00100000:0.0:1789760529.708748:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798086784 00000100:00100000:0.0:1789760529.708781:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798087040 00000100:00100000:0.0:1789760529.708785:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798087040 00000100:00100000:0.0:1789760529.708823:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760529.708831:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798086784:12345-0@lo:400: 00000100:00100000:0.0:1789760529.708876:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798086784:12345-0@lo:400: Request processed in 46us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.708884:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760529.708900:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789760529.708906:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798087040:12345-0@lo:400: 00000100:00100000:0.0:1789760529.708936:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798087040:12345-0@lo:400: Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.708952:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789760529.708976:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798087296 00000100:00100000:0.0:1789760529.708980:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798087296 00000100:00100000:0.0:1789760529.709008:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798087808 00000100:00100000:0.0:1789760529.709010:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798087808 00000100:00100000:0.0:1789760529.709023:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798086656 00000100:00100000:0.0:1789760529.709025:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798086656 00000100:00100000:0.0:1789760529.709036:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798087168 00000100:00100000:0.0:1789760529.709038:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798087168 00000100:00100000:0.0:1789760529.709049:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798087680 00000100:00100000:0.0:1789760529.709052:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798087680 00000100:00100000:0.0:1789760529.709063:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798086912 00000100:00100000:0.0:1789760529.709066:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798086912 00000100:00100000:0.0:1789760529.709079:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760529.709085:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798087296:12345-0@lo:400: 00000100:00100000:0.0:1789760529.709116:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798087296:12345-0@lo:400: Request processed in 31us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.709122:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760529.709134:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789760529.709141:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798087808:12345-0@lo:400: 00000100:00100000:0.0:1789760529.709166:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798087808:12345-0@lo:400: Request processed in 26us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.709172:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789760529.709182:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789760529.709188:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798086656:12345-0@lo:400: 00000100:00100000:0.0:1789760529.709214:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798086656:12345-0@lo:400: Request processed in 26us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.709219:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789760529.709238:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760529.709244:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798087168:12345-0@lo:400: 00000100:00100000:0.0:1789760529.709272:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798087168:12345-0@lo:400: Request processed in 28us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.709277:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760529.709288:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789760529.709293:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798087680:12345-0@lo:400: 00000100:00100000:0.0:1789760529.709318:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798087680:12345-0@lo:400: Request processed in 25us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.709323:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789760529.709332:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789760529.709338:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798086912:12345-0@lo:400: 00000100:00100000:0.0:1789760529.709361:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798086912:12345-0@lo:400: Request processed in 24us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.709366:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789760529.709396:0:8110:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789760529.709402:0:8110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1789760529.709421:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760529.709424:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760529.709430:0:8114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789760529.709435:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798087424 00000100:00100000:0.0:1789760529.709438:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798087424 00000100:00100000:0.0:1789760529.709457:0:8114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789760529.709461:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798087552 00000100:00100000:0.0:1789760529.709463:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798087552 00000100:00100000:0.0:1789760529.709472:0:8114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789760529.709477:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760529.709481:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798087424:12345-0@lo:400: 00000100:00100000:0.0:1789760529.709512:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798087424:12345-0@lo:400: Request processed in 30us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.709524:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760529.709535:0:8114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789760529.709541:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760529.709546:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798087552:12345-0@lo:400: 00000100:00100000:0.0:1789760529.709573:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798087552:12345-0@lo:400: Request processed in 27us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.709578:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789760529.709592:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760529.709624:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798087040:0@lo:400: 00010000:00080000:0.0:1789760529.709637:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac16a00 x1876699798087552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.709647:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798087552:0@lo:400: 00010000:00080000:0.0:1789760529.709675:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac16300 x1876699798086912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.709696:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798086912:0@lo:400: 00010000:00080000:0.0:1789760529.709709:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac17480 x1876699798087424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.709718:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798087424:0@lo:400: 00010000:00080000:0.0:1789760529.709751:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a1c00 x1876699798086656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.709759:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798086656:0@lo:400: 00010000:00080000:0.0:1789760529.709768:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac14000 x1876699798087168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.709821:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798087168:0@lo:400: 00010000:00080000:0.0:1789760529.709837:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac14a80 x1876699798087680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.709843:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798087680:0@lo:400: 00000100:00100000:0.0:1789760529.709851:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798086784:0@lo:400: 00010000:00080000:0.0:1789760529.709859:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac15500 x1876699798087296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.709865:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798087296:0@lo:400: 00010000:00080000:0.0:1789760529.709872:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac17100 x1876699798087808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.709879:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798087808:0@lo:400: 00000100:00100000:2.0:1789760529.716843:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3460:x1876699798086400:12345-0@lo:8: Request processed in 9857us (10010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.716857:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760529.721183:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798086528 00000100:00100000:2.0:1789760529.721194:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798086528 00010000:00080000:1.0:1789760529.721267:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449749f80 x1876699798086400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760529.721280:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760529.721290:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789760529.721298:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789760529.721303:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789760529.721306:0:3460:0:(import.c:65:import_set_state_nolock()) ffff97e544997800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789760529.721329:0:3460:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789760529.721334:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3460:1876699798086400:0@lo:8: 00000100:00100000:2.0:1789760529.721394:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789760529.721404:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:9530:x1876699798086528:12345-0@lo:502: 00000100:00100000:2.0:1789760529.721814:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:9530:x1876699798086528:12345-0@lo:502: Request processed in 410us (13729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.721821:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789760529.721898:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9530:1876699798086528:0@lo:502: 00000020:01000000:1.0:1789760529.721924:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760529.721930:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760529.721932:0:9530:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760529.721937:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1789760529.722010:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1789760529.722026:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789760529.722037:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.722065:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760529.722075:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789760529.722078:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e546616000 from 39 10000000:01000000:1.0:1789760529.722080:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760529.722109:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.722116:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.722125:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760529.722139:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798087936:0@lo:101: 00000100:00100000:1.0:1789760529.722177:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.722237:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9532:1876699798088064:0@lo:700: 00000100:00100000:3.0:1789760529.722265:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.722291:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798088064 00000100:00100000:3.0:1789760529.722295:0:8122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798088064 00000100:00100000:3.0:1789760529.722328:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760529.722334:0:8122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9532:x1876699798088064:12345-0@lo:700: 00000100:00100000:3.0:1789760529.722359:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8122:1876699798088192:0@lo:700: 00000100:00100000:3.0:1789760529.722382:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.722397:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113f0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789760529.722408:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760529.722417:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.731863:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449101d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.731893:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798088192 00000100:00100000:1.0:1789760529.731902:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798088192 00000100:00100000:1.0:1789760529.731972:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760529.731982:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8122:x1876699798088192:12345-0@lo:700: 00000100:00100000:0.0:1789760529.742627:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798087936 00000100:00100000:0.0:1789760529.742642:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798087936 00000100:00100000:0.0:1789760529.743827:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789760529.743838:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798087936:12345-0@lo:101: 00010000:00010000:0.0:1789760529.743854:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760529.743870:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856b8c expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760529.743894:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 21 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760529.743906:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 21 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760529.743928:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dc800, rc 0) 00000100:00100000:0.0:1789760529.744004:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798087936:12345-0@lo:101: Request processed in 168us (21826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.744010:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789760529.745487:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798087936:0@lo:101: 00010000:00010000:1.0:1789760529.745510:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.745521:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760529.745615:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798088320:0@lo:501: 00000100:00100000:1.0:1789760529.745672:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.745719:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54bbaccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.745749:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798088320 00000100:00100000:1.0:1789760529.745755:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798088320 00000100:00100000:1.0:1789760529.745784:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789760529.745810:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798088320:12345-0@lo:501: 00000100:00100000:1.0:1789760529.746380:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798088320:12345-0@lo:501: Request processed in 572us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.746389:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789760529.746422:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798088320:0@lo:501: 00000100:00100000:1.0:1789760529.746466:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798088448:0@lo:503: 00000100:00100000:1.0:1789760529.746509:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.746518:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e54bbaccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.746535:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798088448 00000100:00100000:1.0:1789760529.746539:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798088448 00000100:00100000:1.0:1789760529.746570:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789760529.746577:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798088448:12345-0@lo:503: 00000100:00100000:1.0:1789760529.746725:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798088448:12345-0@lo:503: Request processed in 148us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.746731:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789760529.748165:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798088448:0@lo:503: 00000100:00100000:1.0:1789760529.748426:0:9534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9534:1876699798088576:0@lo:502: 00000004:00080000:2.0:1789760529.750699:0:9531:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789760529.751819:0:9534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.751868:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798088576 00000100:00100000:1.0:1789760529.751878:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798088576 00000100:00100000:1.0:1789760529.751920:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789760529.751929:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9534:x1876699798088576:12345-0@lo:502: 00000100:00100000:1.0:1789760529.752161:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9534:x1876699798088576:12345-0@lo:502: Request processed in 232us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.752169:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789760529.752215:0:9534:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.752235:0:9534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9534:1876699798088576:0@lo:502: 00000100:00100000:1.0:1789760529.752302:0:9534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9534:1876699798088704:0@lo:502: 00000100:00100000:1.0:1789760529.752336:0:9534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.752356:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798088704 00000100:00100000:1.0:1789760529.752359:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798088704 00000100:00100000:1.0:1789760529.752377:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789760529.752383:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9534:x1876699798088704:12345-0@lo:502: 00000100:00100000:1.0:1789760529.752503:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9534:x1876699798088704:12345-0@lo:502: Request processed in 119us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.752509:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789760529.752536:0:9534:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.752546:0:9534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9534:1876699798088704:0@lo:502: 00000040:00080000:1.0:1789760529.752565:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789760529.752621:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789760529.752639:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760529.752649:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.752659:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760529.752674:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789760529.752677:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e546616000 from 6 10000000:01000000:1.0:1789760529.752680:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000004:00080000:2.0:1789760529.752714:0:9531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 205936924563ns, next at 0ns, rc = 0 00010000:00010000:1.0:1789760529.752716:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3200/0xc2b9a3a739856b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.752728:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5413d3200/0xc2b9a3a739856b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.752735:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5413d3200/0xc2b9a3a739856b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760529.752747:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798088832:0@lo:101: 00000100:00100000:1.0:1789760529.752777:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.752816:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.752828:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798088832 00000100:00100000:1.0:1789760529.752831:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798088832 00000100:00100000:1.0:1789760529.752848:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789760529.752855:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798088832:12345-0@lo:101: 00010000:00010000:1.0:1789760529.752863:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760529.752873:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856ba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856b9a expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.752891:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856b9a expref: 22 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.752901:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5413d3800/0xc2b9a3a739856ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b9a expref: 22 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.752919:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d3800, rc 0) 00000100:00100000:1.0:1789760529.752948:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798088832:12345-0@lo:101: Request processed in 94us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.752954:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789760529.752977:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798088832:0@lo:101: 00010000:00010000:1.0:1789760529.752987:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5413d3200/0xc2b9a3a739856b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ba1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.752996:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3200/0xc2b9a3a739856b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856ba1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760529.753036:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798088960:0@lo:256: 00000100:00100000:1.0:1789760529.753064:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.753072:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.753087:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798088960 00000100:00100000:1.0:1789760529.753090:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798088960 00000100:00100000:1.0:1789760529.753105:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789760529.753111:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798088960:12345-0@lo:256: 20000000:01000000:1.0:1789760529.753122:0:6459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789760529.753139:0:6459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789760529.753142:0:6459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789760529.753226:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798088960:12345-0@lo:256: Request processed in 114us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.753233:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789760529.753258:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798088960:0@lo:256: 10000000:01000000:1.0:1789760529.753300:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789760529.753310:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3200/0xc2b9a3a739856b9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ba1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.753316:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5413d3200/0xc2b9a3a739856b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ba1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760529.753322:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789760529.753324:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789760529.753327:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789760529.753352:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.753360:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.753367:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760529.753379:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089088:0@lo:101: 00000100:00100000:1.0:1789760529.753404:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.753434:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.753451:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798089088 00000100:00100000:1.0:1789760529.753454:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798089088 00000100:00100000:1.0:1789760529.753470:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789760529.753475:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798089088:12345-0@lo:101: 00010000:00010000:1.0:1789760529.753481:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760529.753489:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856ba8 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.753503:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.753520:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760529.753527:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8e400, rc 0) 00000100:00100000:1.0:1789760529.753566:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798089088:12345-0@lo:101: Request processed in 91us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.753572:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789760529.753669:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089088:0@lo:101: 00010000:00010000:2.0:1789760529.753694:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.753704:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760529.753901:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089216:0@lo:501: 00000100:00100000:2.0:1789760529.753948:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760529.753972:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f070600 going to sleep for 11 seconds 00000100:00100000:3.0:1789760529.758046:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798089216 00000100:00100000:3.0:1789760529.758070:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798089216 00000100:00100000:2.0:1789760529.758196:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789760529.758207:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798089216:12345-0@lo:501: 00000100:00100000:2.0:1789760529.759211:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798089216:12345-0@lo:501: Request processed in 1003us (5259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.759227:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789760529.759831:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089216:0@lo:501: 00000100:00100000:3.0:1789760529.759890:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089344:0@lo:503: 00000100:00100000:3.0:1789760529.759950:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.759988:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760529.760116:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798089344 00000100:00100000:2.0:1789760529.760123:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798089344 00000100:00100000:2.0:1789760529.760153:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789760529.760162:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798089344:12345-0@lo:503: 00000100:00100000:2.0:1789760529.761671:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798089344:12345-0@lo:503: Request processed in 1505us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.761694:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789760529.762849:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089344:0@lo:503: 00000100:00100000:3.0:1789760529.763347:0:9535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9535:1876699798089472:0@lo:502: 00000100:00100000:3.0:1789760529.763434:0:9535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.763472:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760529.763491:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798089472 00000100:00100000:3.0:1789760529.763496:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798089472 00000100:00100000:3.0:1789760529.763529:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789760529.763537:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:9535:x1876699798089472:12345-0@lo:502: 00000100:00100000:3.0:1789760529.765262:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:9535:x1876699798089472:12345-0@lo:502: Request processed in 1720us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760529.765698:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789760529.765816:0:9535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9535:1876699798089472:0@lo:502: 00000020:01000000:3.0:1789760529.765852:0:9535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789760529.765860:0:9535:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789760529.765867:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760529.765869:0:9535:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789760529.765875:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789760529.765880:0:9535:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1789760529.765902:0:9535:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789760529.765906:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760529.765947:0:9535:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97e54490cd28) 00000020:00000080:3.0:1789760529.765974:0:9535:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789760529.765982:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789760529.766072:0:9535:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789760529.766078:0:9535:0:(osd_handler.c:1573:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789760529.766087:0:9535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc2b9a3a739856bbd 00010000:00080000:3.0:1789760529.766117:0:9535:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e5435d4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1789760529.766352:0:9535:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789760529.767309:0:9535:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789760529.767323:0:9535:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789760529.769573:0:9535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760529.771038:0:9535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760529.771102:0:9535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789760529.771186:0:9535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789760529.776770:0:9536:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789760529.777222:0:9536:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789760529.786238:0:9535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789760529.786262:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789760529.786301:0:9535:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789760529.786324:0:9535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2b9a3a739856bc4 00000100:00080000:3.0:1789760529.786345:0:9535:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760529.786351:0:9535:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97e5435d4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1789760529.786398:0:9535:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e449749180 x1876699798089600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789760529.786702:0:3460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1876699798089600:0@lo:8: 00000100:00100000:3.0:1789760529.786933:0:3460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789760529.786992:0:9535:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789760529.787068:0:9535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760529.787073:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760529.787075:0:9535:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789760529.787077:0:9535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760529.787082:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760529.787083:0:9535:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789760529.787085:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760529.787087:0:9535:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789760529.787580:0:9535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9535:1876699798089728:0@lo:502: 00000100:00100000:3.0:1789760529.787646:0:9535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.787692:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57b2cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760529.787865:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798089728 00000100:00100000:1.0:1789760529.787873:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798089728 00000100:00100000:1.0:1789760529.788480:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789760529.788492:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:9535:x1876699798089728:12345-0@lo:502: 00000100:00100000:0.0:1789760529.789629:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798089600 00000100:00100000:0.0:1789760529.789642:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798089600 00000100:00100000:0.0:1789760529.789692:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789760529.789701:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3460:x1876699798089600:12345-0@lo:8: 00010000:00080000:0.0:1789760529.789732:0:8114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1789760529.789758:0:8114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc2b9a3a739856bcb 00002000:00100000:0.0:1789760529.789772:0:8114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97e4487a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789760529.789776:0:8114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789760529.789779:0:8114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789760529.789883:0:8114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789760529.789911:0:8114:0:(import.c:65:import_set_state_nolock()) ffff97e4487a5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760529.790217:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3460:x1876699798089600:12345-0@lo:8: Request processed in 514us (3283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760529.790225:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789760529.790391:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:9535:x1876699798089728:12345-0@lo:502: Request processed in 1901us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.790400:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00080000:3.0:1789760529.791863:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449749180 x1876699798089600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760529.791877:0:3460:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789760529.791885:0:3460:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789760529.791894:0:3460:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789760529.791901:0:3460:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789760529.791905:0:3460:0:(import.c:65:import_set_state_nolock()) ffff97e5435d4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789760529.791925:0:3460:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789760529.791932:0:3460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1876699798089600:0@lo:8: 00000004:00080000:1.0:1789760529.791983:0:9536:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789760529.792088:0:9536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 205976299194ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789760529.799566:0:9535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9535:1876699798089728:0@lo:502: 00000020:01000000:3.0:1789760529.799608:0:9535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760529.799616:0:9535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760529.799618:0:9535:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789760529.799623:0:9535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789760529.799751:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789760529.799770:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789760529.799780:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.799812:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760529.799822:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789760529.799824:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e550c219b8 from 1 10000000:01000000:3.0:1789760529.799827:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789760529.799857:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.799872:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.799882:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760529.799900:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089856:0@lo:101: 00000100:00100000:3.0:1789760529.799971:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.800022:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57b2cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760529.800149:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798089856 00000100:00100000:2.0:1789760529.800157:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798089856 00000100:00100000:2.0:1789760529.800204:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789760529.800214:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798089856:12345-0@lo:101: 00010000:00010000:2.0:1789760529.800227:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760529.800239:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856bd2 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.800262:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 24 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.800271:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 24 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760529.800280:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8ee00, rc 0) 00000100:00100000:2.0:1789760529.800330:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798089856:12345-0@lo:101: Request processed in 118us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.800594:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789760529.802593:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089856:0@lo:101: 00010000:00010000:3.0:1789760529.802619:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.802632:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760529.802716:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089984:0@lo:501: 00000100:00100000:3.0:1789760529.802807:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.802844:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57b2cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760529.803170:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798089984 00000100:00100000:2.0:1789760529.803176:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798089984 00000100:00100000:2.0:1789760529.803214:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789760529.803222:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798089984:12345-0@lo:501: 00000100:00100000:2.0:1789760529.803449:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798089984:12345-0@lo:501: Request processed in 227us (670us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760529.803457:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789760529.805254:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798089984:0@lo:501: 10000000:01000000:3.0:1789760529.805296:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789760529.805306:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760529.805316:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:1.0:1789760529.820400:0:6472:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1789760529.831968:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8122:x1876699798088192:12345-0@lo:700: Request processed in 99981us (109578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.831980:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789760529.832036:0:8122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44974bb80 x1876699798088192/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760545 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760529.832050:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8122:1876699798088192:0@lo:700: 40000000:02000000:1.0:1789760529.832062:0:8122:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:2.0:1789760529.851319:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789760529.910453:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789760529.910544:0:9537:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789760529.910581:0:9537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9537:1876699798090240:0@lo:7: 00000100:00100000:3.0:1789760529.910661:0:9537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.910712:0:9537:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441db03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760529.910737:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798090112:0@lo:13: 00000100:00100000:3.0:1789760529.910766:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.910778:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798090240 00000100:00100000:1.0:1789760529.910815:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798090240 00000100:00100000:3.0:1789760529.910820:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798090112 00000100:00100000:3.0:1789760529.910826:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798090112 00000100:00100000:1.0:1789760529.910872:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789760529.910873:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789760529.910886:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:9537:x1876699798090240:12345-0@lo:7: 00000100:00100000:3.0:1789760529.910887:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3461:x1876699798090112:12345-0@lo:13: 00002000:00000024:3.0:1789760529.910936:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789760529.910987:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3461:x1876699798090112:12345-0@lo:13: Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760529.910994:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789760529.911016:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789760529.911047:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449749500 x1876699798090112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760529.911066:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798090112:0@lo:13: 00000001:00100000:2.0:1789760529.919084:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789760529.919104:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789760529.921893:0:8122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9532:x1876699798088064:12345-0@lo:700: Request processed in 199549us (199616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760529.921939:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789760529.922103:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449749c00 x1876699798088064/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760545 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760529.922119:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9532:1876699798088064:0@lo:700: 00002000:00080000:1.0:1789760529.925840:0:9533:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789760529.925849:0:9533:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789760529.926091:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9537:x1876699798090240:12345-0@lo:7: Request processed in 15204us (15427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760529.926101:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789760529.930735:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1789760529.937532:0:9537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449749180 x1876699798090240/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760545 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760529.937563:0:9537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9537:1876699798090240:0@lo:7: 00000004:00080000:0.0:1789760529.937578:0:9537:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789760529.938309:0:9537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9537:1876699798090368:0@lo:5: 00000100:00100000:1.0:1789760529.938377:0:9537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760529.938440:0:9537:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e543e40180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.939076:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798090368 00000100:00100000:0.0:1789760529.939085:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798090368 00000100:00100000:0.0:1789760529.939139:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760529.939158:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9537:x1876699798090368:12345-0@lo:5: 00002000:00080000:0.0:1789760529.939185:0:8114:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789760529.939189:0:8114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789760529.939954:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9537:x1876699798090368:12345-0@lo:5: Request processed in 795us (1574us total) trans 4294967297 rc 0/0 00010000:00080000:3.0:1789760529.940092:0:9537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a187b80 x1876699798090368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760545 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760529.940107:0:9537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9537:1876699798090368:0@lo:5: 00000004:00080000:3.0:1789760529.940129:0:9537:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789760529.940164:0:9537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9537:1876699798090496:0@lo:700: 00000100:00100000:3.0:1789760529.940198:0:9537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760529.940244:0:8121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798090496 00000100:00100000:3.0:1789760529.940249:0:8121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798090496 00000100:00100000:3.0:1789760529.940287:0:8121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760529.940295:0:8121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:9537:x1876699798090496:12345-0@lo:700: 00000100:00100000:3.0:1789760529.940693:0:9537:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441db0000 going to sleep for 11 seconds 00000100:00100000:0.0:1789760529.941131:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:3.0:1789760530.033708:0:9532:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789760530.033739:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449749f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9532:1876699798090752:0@lo:7: 00000100:00100000:3.0:1789760530.033821:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760530.033865:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f070600 going to sleep for 11 seconds 00000100:00100000:3.0:1789760530.033892:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798090624:0@lo:13: 00000100:00100000:3.0:1789760530.033917:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760530.033954:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798090752 00000100:00100000:3.0:1789760530.033975:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798090752 00000100:00100000:3.0:1789760530.034016:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789760530.034025:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9532:x1876699798090752:12345-0@lo:7: 00000100:00100000:2.0:1789760530.041983:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798090624 00000100:00100000:2.0:1789760530.041998:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798090624 00000100:00100000:2.0:1789760530.042066:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760530.042076:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798090624:12345-0@lo:13: 00002000:00000024:2.0:1789760530.042101:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789760530.042187:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798090624:12345-0@lo:13: Request processed in 112us (8268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760530.042195:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789760530.044476:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449748700 x1876699798090624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760530.044615:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798090624:0@lo:13: 00002000:00080000:3.0:1789760530.051408:0:8112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789760530.051416:0:8112:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789760530.051514:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9532:x1876699798090752:12345-0@lo:7: Request processed in 17486us (17689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760530.051533:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789760530.053586:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449749f80 x1876699798090752/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760546 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760530.053604:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9532:1876699798090752:0@lo:7: 00000004:00080000:2.0:1789760530.053620:0:9532:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789760530.053670:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a220e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9532:1876699798090880:0@lo:5: 00000100:00100000:2.0:1789760530.053737:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760530.053771:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760530.053850:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798090880 00000100:00100000:0.0:1789760530.053857:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798090880 00000100:00100000:0.0:1789760530.053914:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760530.053925:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9532:x1876699798090880:12345-0@lo:5: 00002000:00080000:0.0:1789760530.053949:0:8114:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789760530.054000:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9532:x1876699798090880:12345-0@lo:5: Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760530.054007:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789760530.054243:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57a220e00 x1876699798090880/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760546 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760530.054254:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a220e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9532:1876699798090880:0@lo:5: 00000004:00080000:2.0:1789760530.054263:0:9532:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789760530.054288:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a220e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9532:1876699798091008:0@lo:5: 00000100:00100000:2.0:1789760530.054314:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760530.054331:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789760530.054946:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798091008 00000100:00100000:1.0:1789760530.054953:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798091008 00000100:00100000:1.0:1789760530.054988:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789760530.054996:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9532:x1876699798091008:12345-0@lo:5: 00002000:00080000:1.0:1789760530.055029:0:9533:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:2.0:1789760530.059050:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1789760530.059318:0:8121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9537:x1876699798090496:12345-0@lo:700: Request processed in 119019us (119114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760530.059330:0:8121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789760530.059447:0:9537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449749c00 x1876699798090496/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760545 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760530.059459:0:9537:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789760530.059476:0:9537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449749c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9537:1876699798090496:0@lo:700: 00000100:00100000:1.0:1789760530.067567:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9532:x1876699798091008:12345-0@lo:5: Request processed in 12565us (13245us total) trans 4294967298 rc 0/0 00010000:00080000:2.0:1789760530.067688:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57a220e00 x1876699798091008/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760546 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760530.067708:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a220e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9532:1876699798091008:0@lo:5: 00000004:00080000:2.0:1789760530.067723:0:9532:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789760530.067776:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9532:1876699798091136:0@lo:900: 00000100:00100000:2.0:1789760530.067833:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760530.067864:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789760530.068000:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798091136 00000100:00100000:3.0:1789760530.068006:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798091136 00000100:00100000:3.0:1789760530.068073:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760530.068083:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9532:x1876699798091136:12345-0@lo:900: 00000100:00100000:3.0:1789760530.068153:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9532:x1876699798091136:12345-0@lo:900: Request processed in 72us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760530.068160:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789760530.068540:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546385880 x1876699798091136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789760546 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760530.068565:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9532:1876699798091136:0@lo:900: 00000100:00100000:1.0:1789760530.068960:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:02000040:0.0:1789760530.125544:0:9537:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789760530.135719:0:9537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9537:1876699798091264:0@lo:5: 00000100:00100000:0.0:1789760530.135783:0:9537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760530.135858:0:9537:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448ceb900 going to sleep for 11 seconds 00000100:00100000:0.0:1789760530.135880:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798091264 00000100:00100000:0.0:1789760530.135887:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798091264 00000100:00100000:0.0:1789760530.135934:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789760530.135943:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9537:x1876699798091264:12345-0@lo:5: 00002000:00080000:0.0:1789760530.145161:0:8114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789760530.145181:0:8114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789760530.152940:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9537:x1876699798091264:12345-0@lo:5: Request processed in 16989us (17148us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789760530.152954:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789760530.153091:0:9537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac17100 x1876699798091264/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760546 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760530.153109:0:9537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9537:1876699798091264:0@lo:5: 00000004:00080000:3.0:1789760530.153122:0:9537:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:1.0:1789760530.630956:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760530.630984:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798091392:0@lo:41: 00000100:00100000:1.0:1789760530.631055:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760530.631166:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798091392 00000100:00100000:0.0:1789760530.631182:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798091392 00000100:00100000:0.0:1789760530.631237:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760530.631247:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798091392:12345-0@lo:41: 00000004:00000024:0.0:1789760530.631286:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760530.631351:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798091392:12345-0@lo:41: Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760530.631359:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760530.631404:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798091392:0@lo:41: 00010000:00010000:3.0:1789760530.950959:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760531.142992:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798091520:0@lo:41: 00000100:00100000:0.0:1789760531.143063:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760531.143217:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798091520 00000100:00100000:3.0:1789760531.143225:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798091520 00000100:00100000:3.0:1789760531.143286:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789760531.143297:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798091520:12345-0@lo:41: 00000004:00000024:3.0:1789760531.143345:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760531.143653:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798091520:12345-0@lo:41: Request processed in 357us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760531.143662:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789760531.144137:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798091520:0@lo:41: 00000100:00100000:2.0:1789760531.656935:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760531.656959:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798091648:0@lo:13: 00000100:00100000:2.0:1789760531.657022:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760531.657078:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798091648 00000100:00100000:2.0:1789760531.657086:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798091648 00000100:00100000:2.0:1789760531.657141:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760531.657165:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798091648:12345-0@lo:13: 00002000:00000024:2.0:1789760531.657200:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760531.657258:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798091648:12345-0@lo:13: Request processed in 108us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760531.657265:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789760531.657289:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760531.657651:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546385880 x1876699798091648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760531.657690:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798091648:0@lo:13: 00000100:00100000:1.0:1789760531.662396:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760531.662418:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798091776:0@lo:13: 00000100:00100000:1.0:1789760531.662480:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760531.662577:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798091776 00000100:00100000:0.0:1789760531.662584:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798091776 00000100:00080000:2.0:1789760531.662707:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760531.662756:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760531.662767:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798091776:12345-0@lo:13: 00002000:00000024:0.0:1789760531.662814:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760531.662862:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798091776:12345-0@lo:13: Request processed in 97us (381us total) trans 0 rc 0/0 00010000:00080000:2.0:1789760531.662953:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac14000 x1876699798091776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760531.662972:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798091776:0@lo:13: 00000100:00100000:0.0:1789760531.666775:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000001:00080000:0.0:1789760531.730071:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1789760531.730089:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1789760531.979624:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760532.160581:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.160854:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777073280 00000100:00100000:2.0:1789760532.160865:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777073280 00000100:00100000:2.0:1789760532.161202:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:2.0:1789760532.161211:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1876699777073280:12345-192.168.203.38@tcp:250: 00010000:00080000:2.0:1789760532.161239:0:6459:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9c9a29f0-58a4-4591-8db4-e258df357379@192.168.203.38@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1789760532.161268:0:6459:0:(genops.c:1385:class_connect()) connect: client 9c9a29f0-58a4-4591-8db4-e258df357379, cookie 0xc2b9a3a739856be0 00000100:00080000:2.0:1789760532.161403:0:6459:0:(import.c:65:import_set_state_nolock()) ffff97e543263000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760532.161472:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+5:2402:x1876699777073280:12345-192.168.203.38@tcp:250: Request processed in 260us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760532.161492:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:0.0:1789760532.165389:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760532.165436:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777073408 00000100:00100000:0.0:1789760532.165445:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777073408 00000100:00100000:0.0:1789760532.165493:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:0.0:1789760532.165502:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+5:6378:x1876699777073408:12345-192.168.203.38@tcp:101: 00010000:00010000:0.0:1789760532.165518:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760532.165534:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e652116f5 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.165561:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 6 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.165573:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 6 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.165581:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dce00, rc 0) 00000100:00100000:0.0:1789760532.165785:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+6:6378:x1876699777073408:12345-192.168.203.38@tcp:101: Request processed in 128us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760532.165807:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:3.0:1789760532.172150:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760532.172241:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777073536 00000100:00100000:1.0:1789760532.172250:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777073536 00000100:00100000:1.0:1789760532.172304:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:1.0:1789760532.172314:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+6:6378:x1876699777073536:12345-192.168.203.38@tcp:501: 00000100:00100000:1.0:1789760532.172768:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+6:6378:x1876699777073536:12345-192.168.203.38@tcp:501: Request processed in 455us (624us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760532.172777:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:0.0:1789760532.178590:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.178731:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777073664 00000100:00100000:2.0:1789760532.178741:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777073664 00000100:00100000:2.0:1789760532.178816:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1789760532.178827:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+6:6378:x1876699777073664:12345-192.168.203.38@tcp:101: 00010000:00010000:2.0:1789760532.178844:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760532.178863:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e652116fc expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.178892:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 7 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.178904:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 7 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.178913:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8ea00, rc 0) 00000100:00100000:2.0:1789760532.178960:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+7:6378:x1876699777073664:12345-192.168.203.38@tcp:101: Request processed in 136us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760532.178966:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1789760532.180730:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760532.180962:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777073792 00000100:00100000:3.0:1789760532.180971:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777073792 00000100:00100000:0.0:1789760532.181070:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:0.0:1789760532.181081:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+7:6378:x1876699777073792:12345-192.168.203.38@tcp:501: 00000100:00100000:0.0:1789760532.181293:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+8:6378:x1876699777073792:12345-192.168.203.38@tcp:501: Request processed in 215us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760532.181301:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:1.0:1789760532.186131:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760532.186456:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777073920 00000100:00100000:3.0:1789760532.186466:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777073920 00000100:00100000:3.0:1789760532.186522:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:3.0:1789760532.186532:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+8:6378:x1876699777073920:12345-192.168.203.38@tcp:503: 00000100:00100000:3.0:1789760532.187003:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+8:6378:x1876699777073920:12345-192.168.203.38@tcp:503: Request processed in 470us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760532.187012:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:0.0:1789760532.200713:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760532.200855:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777074048 00000100:00100000:3.0:1789760532.200865:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777074048 00000100:00100000:3.0:1789760532.200920:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:3.0:1789760532.200929:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+8:6396:x1876699777074048:12345-192.168.203.38@tcp:502: 00000100:00100000:3.0:1789760532.201260:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+8:6396:x1876699777074048:12345-192.168.203.38@tcp:502: Request processed in 331us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760532.201269:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:1.0:1789760532.246602:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.246711:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777074176 00000100:00100000:2.0:1789760532.246721:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777074176 00000100:00100000:2.0:1789760532.246835:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:2.0:1789760532.246845:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+8:6396:x1876699777074176:12345-192.168.203.38@tcp:502: 00000100:00100000:2.0:1789760532.247135:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+8:6396:x1876699777074176:12345-192.168.203.38@tcp:502: Request processed in 290us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760532.247142:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:1.0:1789760532.255904:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.255934:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777074304 00000100:00100000:2.0:1789760532.255944:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777074304 00000100:00100000:2.0:1789760532.255988:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:2.0:1789760532.255998:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+8:6378:x1876699777074304:12345-192.168.203.38@tcp:101: 00010000:00010000:2.0:1789760532.256015:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760532.256032:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8fe00/0xc2b9a3a739856bf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521172d expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.256070:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8fe00/0xc2b9a3a739856bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521172d expref: 9 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.256082:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8fe00/0xc2b9a3a739856bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521172d expref: 9 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.256092:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8fe00, rc 0) 00000100:00100000:2.0:1789760532.256604:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+9:6378:x1876699777074304:12345-192.168.203.38@tcp:101: Request processed in 604us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760532.256611:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:1.0:1789760532.265352:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.265543:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777074432 00000100:00100000:2.0:1789760532.265553:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777074432 00000100:00100000:2.0:1789760532.265726:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:2.0:1789760532.265737:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+9:6378:x1876699777074432:12345-192.168.203.38@tcp:256: 20000000:01000000:2.0:1789760532.265762:0:6457:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789760532.265877:0:6457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789760532.265883:0:6457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789760532.265887:0:6457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789760532.265890:0:6457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789760532.265892:0:6457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789760532.270019:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+9:6378:x1876699777074432:12345-192.168.203.38@tcp:256: Request processed in 4275us (4668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760532.270044:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:1.0:1789760532.275873:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.275947:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777074560 00000100:00100000:2.0:1789760532.275957:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777074560 00000100:00100000:2.0:1789760532.276009:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:2.0:1789760532.276018:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+9:6378:x1876699777074560:12345-192.168.203.38@tcp:101: 00010000:00010000:2.0:1789760532.276035:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760532.276050:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211734 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.276075:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 10 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.276087:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 10 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760532.276097:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e200, rc 0) 00000100:00100000:2.0:1789760532.276160:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:6378:x1876699777074560:12345-192.168.203.38@tcp:101: Request processed in 143us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760532.276167:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:1.0:1789760532.280021:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.280132:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777074688 00000100:00100000:2.0:1789760532.280142:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777074688 00000100:00100000:2.0:1789760532.280347:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:2.0:1789760532.280357:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:6378:x1876699777074688:12345-192.168.203.38@tcp:501: 00000100:00100000:2.0:1789760532.280681:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:6378:x1876699777074688:12345-192.168.203.38@tcp:501: Request processed in 324us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760532.280689:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:3.0:1789760532.282695:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760532.283478:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777074816 00000100:00100000:1.0:1789760532.283490:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777074816 00000100:00100000:1.0:1789760532.283585:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:1.0:1789760532.283596:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6378:x1876699777074816:12345-192.168.203.38@tcp:503: 00000100:00100000:1.0:1789760532.284001:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6378:x1876699777074816:12345-192.168.203.38@tcp:503: Request processed in 406us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760532.284009:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:1.0:1789760532.288220:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.288329:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777074944 00000100:00100000:2.0:1789760532.288352:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777074944 00000100:00100000:2.0:1789760532.288409:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:2.0:1789760532.288420:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:6400:x1876699777074944:12345-192.168.203.38@tcp:502: 00000100:00100000:2.0:1789760532.289322:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:6400:x1876699777074944:12345-192.168.203.38@tcp:502: Request processed in 892us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760532.289332:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:2.0:1789760532.293146:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760532.293288:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777075072 00000100:00100000:1.0:1789760532.293301:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777075072 00000100:00100000:1.0:1789760532.293360:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:1.0:1789760532.293369:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6400:x1876699777075072:12345-192.168.203.38@tcp:502: 00000100:00100000:1.0:1789760532.295300:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6400:x1876699777075072:12345-192.168.203.38@tcp:502: Request processed in 1923us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760532.295312:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:2.0:1789760532.300344:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760532.300389:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760532.300421:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777075200 00000100:00100000:0.0:1789760532.300431:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777075200 00000100:00100000:0.0:1789760532.300490:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777075456 00000100:00100000:0.0:1789760532.300493:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777075456 00000100:00100000:0.0:1789760532.300523:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1789760532.300532:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1876699777075200:12345-192.168.203.38@tcp:38: 00010000:00080000:0.0:1789760532.300561:0:6466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1789760532.300607:0:6466:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739856c03 00000004:00100000:0.0:1789760532.300638:0:6466:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789760532.301011:0:6466:0:(import.c:65:import_set_state_nolock()) ffff97e441fef800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760532.301077:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777075200:12345-192.168.203.38@tcp:38: Request processed in 545us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760532.301085:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1789760532.301104:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1789760532.301109:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1876699777075456:12345-192.168.203.38@tcp:38: 00010000:00080000:0.0:1789760532.301125:0:6466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1789760532.301295:0:6466:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739856c0a 00000004:00100000:0.0:1789760532.301385:0:6466:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789760532.301619:0:6466:0:(import.c:65:import_set_state_nolock()) ffff97e57ad55000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760532.301651:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777075456:12345-192.168.203.38@tcp:38: Request processed in 540us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760532.301657:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00010000:00010000:2.0:1789760532.999117:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760533.307087:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760533.307188:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760533.314731:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760533.323686:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777075584 00000100:00100000:0.0:1789760533.323701:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777075584 00000100:00100000:0.0:1789760533.323801:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777075328 00000100:00100000:0.0:1789760533.323804:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777075328 00000100:00100000:0.0:1789760533.323834:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1789760533.323844:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:0:x1876699777075584:12345-192.168.203.38@tcp:41: 00000004:00000024:0.0:1789760533.323900:0:6465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789760533.323976:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:0:x1876699777075584:12345-192.168.203.38@tcp:41: Request processed in 131us (16896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760533.323985:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1789760533.324009:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1789760533.324017:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:0:x1876699777075328:12345-192.168.203.38@tcp:41: 00000004:00000024:0.0:1789760533.324039:0:6465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760533.324064:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:0:x1876699777075328:12345-192.168.203.38@tcp:41: Request processed in 49us (16877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760533.324070:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00080000:0.0:1789760533.324180:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760533.324184:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760533.327911:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777075712 00000100:00100000:1.0:1789760533.327932:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777075712 00000100:00100000:1.0:1789760533.328037:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1789760533.328051:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6378:x1876699777075712:12345-192.168.203.38@tcp:41: 00000004:00000024:1.0:1789760533.329078:0:6466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760533.329148:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6378:x1876699777075712:12345-192.168.203.38@tcp:41: Request processed in 1100us (14424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760533.329158:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1789760533.332975:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760533.333132:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777075840 00000100:00100000:0.0:1789760533.333150:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777075840 00000100:00100000:0.0:1789760533.333213:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:0.0:1789760533.333224:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6378:x1876699777075840:12345-192.168.203.38@tcp:40: 00000100:00100000:0.0:1789760533.333326:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6378:x1876699777075840:12345-192.168.203.38@tcp:40: Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760533.333333:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1789760533.335140:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760533.335254:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777075968 00000100:00100000:1.0:1789760533.335264:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777075968 00000100:00100000:1.0:1789760533.335307:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1789760533.335314:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1876699777075968:12345-192.168.203.38@tcp:8: 00010000:00080000:1.0:1789760533.335343:0:9533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1789760533.335669:0:9533:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739856c11 00002000:00100000:1.0:1789760533.335683:0:9533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ac82f857-edfe-4201-bbe8-4599ba569acb/ffff97e544911800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789760533.335706:0:9533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789760533.336686:0:9533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789760533.336719:0:9533:0:(import.c:65:import_set_state_nolock()) ffff97e544917000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760533.336854:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777075968:12345-192.168.203.38@tcp:8: Request processed in 1538us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760533.336864:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1789760533.338147:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760533.338233:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760533.338307:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777076096 00000100:00100000:3.0:1789760533.338325:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777076096 00000100:00100000:3.0:1789760533.338368:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1789760533.338383:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1876699777076096:12345-192.168.203.38@tcp:8: 00010000:00080000:3.0:1789760533.338413:0:8110:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1789760533.338439:0:8110:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739856c18 00002000:00100000:3.0:1789760533.338449:0:8110:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ac82f857-edfe-4201-bbe8-4599ba569acb/ffff97e5435d5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789760533.338480:0:8110:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789760533.338770:0:8110:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789760533.338828:0:8110:0:(import.c:65:import_set_state_nolock()) ffff97e5435d7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760533.338883:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777076096:12345-192.168.203.38@tcp:8: Request processed in 508us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.338891:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:2.0:1789760533.339888:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777076224 00000100:00100000:2.0:1789760533.339897:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777076224 00000100:00100000:2.0:1789760533.340049:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:2.0:1789760533.340059:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2403:x1876699777076224:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1789760533.340115:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2403:x1876699777076224:12345-192.168.203.38@tcp:400: Request processed in 58us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760533.340121:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:1.0:1789760533.345282:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760533.345367:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777076352 00000100:00100000:3.0:1789760533.345387:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777076352 00000100:00100000:3.0:1789760533.345445:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1789760533.345455:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6378:x1876699777076352:12345-192.168.203.38@tcp:900: 00000100:00100000:3.0:1789760533.345537:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6378:x1876699777076352:12345-192.168.203.38@tcp:900: Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.345553:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1789760533.352239:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760533.352331:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777076480 00000100:00100000:2.0:1789760533.352341:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777076480 00000100:00100000:2.0:1789760533.354186:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1789760533.354207:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6378:x1876699777076480:12345-192.168.203.38@tcp:33: 00000004:00080000:3.0:1789760533.386500:0:6468:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32226us 00000004:00200000:3.0:1789760533.401826:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789760533.401939:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6378:x1876699777076480:12345-192.168.203.38@tcp:33: Request processed in 47737us (49703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.401964:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1789760533.598340:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760533.598508:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777076608 00000100:00100000:0.0:1789760533.598517:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777076608 00000100:00100000:0.0:1789760533.598575:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:0.0:1789760533.598585:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6418:x1876699777076608:12345-192.168.203.38@tcp:101: 00010000:00010000:0.0:1789760533.598605:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760533.598671:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd200/0xc2b9a3a739856c1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211765 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.598758:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856c26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.598773:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.598815:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760533.598848:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760533.598852:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760533.598866:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.598889:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd200/0xc2b9a3a739856c1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211765 expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.598910:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856c26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211765 expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.598918:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760533.598920:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760533.598923:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dcc00, rc 0) 00000100:00100000:0.0:1789760533.598982:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:6418:x1876699777076608:12345-192.168.203.38@tcp:101: Request processed in 398us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760533.598992:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00010000:00010000:0.0:1789760534.025706:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760535.047113:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760535.239430:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798092032:0@lo:13: 00000100:00100000:0.0:1789760535.239566:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760535.239651:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798091904:0@lo:13: 00000100:00100000:0.0:1789760535.239689:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760535.239747:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798092032 00000100:00100000:0.0:1789760535.239757:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798092032 00000100:00100000:1.0:1789760535.247372:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798092288:0@lo:400: 00000100:00100000:1.0:1789760535.247448:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760535.247502:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798092800:0@lo:400: 00000100:00100000:1.0:1789760535.247532:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760535.247549:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798093312:0@lo:400: 00000100:00100000:1.0:1789760535.247572:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789760535.247629:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760535.247670:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798091904 00000100:00100000:2.0:1789760535.247683:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798091904 00000100:00100000:1.0:1789760535.248475:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789760535.248488:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798092416:0@lo:400: 00000100:00100000:1.0:1789760535.248525:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760535.248548:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798092928:0@lo:400: 00000100:00100000:1.0:1789760535.248570:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760535.248589:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798093440:0@lo:400: 00000100:00100000:1.0:1789760535.248609:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760535.248651:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798092288 00000100:00100000:1.0:1789760535.248658:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798092288 00000100:00100000:1.0:1789760535.248694:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798092800 00000100:00100000:1.0:1789760535.248697:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798092800 00000100:00100000:1.0:1789760535.248712:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798093312 00000100:00100000:1.0:1789760535.248715:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798093312 00000100:00100000:1.0:1789760535.248726:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798092928 00000100:00100000:1.0:1789760535.248728:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798092928 00000100:00100000:1.0:1789760535.248737:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798093440 00000100:00100000:1.0:1789760535.248739:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798093440 00000100:00100000:1.0:1789760535.248752:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760535.248759:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798092288:12345-0@lo:400: 00000100:00080000:2.0:1789760535.249621:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760535.249659:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760535.249664:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760535.249734:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760535.249754:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798091904:12345-0@lo:13: 00002000:00000024:2.0:1789760535.249857:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760535.249954:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798091904:12345-0@lo:13: Request processed in 208us (10262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760535.249963:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760535.250007:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798092288:12345-0@lo:400: Request processed in 1240us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760535.250148:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789760535.250936:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760535.250954:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798092800:12345-0@lo:400: 00000100:00100000:0.0:1789760535.251030:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798092800:12345-0@lo:400: Request processed in 84us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.251037:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760535.251058:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789760535.251066:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798093312:12345-0@lo:400: 00000100:00100000:0.0:1789760535.251096:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798093312:12345-0@lo:400: Request processed in 31us (3524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.251102:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789760535.251113:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760535.251121:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798092928:12345-0@lo:400: 00000100:00100000:0.0:1789760535.251150:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798092928:12345-0@lo:400: Request processed in 31us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.251155:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760535.251168:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789760535.251174:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798093440:12345-0@lo:400: 00000100:00100000:0.0:1789760535.251201:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798093440:12345-0@lo:400: Request processed in 27us (2592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.251206:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789760535.251233:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798092160:0@lo:400: 00000100:00100000:0.0:1789760535.251319:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760535.251365:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798092672:0@lo:400: 00000100:00100000:0.0:1789760535.251392:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760535.251412:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798093184:0@lo:400: 00000100:00100000:0.0:1789760535.251438:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760535.251462:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789760535.251469:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798092544:0@lo:400: 00000100:00100000:0.0:1789760535.251491:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760535.251507:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798093056:0@lo:400: 00000100:00100000:0.0:1789760535.251529:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760535.251573:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798092160 00000100:00100000:0.0:1789760535.251583:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798092160 00000100:00100000:0.0:1789760535.251620:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789760535.251627:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798092160:12345-0@lo:400: 00000100:00100000:0.0:1789760535.251674:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798092160:12345-0@lo:400: Request processed in 47us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.251681:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789760535.251711:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798092416 00000100:00100000:0.0:1789760535.251715:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798092416 00000100:00100000:0.0:1789760535.251739:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798092672 00000100:00100000:0.0:1789760535.251743:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798092672 00000100:00100000:0.0:1789760535.251757:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789760535.251763:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798092416:12345-0@lo:400: 00000100:00100000:0.0:1789760535.251833:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798092416:12345-0@lo:400: Request processed in 68us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.251840:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789760535.251852:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789760535.251865:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798092672:12345-0@lo:400: 00000100:00100000:0.0:1789760535.251894:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798092672:12345-0@lo:400: Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.251900:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789760535.251917:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798093184 00000100:00100000:0.0:1789760535.251920:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798093184 00000100:00100000:0.0:1789760535.251956:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798093056 00000100:00100000:0.0:1789760535.251959:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798093056 00000100:00100000:0.0:1789760535.251978:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760535.251984:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798093184:12345-0@lo:400: 00000100:00100000:0.0:1789760535.252015:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798093184:12345-0@lo:400: Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.252021:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760535.252032:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760535.252037:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798093056:12345-0@lo:400: 00000100:00100000:0.0:1789760535.252063:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798093056:12345-0@lo:400: Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.252068:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760535.252083:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798092544 00000100:00100000:0.0:1789760535.252087:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798092544 00000100:00100000:0.0:1789760535.252103:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789760535.252108:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798092544:12345-0@lo:400: 00000100:00100000:0.0:1789760535.252134:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798092544:12345-0@lo:400: Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.252140:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789760535.252166:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760535.252210:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798092544:0@lo:400: 00010000:00080000:0.0:1789760535.252236:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433df100 x1876699798093056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760535.252248:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798093056:0@lo:400: 00000100:00100000:0.0:1789760535.252257:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798092160:0@lo:400: 00000100:00100000:0.0:1789760535.252267:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798092672:0@lo:400: 00010000:00080000:0.0:1789760535.252276:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433ded80 x1876699798093184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760535.252284:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798093184:0@lo:400: 00000100:00100000:0.0:1789760535.252349:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760535.252357:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798092032:12345-0@lo:13: 00002000:00000024:0.0:1789760535.252375:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760535.252414:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798092032:12345-0@lo:13: Request processed in 58us (12853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.252420:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789760535.252457:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac17480 x1876699798092032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760535.252468:0:3463:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789760535.252489:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798092032:0@lo:13: 00010000:00080000:0.0:1789760535.252507:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546385180 x1876699798091904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760535.252514:0:3463:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789760535.252530:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798091904:0@lo:13: 00000100:00100000:0.0:1789760535.252762:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798092416:0@lo:400: 00010000:00080000:0.0:1789760535.252784:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433dc380 x1876699798092928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760535.252819:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798092928:0@lo:400: 00010000:00080000:0.0:1789760535.252832:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dd500 x1876699798093440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760535.252841:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798093440:0@lo:400: 00000100:00100000:0.0:1789760535.252856:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798092288:0@lo:400: 00000100:00100000:0.0:1789760535.252869:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798092800:0@lo:400: 00000100:00100000:0.0:1789760535.252882:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798093312:0@lo:400: 00000001:00100000:3.0:1789760535.319433:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000001:00100000:0.0:1789760535.371485:0:7272:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000100:00100000:1.0:1789760535.752651:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798093568:0@lo:41: 00000100:00100000:1.0:1789760535.752745:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760535.752861:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798093568 00000100:00100000:1.0:1789760535.752870:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798093568 00000100:00100000:1.0:1789760535.752923:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789760535.752932:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798093568:12345-0@lo:41: 00000004:00000024:1.0:1789760535.752980:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760535.753043:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798093568:12345-0@lo:41: Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760535.753051:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789760535.753117:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798093568:0@lo:41: 00000100:00100000:1.0:1789760535.806150:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760535.806333:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777076736 00000100:00100000:0.0:1789760535.806346:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777076736 00000100:00100000:0.0:1789760535.806456:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1789760535.806469:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6471:x1876699777076736:12345-192.168.203.38@tcp:41: 00000004:00000024:0.0:1789760535.806509:0:6467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760535.806601:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6471:x1876699777076736:12345-192.168.203.38@tcp:41: Request processed in 135us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.806609:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00080000:2.0:1789760535.807297:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760535.810088:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760535.810266:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777076864 00000100:00100000:0.0:1789760535.810278:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777076864 00000100:00100000:0.0:1789760535.810385:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:0.0:1789760535.810397:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:6471:x1876699777076864:12345-192.168.203.38@tcp:41: 00000004:00000024:0.0:1789760535.810456:0:9081:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00080000:2.0:1789760535.810627:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760535.810780:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:6471:x1876699777076864:12345-192.168.203.38@tcp:41: Request processed in 384us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.810838:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:1.0:1789760535.820194:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760535.820328:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777076992 00000100:00100000:0.0:1789760535.820341:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777076992 00000100:00100000:0.0:1789760535.820557:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1789760535.820569:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6471:x1876699777076992:12345-192.168.203.38@tcp:13: 00002000:00000024:0.0:1789760535.820623:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760535.820725:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6471:x1876699777076992:12345-192.168.203.38@tcp:13: Request processed in 159us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.820733:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00080000:2.0:1789760535.821487:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760535.823772:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760535.823905:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777077120 00000100:00100000:0.0:1789760535.823919:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777077120 00000100:00080000:2.0:1789760535.824050:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760535.826809:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:0.0:1789760535.826844:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6471:x1876699777077120:12345-192.168.203.38@tcp:13: 00002000:00000024:0.0:1789760535.826882:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760535.826991:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6471:x1876699777077120:12345-192.168.203.38@tcp:13: Request processed in 166us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760535.827000:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00010000:00010000:2.0:1789760536.082087:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760536.271377:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760536.271409:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798093696:0@lo:41: 00000100:00100000:3.0:1789760536.271503:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760536.274404:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798093696 00000100:00100000:2.0:1789760536.274423:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798093696 00000100:00100000:2.0:1789760536.275336:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760536.275355:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798093696:12345-0@lo:41: 00000004:00000024:2.0:1789760536.275415:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760536.275770:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798093696:12345-0@lo:41: Request processed in 421us (4266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760536.275779:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789760536.275917:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798093696:0@lo:41: 00000100:00100000:2.0:1789760536.775966:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798093824:0@lo:13: 00000100:00100000:2.0:1789760536.776030:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760536.778986:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798093824 00000100:00100000:2.0:1789760536.778999:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798093824 00000100:00100000:2.0:1789760536.779058:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789760536.779068:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798093824:12345-0@lo:13: 00002000:00000024:2.0:1789760536.779100:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760536.779255:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798093824:12345-0@lo:13: Request processed in 188us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760536.779263:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789760536.779287:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543284e00 x1876699798093824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760536.779312:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798093824:0@lo:13: 00000100:00100000:2.0:1789760536.779327:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798093952:0@lo:13: 00000100:00100000:2.0:1789760536.779501:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760536.779684:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798093952 00000100:00100000:1.0:1789760536.779689:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798093952 00000100:00100000:1.0:1789760536.779759:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760536.779767:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798093952:12345-0@lo:13: 00002000:00000024:1.0:1789760536.779780:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760536.779905:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798093952:12345-0@lo:13: Request processed in 138us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760536.779912:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789760536.779989:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546386a00 x1876699798093952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760536.780003:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798093952:0@lo:13: 00010000:00010000:0.0:1789760537.107826:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789760537.352259:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000001:00100000:1.0:1789760537.358964:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00010000:00010000:2.0:1789760538.120079:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760538.312560:0:9745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789760538.679651:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760538.679698:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760538.679729:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760538.679762:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760538.679848:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760538.679879:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777077504 00000100:00100000:3.0:1789760538.679887:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777077504 00000100:00100000:3.0:1789760538.679942:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777077376 00000100:00100000:3.0:1789760538.679945:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777077376 00000100:00100000:3.0:1789760538.679970:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1789760538.679981:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777077504:12345-192.168.203.38@tcp:400: 00000100:00100000:3.0:1789760538.680053:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777077504:12345-192.168.203.38@tcp:400: Request processed in 74us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760538.680060:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1789760538.680077:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1789760538.680083:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777077376:12345-192.168.203.38@tcp:400: 00000100:00100000:3.0:1789760538.680121:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777077376:12345-192.168.203.38@tcp:400: Request processed in 37us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760538.680127:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1789760538.680144:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777077760 00000100:00100000:3.0:1789760538.680148:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777077760 00000100:00100000:3.0:1789760538.680172:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777077632 00000100:00100000:3.0:1789760538.680175:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777077632 00000100:00100000:3.0:1789760538.680196:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1789760538.680202:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777077760:12345-192.168.203.38@tcp:400: 00000100:00100000:3.0:1789760538.680226:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777077760:12345-192.168.203.38@tcp:400: Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760538.680242:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1789760538.680255:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1789760538.680262:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777077632:12345-192.168.203.38@tcp:400: 00000100:00100000:3.0:1789760538.680301:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777077632:12345-192.168.203.38@tcp:400: Request processed in 39us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760538.680307:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00080000:3.0:1789760538.680322:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760538.680327:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760538.680330:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760538.680332:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760538.681302:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777077248 00000100:00100000:2.0:1789760538.681310:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777077248 00000100:00100000:2.0:1789760538.681360:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:2.0:1789760538.681369:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2403:x1876699777077248:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1789760538.681420:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2403:x1876699777077248:12345-192.168.203.38@tcp:400: Request processed in 53us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760538.681427:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 194 00010000:00010000:2.0:1789760539.143781:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760540.166936:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760540.359278:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798094208:0@lo:400: 00000100:00100000:2.0:1789760540.359340:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359388:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798094720:0@lo:400: 00000100:00100000:2.0:1789760540.359412:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359435:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798095232:0@lo:400: 00000100:00100000:2.0:1789760540.359459:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359487:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789760540.359513:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798094080:0@lo:400: 00000100:00100000:2.0:1789760540.359550:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359571:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798094592:0@lo:400: 00000100:00100000:2.0:1789760540.359679:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359701:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798095104:0@lo:400: 00000100:00100000:2.0:1789760540.359722:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359740:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798095616:0@lo:400: 00000100:00100000:2.0:1789760540.359758:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359780:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798094336:0@lo:400: 00000100:00100000:2.0:1789760540.359905:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359925:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798094848:0@lo:400: 00000100:00100000:2.0:1789760540.359943:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.359958:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798095360:0@lo:400: 00000100:00100000:2.0:1789760540.359992:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.360005:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789760540.360010:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798094464:0@lo:400: 00000100:00100000:2.0:1789760540.360031:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.360040:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798094976:0@lo:400: 00000100:00100000:2.0:1789760540.360059:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.360075:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798095488:0@lo:400: 00000100:00100000:2.0:1789760540.360093:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.360127:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798094208 00000100:00100000:2.0:1789760540.360134:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798094208 00000100:00100000:2.0:1789760540.360167:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798094720 00000100:00100000:2.0:1789760540.360170:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798094720 00000100:00100000:2.0:1789760540.360189:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798095232 00000100:00100000:2.0:1789760540.360197:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798095232 00000100:00100000:2.0:1789760540.360213:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798094848 00000100:00100000:2.0:1789760540.360215:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798094848 00000100:00100000:2.0:1789760540.360225:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798095360 00000100:00100000:2.0:1789760540.360227:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798095360 00000100:00100000:2.0:1789760540.360237:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798094464 00000100:00100000:2.0:1789760540.360239:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798094464 00000100:00100000:2.0:1789760540.360252:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760540.360259:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798094208:12345-0@lo:400: 00000100:00100000:2.0:1789760540.360308:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798094208:12345-0@lo:400: Request processed in 49us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.360315:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760540.360331:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760540.360337:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798094720:12345-0@lo:400: 00000100:00100000:2.0:1789760540.360364:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798094720:12345-0@lo:400: Request processed in 28us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.360370:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760540.360380:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760540.360385:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798095232:12345-0@lo:400: 00000100:00100000:2.0:1789760540.360408:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798095232:12345-0@lo:400: Request processed in 24us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.360413:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760540.360421:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760540.360426:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798094848:12345-0@lo:400: 00000100:00100000:2.0:1789760540.360453:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798094848:12345-0@lo:400: Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.360459:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760540.360469:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789760540.360480:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798095360:12345-0@lo:400: 00000100:00100000:2.0:1789760540.360507:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798095360:12345-0@lo:400: Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.360512:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789760540.360522:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760540.360528:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798094464:12345-0@lo:400: 00000100:00100000:2.0:1789760540.360553:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798094464:12345-0@lo:400: Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.360557:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760540.360573:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798094592 00000100:00100000:2.0:1789760540.360576:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798094592 00000100:00100000:1.0:1789760540.360887:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798094080 00000100:00100000:1.0:1789760540.360898:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798094080 00000100:00100000:1.0:1789760540.360926:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789760540.360933:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798094080:12345-0@lo:400: 00000100:00100000:1.0:1789760540.360967:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798094080:12345-0@lo:400: Request processed in 35us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760540.360972:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789760540.361817:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760540.361830:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798095744:0@lo:13: 00000100:00100000:1.0:1789760540.361863:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760540.362126:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798095744 00000100:00100000:1.0:1789760540.362131:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798095744 00000100:00100000:1.0:1789760540.362163:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760540.362172:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798095744:12345-0@lo:13: 00002000:00000024:1.0:1789760540.362199:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760540.362237:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798095744:12345-0@lo:13: Request processed in 67us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760540.362244:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789760540.362282:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dd500 x1876699798095744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760540.362301:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798095744:0@lo:13: 00000100:00100000:2.0:1789760540.362750:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798094336 00000100:00100000:2.0:1789760540.362755:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798094336 00000100:00100000:2.0:1789760540.362775:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760540.362781:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798094592:12345-0@lo:400: 00000100:00100000:2.0:1789760540.362892:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798094592:12345-0@lo:400: Request processed in 111us (3212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.362898:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760540.362911:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760540.362916:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798094336:12345-0@lo:400: 00000100:00100000:2.0:1789760540.362941:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798094336:12345-0@lo:400: Request processed in 25us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.362947:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760540.362965:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798095104 00000100:00100000:2.0:1789760540.362969:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798095104 00000100:00100000:2.0:1789760540.362987:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798095616 00000100:00100000:2.0:1789760540.362990:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798095616 00000100:00100000:2.0:1789760540.363734:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798094976 00000100:00100000:2.0:1789760540.363738:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798094976 00000100:00100000:2.0:1789760540.363752:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798095488 00000100:00100000:2.0:1789760540.363755:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798095488 00000100:00100000:2.0:1789760540.363768:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760540.363774:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798095104:12345-0@lo:400: 00000100:00100000:2.0:1789760540.363907:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798095104:12345-0@lo:400: Request processed in 133us (4183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.363914:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760540.363927:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760540.363933:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798095616:12345-0@lo:400: 00000100:00100000:2.0:1789760540.363959:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798095616:12345-0@lo:400: Request processed in 27us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.363964:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760540.363974:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760540.363980:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798094976:12345-0@lo:400: 00000100:00100000:2.0:1789760540.364007:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798094976:12345-0@lo:400: Request processed in 27us (3946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.364012:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760540.364022:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760540.364027:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798095488:12345-0@lo:400: 00000100:00100000:2.0:1789760540.365587:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798095488:12345-0@lo:400: Request processed in 1553us (5487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.365671:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760540.367771:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760540.367818:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798095872:0@lo:13: 00000100:00100000:2.0:1789760540.367929:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.367995:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798095872 00000100:00100000:2.0:1789760540.368002:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798095872 00000100:00100000:2.0:1789760540.368043:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789760540.368051:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798095872:12345-0@lo:13: 00002000:00000024:2.0:1789760540.368074:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760540.369700:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798095872:12345-0@lo:13: Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.369715:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789760540.369772:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543284e00 x1876699798095872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760540.369807:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798095872:0@lo:13: 00000100:00100000:2.0:1789760540.369853:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798094464:0@lo:400: 00010000:00080000:2.0:1789760540.369866:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546385180 x1876699798094976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760540.369875:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798094976:0@lo:400: 00010000:00080000:2.0:1789760540.369886:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d7100 x1876699798095488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760540.369893:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798095488:0@lo:400: 00000100:00100000:2.0:1789760540.369902:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798094336:0@lo:400: 00010000:00080000:2.0:1789760540.369912:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546385500 x1876699798094848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760540.369918:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798094848:0@lo:400: 00010000:00080000:2.0:1789760540.369928:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d4a80 x1876699798095360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760540.369951:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798095360:0@lo:400: 00000100:00100000:2.0:1789760540.369986:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798094080:0@lo:400: 00000100:00100000:2.0:1789760540.369998:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798094592:0@lo:400: 00010000:00080000:2.0:1789760540.370008:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546385880 x1876699798095104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760540.370016:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798095104:0@lo:400: 00010000:00080000:2.0:1789760540.370026:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d6680 x1876699798095616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760540.370032:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798095616:0@lo:400: 00000100:00100000:2.0:1789760540.370045:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798094208:0@lo:400: 00000100:00100000:2.0:1789760540.370055:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798094720:0@lo:400: 00000100:00100000:2.0:1789760540.370064:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798095232:0@lo:400: 00000100:00080000:3.0:1789760540.370567:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760540.370572:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760540.370575:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760540.370578:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760540.871296:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798096000:0@lo:41: 00000100:00100000:3.0:1789760540.871375:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760540.871524:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798096000 00000100:00100000:2.0:1789760540.871531:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798096000 00000100:00100000:2.0:1789760540.871581:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760540.871715:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798096000:12345-0@lo:41: 00000004:00000024:2.0:1789760540.871751:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760540.871817:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798096000:12345-0@lo:41: Request processed in 106us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760540.871823:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760540.871862:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798096000:0@lo:41: 00010000:00010000:3.0:1789760541.192905:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760541.383334:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798096128:0@lo:41: 00000100:00100000:1.0:1789760541.383405:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760541.383567:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798096128 00000100:00100000:3.0:1789760541.383575:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798096128 00000100:00100000:3.0:1789760541.383653:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789760541.383663:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798096128:12345-0@lo:41: 00000004:00000024:3.0:1789760541.383701:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760541.406495:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798096128:12345-0@lo:41: Request processed in 22824us (23080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760541.406510:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789760541.406674:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798096128:0@lo:41: 00000100:00100000:0.0:1789760541.895864:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760541.895886:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798096256:0@lo:13: 00000100:00100000:2.0:1789760541.896112:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760541.896122:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798096384:0@lo:13: 00000100:00100000:2.0:1789760541.897007:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760541.899175:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760541.899238:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798096384 00000100:00100000:0.0:1789760541.899247:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798096384 00000100:00100000:0.0:1789760541.899284:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798096256 00000100:00100000:0.0:1789760541.899294:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798096256 00000100:00100000:0.0:1789760541.899314:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760541.899322:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798096384:12345-0@lo:13: 00002000:00000024:0.0:1789760541.899357:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760541.899417:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798096384:12345-0@lo:13: Request processed in 97us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760541.899424:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760541.899439:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789760541.899445:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798096256:12345-0@lo:13: 00002000:00000024:0.0:1789760541.899453:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760541.899478:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798096256:12345-0@lo:13: Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760541.899484:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789760541.899531:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d6680 x1876699798096384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760541.899550:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798096384:0@lo:13: 00010000:00080000:0.0:1789760541.899870:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543285f80 x1876699798096256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760541.899885:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798096256:0@lo:13: 00000020:00000080:1.0:1789760542.163192:0:9892:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd08879c00 20000000:00000080:1.0:1789760542.163209:0:9892:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e579c72800 uarg=0000000000000000 20000000:01000000:1.0:1789760542.163240:0:9892:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789760542.163248:0:9892:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789760542.163251:0:9892:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789760542.163255:0:9892:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789760542.163260:0:9892:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789760542.163272:0:9892:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789760542.163274:0:9892:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789760542.163432:0:9892:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789760542.163434:0:9892:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789760542.164536:0:9893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789760542.165105:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789760542.165150:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789760542.165192:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789760542.165203:0:9892:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789760542.165206:0:9892:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789760542.166019:0:9894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789760542.167446:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789760542.167534:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789760542.167568:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1789760542.167583:0:9892:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789760542.167586:0:9892:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789760542.168613:0:9895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789760542.169115:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789760542.169166:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789760542.169197:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789760542.169208:0:9892:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789760542.169210:0:9892:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789760542.173546:0:9896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1789760542.175917:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1789760542.175980:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1789760542.176035:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1789760542.176053:0:9892:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789760542.176056:0:9892:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789760542.177489:0:9897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1789760542.177937:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1789760542.177982:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1789760542.178026:0:9892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1789760542.178043:0:9892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789760542.178062:0:9892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178080:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178088:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178095:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178102:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178109:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178117:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178130:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178137:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178143:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178153:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 9 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178160:0:9892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 9 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178168:0:9892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178202:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 9 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178216:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 9 pid: 6459 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.178231:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798096512:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760542.178327:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 9 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.178335:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 9 pid: 6460 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.178950:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798096640:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760542.179035:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179044:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 23 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179054:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798096768:0@lo:104: 00000100:00100000:2.0:1789760542.179086:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760542.179117:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179125:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 23 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179132:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798096896:0@lo:104: 00000100:00100000:2.0:1789760542.179149:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760542.179175:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179183:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 23 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179191:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097024:0@lo:104: 00000100:00100000:2.0:1789760542.179207:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760542.179220:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179239:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 23 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179258:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097152:0@lo:104: 00000100:00100000:2.0:1789760542.179282:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760542.179296:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179304:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 23 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179311:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097280:0@lo:104: 00010000:00010000:2.0:1789760542.179329:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179336:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 23 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179344:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097408:0@lo:104: 00010000:00010000:2.0:1789760542.179371:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179379:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 23 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179386:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097536:0@lo:104: 00010000:00010000:2.0:1789760542.179408:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179426:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 23 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179434:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097664:0@lo:104: 00010000:00010000:2.0:1789760542.179465:0:9892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.179473:0:9892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 23 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.179481:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097792:0@lo:104: 00000100:00100000:2.0:1789760542.179496:0:9892:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760542.179744:0:6448:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789760542.179763:0:6448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.179775:0:6448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.179783:0:6448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.179816:0:6448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.179824:0:6448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.179831:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798096768 00000100:00100000:0.0:1789760542.179837:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798096768 00000100:00100000:0.0:1789760542.179873:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798096896 00000100:00100000:0.0:1789760542.179875:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798096896 00000100:00100000:0.0:1789760542.179883:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798097024 00000100:00100000:0.0:1789760542.179885:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798097024 00000100:00100000:0.0:1789760542.179893:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798097152 00000100:00100000:0.0:1789760542.179895:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798097152 00000100:00100000:0.0:1789760542.179902:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798097280 00000100:00100000:0.0:1789760542.179904:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798097280 00000100:00100000:0.0:1789760542.179911:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798097408 00000100:00100000:0.0:1789760542.179913:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798097408 00000100:00100000:0.0:1789760542.179920:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798097536 00000100:00100000:0.0:1789760542.179922:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798097536 00000100:00100000:0.0:1789760542.179929:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798097664 00000100:00100000:0.0:1789760542.179930:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798097664 00000100:00100000:0.0:1789760542.179937:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798097792 00000100:00100000:0.0:1789760542.179939:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798097792 00000100:00100000:0.0:1789760542.179950:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789760542.179957:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:9892:x1876699798096768:12345-0@lo:104: 00010000:00010000:0.0:1789760542.179968:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180021:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760542.180027:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+11:9892:x1876699798096768:12345-0@lo:104: Request processed in 71us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180034:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789760542.180049:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789760542.180054:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:9892:x1876699798096896:12345-0@lo:104: 00010000:00010000:0.0:1789760542.180061:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180088:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760542.180096:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+10:9892:x1876699798096896:12345-0@lo:104: Request processed in 42us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180102:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789760542.180112:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789760542.180117:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:9892:x1876699798097024:12345-0@lo:104: 00010000:00010000:0.0:1789760542.180124:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180151:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789760542.180155:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+9:9892:x1876699798097024:12345-0@lo:104: Request processed in 38us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180160:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789760542.180169:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789760542.180174:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e448e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+8:9892:x1876699798097152:12345-0@lo:104: 00010000:00010000:0.0:1789760542.180180:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180201:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789760542.180205:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e448e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+8:9892:x1876699798097152:12345-0@lo:104: Request processed in 31us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180210:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789760542.180237:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789760542.180249:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+7:9892:x1876699798097280:12345-0@lo:104: 00010000:00010000:0.0:1789760542.180256:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180277:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789760542.180286:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+7:9892:x1876699798097280:12345-0@lo:104: Request processed in 43us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180291:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789760542.180301:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789760542.180306:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:9892:x1876699798097408:12345-0@lo:104: 00010000:00010000:0.0:1789760542.180312:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180333:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789760542.180342:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:9892:x1876699798097408:12345-0@lo:104: Request processed in 36us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180354:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789760542.180365:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789760542.180370:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:9892:x1876699798097536:12345-0@lo:104: 00010000:00010000:0.0:1789760542.180376:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180397:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789760542.180401:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:9892:x1876699798097536:12345-0@lo:104: Request processed in 31us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180406:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789760542.180415:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789760542.180419:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:9892:x1876699798097664:12345-0@lo:104: 00010000:00010000:0.0:1789760542.180426:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180444:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1789760542.180453:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:9892:x1876699798097664:12345-0@lo:104: Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180459:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789760542.180469:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760542.180474:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:9892:x1876699798097792:12345-0@lo:104: 00010000:00010000:0.0:1789760542.180480:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180500:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1789760542.180504:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:9892:x1876699798097792:12345-0@lo:104: Request processed in 31us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.180509:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789760542.180523:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1789760542.180528:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180535:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483600 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.180540:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180548:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.180555:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.180561:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.180584:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180611:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.180628:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180636:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541483600/0xc2b9a3a739856bd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856bd9 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180649:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1789760542.180661:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180667:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ec00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.180670:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180677:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.180683:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.180688:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.180699:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180705:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.180716:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180723:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ec00/0xc2b9a3a739856ba8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856baf expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180736:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789760542.180739:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180744:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d2e00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.180747:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180754:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.180760:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.180765:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.180775:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180780:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.180811:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180818:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5413d2e00/0xc2b9a3a739856b8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b93 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180827:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789760542.180829:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180844:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8f800 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.180847:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180853:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.180860:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.180865:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.180876:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180881:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.180886:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180892:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856b62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b69 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180901:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789760542.180903:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180909:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8f000 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.180912:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180926:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.180933:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.180938:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.180947:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180952:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.180956:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180962:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856b46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b4d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180970:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789760542.180973:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180979:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483a00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.180982:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.180987:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.180994:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.181002:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.181011:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181016:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.181020:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181027:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541483a00/0xc2b9a3a739856b38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b3f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181034:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789760542.181037:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181042:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541482600 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.181045:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181052:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.181058:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.181062:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.181070:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181075:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.181082:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181089:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856b2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856b31 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181098:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760542.181101:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181107:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486ddc00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.181110:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181116:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.181123:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.181128:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.181137:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181142:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.181145:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181151:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856aeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856af2 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181162:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760542.181169:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181174:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d3000 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760542.181177:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181184:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760542.181190:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760542.181196:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760542.181205:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181211:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760542.181215:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181221:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5413d3000/0xc2b9a3a739856ac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ac8 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.181232:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760542.181233:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760542.181236:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760542.181244:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760542.181263:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798097920:0@lo:103: 00000100:00100000:0.0:1789760542.181297:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.181315:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798098432:0@lo:103: 00000100:00100000:0.0:1789760542.181338:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.181350:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798098944:0@lo:103: 00000100:00100000:0.0:1789760542.181366:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.181380:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789760542.181385:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798098304:0@lo:103: 00000100:00100000:2.0:1789760542.182089:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798096768:0@lo:104: 00000100:00100000:2.0:1789760542.182101:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798096896:0@lo:104: 00000100:00100000:2.0:1789760542.182108:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097024:0@lo:104: 00000100:00100000:2.0:1789760542.182116:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097152:0@lo:104: 00000100:00100000:2.0:1789760542.182124:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097280:0@lo:104: 00000100:00100000:2.0:1789760542.182131:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097408:0@lo:104: 00000100:00100000:2.0:1789760542.182138:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097536:0@lo:104: 00000100:00100000:2.0:1789760542.182145:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097664:0@lo:104: 00000100:00100000:2.0:1789760542.182153:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798097792:0@lo:104: 00000100:00100000:1.0:1789760542.182364:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760542.182556:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798096512:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760542.183057:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798098048:0@lo:103: 00000100:00100000:1.0:1789760542.183106:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760542.183129:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798098560:0@lo:103: 00000100:00100000:1.0:1789760542.183144:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760542.183156:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789760542.183161:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798098176:0@lo:103: 00000100:00100000:1.0:1789760542.183188:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760542.183196:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798098688:0@lo:103: 00000100:00100000:1.0:1789760542.183212:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760542.184641:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760542.184851:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798097920 00000100:00100000:1.0:1789760542.184861:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798097920 00010000:00010000:1.0:1789760542.184895:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 24 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.184916:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798098432 00000100:00100000:1.0:1789760542.184919:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798098432 00010000:00010000:1.0:1789760542.184927:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 25 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.184937:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798098944 00000100:00100000:1.0:1789760542.184939:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798098944 00010000:00010000:1.0:1789760542.184946:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 26 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.184955:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777077888 00000100:00100000:1.0:1789760542.184957:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777077888 00010000:00010000:1.0:1789760542.184967:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 10 pid: 6459 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.184976:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798098048 00000100:00100000:1.0:1789760542.184978:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798098048 00010000:00010000:1.0:1789760542.184987:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 27 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.184996:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798098560 00000100:00100000:1.0:1789760542.184998:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798098560 00010000:00010000:1.0:1789760542.185006:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 28 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.185029:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798098176 00000100:00100000:1.0:1789760542.185031:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798098176 00010000:00010000:1.0:1789760542.185040:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 29 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.185049:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798098688 00000100:00100000:1.0:1789760542.185051:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798098688 00010000:00010000:1.0:1789760542.185060:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 30 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.185083:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789760542.185091:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545671850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+30:3462:x1876699798097920:12345-0@lo:103: 00010000:00010000:1.0:1789760542.185103:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760542.185108:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 30 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.185117:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 30 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.185133:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8ee00/0xc2b9a3a739856bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856bd2 expref: 30 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.185147:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760542.185187:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545671850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+29:3462:x1876699798097920:12345-0@lo:103: Request processed in 97us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760542.185194:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789760542.185232:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760542.185238:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+28:3462:x1876699798098432:12345-0@lo:103: 00000100:00100000:2.0:1789760542.185444:0:6450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789760542.185457:0:6450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789760542.185718:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760542.185723:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 28 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.185733:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 28 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.185743:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856b4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856b46 expref: 28 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.185752:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760542.185774:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+27:3462:x1876699798098432:12345-0@lo:103: Request processed in 536us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760542.185780:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789760542.185843:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789760542.185851:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+26:3462:x1876699798098944:12345-0@lo:103: 00010000:00010000:2.0:1789760542.185859:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760542.185863:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 26 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.185872:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 26 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.185881:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5413d2800/0xc2b9a3a739856ac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856ac1 expref: 26 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.185890:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760542.185913:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+25:3462:x1876699798098944:12345-0@lo:103: Request processed in 64us (4546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760542.185919:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789760542.185933:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1789760542.185938:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777077888:12345-192.168.203.38@tcp:103: 00010000:00010000:2.0:1789760542.185945:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760542.185949:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 10 pid: 6459 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.185959:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 10 pid: 6459 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.185968:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856bee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116fc expref: 10 pid: 6459 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.185986:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760542.186020:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c9a29f0-58a4-4591-8db4-e258df357379+9:2404:x1876699777077888:12345-192.168.203.38@tcp:103: Request processed in 81us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760542.186026:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1789760542.186037:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789760542.186042:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798098048:12345-0@lo:103: 00010000:00010000:2.0:1789760542.186048:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760542.186053:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 24 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.186061:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 24 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.186080:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856baf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856ba8 expref: 24 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.186088:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760542.186112:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:3463:x1876699798098048:12345-0@lo:103: Request processed in 70us (3006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760542.186117:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789760542.186128:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760542.186133:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:3463:x1876699798098560:12345-0@lo:103: 00010000:00010000:2.0:1789760542.186139:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760542.186143:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 22 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.186151:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 22 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.186165:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856b3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856b38 expref: 22 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.186173:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760542.186190:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:3463:x1876699798098560:12345-0@lo:103: Request processed in 58us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760542.186195:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760542.186206:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789760542.186211:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:3463:x1876699798098176:12345-0@lo:103: 00010000:00010000:2.0:1789760542.186217:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760542.186221:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 20 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.186229:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 20 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.186238:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e4486dc800/0xc2b9a3a739856b93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856b8c expref: 20 pid: 6459 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760542.186322:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.186415:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798098816:0@lo:103: 00000100:00100000:0.0:1789760542.186444:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760542.186474:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798097920:0@lo:103: 00000100:00100000:0.0:1789760542.186482:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798098432:0@lo:103: 00000100:00100000:0.0:1789760542.186488:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798098944:0@lo:103: 00000100:00100000:0.0:1789760542.186640:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798098304 00000100:00100000:0.0:1789760542.186646:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798098304 00000100:00100000:1.0:1789760542.186775:0:6452:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789760542.186782:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798098816 00000100:00100000:1.0:1789760542.186799:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798098816 00010000:00010000:1.0:1789760542.186814:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 22 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.186827:0:6452:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789760542.186833:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760542.186838:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545671c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:3463:x1876699798098688:12345-0@lo:103: 00010000:00010000:1.0:1789760542.186844:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760542.186848:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 22 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.186857:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 22 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.186877:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856b31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856b2a expref: 22 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.186887:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760542.186909:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545671c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:3463:x1876699798098688:12345-0@lo:103: Request processed in 72us (3696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760542.186915:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760542.186926:0:6452:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789760542.186931:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789760542.186936:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:3462:x1876699798098816:12345-0@lo:103: 00010000:00010000:1.0:1789760542.186942:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760542.186946:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 20 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.186953:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 20 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.186963:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856af2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856aeb expref: 20 pid: 6460 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.186971:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760542.186992:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:3462:x1876699798098816:12345-0@lo:103: Request processed in 56us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760542.186997:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789760542.187023:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798098816:0@lo:103: 00000100:00100000:1.0:1789760542.187041:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798098688:0@lo:103: 00000100:00100000:1.0:1789760542.187053:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798098048:0@lo:103: 00000100:00100000:1.0:1789760542.187066:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798098560:0@lo:103: 00010000:00010000:2.0:1789760542.187130:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760542.187159:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:3463:x1876699798098176:12345-0@lo:103: Request processed in 948us (3970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760542.187164:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789760542.187871:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 16 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760542.187891:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789760542.187897:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:3462:x1876699798098304:12345-0@lo:103: 00010000:00010000:0.0:1789760542.187905:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760542.187909:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 16 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.187918:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 16 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.187930:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e541483000/0xc2b9a3a739856b69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856b62 expref: 16 pid: 6457 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.187946:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760542.187971:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:3462:x1876699798098304:12345-0@lo:103: Request processed in 75us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760542.187977:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760542.188459:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760542.188477:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777078016 00000100:00100000:2.0:1789760542.188482:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777078016 00010000:00010000:2.0:1789760542.188497:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 9 pid: 6460 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.188524:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1789760542.188530:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c9a29f0-58a4-4591-8db4-e258df357379+9:2403:x1876699777078016:12345-192.168.203.38@tcp:103: 00010000:00010000:2.0:1789760542.188537:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760542.188541:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 9 pid: 6460 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188550:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 9 pid: 6460 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188562:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188570:0:6451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188601:0:6451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188609:0:6451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188616:0:6451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188622:0:6451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188628:0:6451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8f200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760542.188633:0:6451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188645:0:6451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.188765:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798098304:0@lo:103: 00000100:00100000:1.0:1789760542.188811:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798098176:0@lo:103: 00010000:00010000:2.0:1789760542.188929:0:6451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.188939:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760542.188971:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c9a29f0-58a4-4591-8db4-e258df357379+9:2403:x1876699777078016:12345-192.168.203.38@tcp:103: Request processed in 440us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760542.188977:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00010000:00010000:2.0:1789760542.189451:0:9892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e4486dce00/0xc2b9a3a739856be7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652116f5 expref: 8 pid: 6460 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760542.189462:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9892:1876699798096640:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760542.189504:0:9892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.189513:0:9892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.189520:0:9892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760542.189526:0:9892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8f200/0xc2b9a3a739856c2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760542.216899:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760543.244140:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760543.788397:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760543.788440:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760543.788475:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760543.788573:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777078528 00000100:00100000:0.0:1789760543.788591:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777078528 00000100:00100000:0.0:1789760543.788647:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:0.0:1789760543.788656:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777078528:12345-192.168.203.38@tcp:400: 00000100:00100000:0.0:1789760543.788720:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777078528:12345-192.168.203.38@tcp:400: Request processed in 65us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760543.788728:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00080000:0.0:1789760543.788764:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760543.788867:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777078272 00000100:00100000:2.0:1789760543.788872:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777078272 00000100:00100000:2.0:1789760543.788912:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:2.0:1789760543.788931:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777078272:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1789760543.788956:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777078272:12345-192.168.203.38@tcp:400: Request processed in 28us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760543.788963:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1789760543.789274:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760543.789303:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760543.789389:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777078400 00000100:00100000:2.0:1789760543.789394:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777078400 00000100:00100000:2.0:1789760543.789425:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1789760543.789431:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777078400:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1789760543.789460:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777078400:12345-192.168.203.38@tcp:400: Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760543.789466:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1789760543.789481:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777078656 00000100:00100000:2.0:1789760543.789484:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777078656 00000100:00100000:2.0:1789760543.789502:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:2.0:1789760543.789508:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777078656:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1789760543.789527:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777078656:12345-192.168.203.38@tcp:400: Request processed in 20us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760543.789533:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00080000:0.0:1789760543.789913:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760543.789917:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760543.789919:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760543.791179:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777078144 00000100:00100000:1.0:1789760543.791188:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777078144 00000100:00100000:1.0:1789760543.791271:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1789760543.791281:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+8:2405:x1876699777078144:12345-192.168.203.38@tcp:400: 00000100:00100000:1.0:1789760543.791337:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+8:2405:x1876699777078144:12345-192.168.203.38@tcp:400: Request processed in 58us (2861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760543.791344:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 196 10000000:01000000:0.0:1789760544.199453:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789760544.199465:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e4489b2000 from 48 10000000:01000000:0.0:1789760544.199473:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760544.199543:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486dc200/0xc2b9a3a739856c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.199557:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e4486dc200/0xc2b9a3a739856c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.199581:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e4486dc200/0xc2b9a3a739856c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760544.200156:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099072:0@lo:101: 00000100:00100000:0.0:1789760544.201009:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760544.201090:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57b2cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.203676:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798099072 00000100:00100000:2.0:1789760544.203691:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798099072 00000100:00100000:2.0:1789760544.203757:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789760544.203767:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+15:6462:x1876699798099072:12345-0@lo:101: 00010000:00010000:2.0:1789760544.203823:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760544.203842:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856c3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856c34 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.203888:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856c34 expref: 16 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.203899:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8ea00/0xc2b9a3a739856c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856c34 expref: 16 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.203909:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8ea00, rc 0) 00000100:00100000:2.0:1789760544.204003:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798099072:12345-0@lo:101: Request processed in 237us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.204013:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789760544.204087:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099072:0@lo:101: 00010000:00010000:0.0:1789760544.204120:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e4486dc200/0xc2b9a3a739856c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c3b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.204133:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e4486dc200/0xc2b9a3a739856c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856c3b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760544.204290:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099200:0@lo:501: 00000100:00100000:0.0:1789760544.204363:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760544.205004:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57b2cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760544.208106:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798099200 00000100:00100000:1.0:1789760544.208127:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798099200 00000100:00100000:1.0:1789760544.208217:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789760544.209047:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798099200:12345-0@lo:501: 00000100:00100000:1.0:1789760544.211621:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798099200:12345-0@lo:501: Request processed in 3374us (7238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760544.211636:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789760544.218155:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099200:0@lo:501: 00000100:00100000:0.0:1789760544.218258:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099328:0@lo:503: 00000100:00100000:0.0:1789760544.218366:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760544.218426:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57b2cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.225261:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798099328 00000100:00100000:2.0:1789760544.225277:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798099328 00000100:00100000:2.0:1789760544.225344:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789760544.225354:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798099328:12345-0@lo:503: 00000100:00100000:2.0:1789760544.225625:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798099328:12345-0@lo:503: Request processed in 272us (7258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.225634:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789760544.225736:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099328:0@lo:503: 00000100:00100000:2.0:1789760544.227470:0:9912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9912:1876699798099456:0@lo:502: 00000100:00100000:2.0:1789760544.227569:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.227630:0:9912:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760544.227739:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798099456 00000100:00100000:1.0:1789760544.227748:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798099456 00000100:00100000:1.0:1789760544.227843:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789760544.228091:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9912:x1876699798099456:12345-0@lo:502: 00000100:00100000:1.0:1789760544.228625:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9912:x1876699798099456:12345-0@lo:502: Request processed in 537us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760544.228634:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789760544.229150:0:9912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9912:1876699798099456:0@lo:502: 00000100:00100000:2.0:1789760544.231821:0:9912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9912:1876699798099584:0@lo:502: 00000100:00100000:2.0:1789760544.232585:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.232651:0:9912:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.232861:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798099584 00000100:00100000:0.0:1789760544.232873:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798099584 00000100:00100000:0.0:1789760544.232937:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789760544.232948:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9912:x1876699798099584:12345-0@lo:502: 00000100:00100000:0.0:1789760544.233356:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:9912:x1876699798099584:12345-0@lo:502: Request processed in 408us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760544.233375:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789760544.233769:0:9912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9912:1876699798099584:0@lo:502: 00000040:00080000:2.0:1789760544.233883:0:9912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789760544.234770:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789760544.234858:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760544.234873:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486dc200/0xc2b9a3a739856c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c3b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.234887:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e4486dc200/0xc2b9a3a739856c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c3b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760544.234899:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789760544.234903:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789760544.234907:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789760544.234951:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486dd800/0xc2b9a3a739856c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.234960:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e4486dd800/0xc2b9a3a739856c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.234972:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e4486dd800/0xc2b9a3a739856c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760544.234998:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099712:0@lo:101: 00000100:00100000:0.0:1789760544.235070:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760544.235123:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57b2cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760544.235393:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798099712 00000100:00100000:1.0:1789760544.235423:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798099712 00000100:00100000:1.0:1789760544.235483:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789760544.235493:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+16:6462:x1876699798099712:12345-0@lo:101: 00010000:00010000:1.0:1789760544.235508:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760544.235525:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e57fd8fa00/0xc2b9a3a739856c49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856c42 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.235554:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e57fd8fa00/0xc2b9a3a739856c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856c42 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.235566:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e57fd8fa00/0xc2b9a3a739856c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856c42 expref: 17 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.235584:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8fa00, rc 0) 00000100:00100000:1.0:1789760544.237136:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798099712:12345-0@lo:101: Request processed in 1630us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760544.237150:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789760544.238290:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099712:0@lo:101: 00010000:00010000:2.0:1789760544.238325:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e4486dd800/0xc2b9a3a739856c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c49 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.238340:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e4486dd800/0xc2b9a3a739856c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856c49 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760544.238457:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099840:0@lo:501: 00000100:00100000:2.0:1789760544.238525:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.238567:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.238812:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798099840 00000100:00100000:0.0:1789760544.238822:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798099840 00000100:00100000:0.0:1789760544.238900:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789760544.238910:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798099840:12345-0@lo:501: 00000100:00100000:0.0:1789760544.240567:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798099840:12345-0@lo:501: Request processed in 1648us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760544.240606:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789760544.241149:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099840:0@lo:501: 00000100:00100000:2.0:1789760544.241490:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099968:0@lo:503: 00000100:00100000:2.0:1789760544.241569:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.241630:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.242055:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798099968 00000100:00100000:0.0:1789760544.242064:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798099968 00000100:00100000:0.0:1789760544.242129:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789760544.242141:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798099968:12345-0@lo:503: 00000100:00100000:0.0:1789760544.243485:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798099968:12345-0@lo:503: Request processed in 1340us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760544.243497:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789760544.243668:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798099968:0@lo:503: 00000100:00100000:1.0:1789760544.246049:0:9913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9913:1876699798100096:0@lo:502: 00000100:00100000:1.0:1789760544.246165:0:9913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.246215:0:9913:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.246327:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798100096 00000100:00100000:0.0:1789760544.246337:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798100096 00000100:00100000:0.0:1789760544.246457:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789760544.246468:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9913:x1876699798100096:12345-0@lo:502: 00000100:00100000:1.0:1789760544.249025:0:9913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9913:1876699798100096:0@lo:502: 00000020:01000000:1.0:1789760544.249088:0:9913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760544.249103:0:9913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760544.249107:0:9913:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789760544.249117:0:9913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789760544.249167:0:9913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9913:1876699798100224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760544.249496:0:9913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.249550:0:9913:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.249740:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798100224 00000100:00100000:2.0:1789760544.249749:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798100224 00000100:00100000:2.0:1789760544.249869:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789760544.249881:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9913:x1876699798100224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760544.250140:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9913:x1876699798100224:12345-0@lo:502:llog_process_th.0 Request processed in 261us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.250149:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789760544.251292:0:9913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9913:1876699798100224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760544.251350:0:9913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760544.251364:0:9913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760544.251378:0:9913:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789760544.251385:0:9913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789760544.251625:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789760544.251663:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789760544.251676:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486dd800/0xc2b9a3a739856c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c49 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.251688:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e4486dd800/0xc2b9a3a739856c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c49 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760544.251708:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789760544.251711:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e44128d800 from 48 10000000:01000000:1.0:1789760544.251715:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760544.251761:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e57fd8e000/0xc2b9a3a739856c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.251769:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e57fd8e000/0xc2b9a3a739856c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.251781:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e57fd8e000/0xc2b9a3a739856c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760544.251833:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798100352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.251919:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.251968:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.251979:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:9913:x1876699798100096:12345-0@lo:502: Request processed in 5509us (5811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760544.251991:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789760544.252085:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798100352 00000100:00100000:0.0:1789760544.252092:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798100352 00000100:00100000:0.0:1789760544.252130:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789760544.252138:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+17:6462:x1876699798100352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760544.252152:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760544.252165:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dc000/0xc2b9a3a739856c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856c50 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.252191:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dc000/0xc2b9a3a739856c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856c50 expref: 18 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.252202:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dc000/0xc2b9a3a739856c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856c50 expref: 18 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.252224:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dc000, rc 0) 00000100:00100000:0.0:1789760544.252259:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798100352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760544.252265:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789760544.252529:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798100352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760544.252544:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e57fd8e000/0xc2b9a3a739856c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c57 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.252554:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e57fd8e000/0xc2b9a3a739856c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856c57 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760544.252649:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798100480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.253105:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.253144:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.253272:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798100480 00000100:00100000:3.0:1789760544.253279:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798100480 00000100:00100000:3.0:1789760544.253323:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789760544.253332:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798100480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.253728:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798100480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 397us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.253736:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789760544.253781:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798100480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.253870:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798100608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.253919:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.253936:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.253949:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798100608 00000100:00100000:3.0:1789760544.253953:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798100608 00000100:00100000:3.0:1789760544.253974:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789760544.253981:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798100608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.254155:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798100608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.254162:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789760544.254201:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798100608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.254417:0:9914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9914:1876699798100736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.254452:0:9914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.254472:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798100736 00000100:00100000:3.0:1789760544.254477:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798100736 00000100:00100000:3.0:1789760544.254494:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789760544.254500:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9914:x1876699798100736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.254698:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9914:x1876699798100736:12345-0@lo:502:llog_process_th.0 Request processed in 196us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.254705:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789760544.254735:0:9914:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.254748:0:9914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9914:1876699798100736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.254808:0:9914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9914:1876699798100864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.254854:0:9914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.254873:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798100864 00000100:00100000:3.0:1789760544.254877:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798100864 00000100:00100000:3.0:1789760544.254894:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789760544.254900:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9914:x1876699798100864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.254998:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:9914:x1876699798100864:12345-0@lo:502:llog_process_th.0 Request processed in 97us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.255005:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789760544.255037:0:9914:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.255049:0:9914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9914:1876699798100864:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789760544.255069:0:9914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789760544.255122:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789760544.255143:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760544.255153:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e57fd8e000/0xc2b9a3a739856c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c57 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.255166:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e57fd8e000/0xc2b9a3a739856c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c57 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760544.255176:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789760544.255180:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789760544.255183:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789760544.255213:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.255222:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.255232:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760544.255244:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798100992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.255272:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.255286:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.255298:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798100992 00000100:00100000:3.0:1789760544.255301:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798100992 00000100:00100000:3.0:1789760544.255317:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789760544.255323:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+18:6462:x1876699798100992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760544.255337:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760544.255351:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541482a00/0xc2b9a3a739856c65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856c5e expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.255375:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541482a00/0xc2b9a3a739856c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856c5e expref: 19 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.255386:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541482a00/0xc2b9a3a739856c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856c5e expref: 19 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.255395:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541482a00, rc 0) 00000100:00100000:3.0:1789760544.255423:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798100992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.255429:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789760544.255457:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798100992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760544.255468:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856c5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c65 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.255478:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856c5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856c65 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760544.255519:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.255543:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.255556:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.255567:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798101120 00000100:00100000:3.0:1789760544.255570:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798101120 00000100:00100000:3.0:1789760544.255599:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789760544.255605:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798101120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.255883:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798101120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.255889:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789760544.255918:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.255942:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.255977:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.255991:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.256003:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798101248 00000100:00100000:3.0:1789760544.256007:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798101248 00000100:00100000:3.0:1789760544.256024:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789760544.256030:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798101248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.256169:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798101248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.256175:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789760544.256210:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.256452:0:9915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9915:1876699798101376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.256486:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.256505:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798101376 00000100:00100000:3.0:1789760544.256508:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798101376 00000100:00100000:3.0:1789760544.256526:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789760544.256532:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:9915:x1876699798101376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760544.258360:0:9915:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.259488:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:9915:x1876699798101376:12345-0@lo:502:llog_process_th.0 Request processed in 2947us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.259503:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789760544.260047:0:9915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9915:1876699798101376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760544.260179:0:9915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760544.260192:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760544.260195:0:9915:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789760544.260202:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789760544.261326:0:9915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9915:1876699798101504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.261498:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.261622:0:9915:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.262122:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798101504 00000100:00100000:0.0:1789760544.262134:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798101504 00000100:00100000:1.0:1789760544.262456:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789760544.262470:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:9915:x1876699798101504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760544.263192:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:9915:x1876699798101504:12345-0@lo:502:llog_process_th.0 Request processed in 720us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760544.263202:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789760544.263596:0:9915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9915:1876699798101504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760544.264028:0:9915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760544.264039:0:9915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760544.264042:0:9915:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789760544.264049:0:9915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00010000:00010000:2.0:1789760544.264564:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789760544.264602:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789760544.267105:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789760544.267126:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856c5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c65 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.267142:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541483e00/0xc2b9a3a739856c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c65 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760544.267255:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789760544.267260:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e544828000 from 48 10000000:01000000:1.0:1789760544.267264:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760544.267321:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ee00/0xc2b9a3a739856c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.267330:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ee00/0xc2b9a3a739856c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.267344:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ee00/0xc2b9a3a739856c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760544.267390:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543284000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.267486:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.267537:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f2a0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.267722:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798101632 00000100:00100000:2.0:1789760544.267734:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798101632 00000100:00100000:2.0:1789760544.267813:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789760544.267825:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+19:6462:x1876699798101632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760544.267853:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760544.267871:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8e000/0xc2b9a3a739856c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856c6c expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.267903:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8e000/0xc2b9a3a739856c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856c6c expref: 20 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.267916:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8e000/0xc2b9a3a739856c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856c6c expref: 20 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.267925:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e000, rc 0) 00000100:00100000:2.0:1789760544.267974:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798101632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.267981:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789760544.268532:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543284000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760544.268553:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ee00/0xc2b9a3a739856c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c73 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.268564:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ee00/0xc2b9a3a739856c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856c73 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760544.268672:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760544.268736:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760544.268772:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760544.268859:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798101760 00000100:00100000:1.0:1789760544.268865:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798101760 00000100:00100000:1.0:1789760544.268898:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789760544.268906:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798101760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.269248:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798101760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760544.269255:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789760544.269405:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760544.269440:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760544.269488:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760544.269512:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.269880:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798101888 00000100:00100000:2.0:1789760544.269887:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798101888 00000100:00100000:2.0:1789760544.269918:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789760544.269926:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798101888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.270107:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798101888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.270114:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789760544.270315:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798101888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760544.271152:0:9916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9916:1876699798102016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760544.271217:0:9916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760544.271256:0:9916:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.271304:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798102016 00000100:00100000:2.0:1789760544.271311:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798102016 00000100:00100000:2.0:1789760544.271354:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789760544.271362:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:9916:x1876699798102016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760544.272008:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:9916:x1876699798102016:12345-0@lo:502:llog_process_th.0 Request processed in 645us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.272016:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789760544.272112:0:9916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9916:1876699798102016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760544.272161:0:9916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9916:1876699798102144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760544.272199:0:9916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760544.272267:0:9916:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789760544.273157:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798102144 00000100:00100000:1.0:1789760544.273167:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798102144 00000100:00100000:1.0:1789760544.273248:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789760544.273258:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:9916:x1876699798102144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760544.273489:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:9916:x1876699798102144:12345-0@lo:502:llog_process_th.0 Request processed in 233us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760544.273497:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789760544.273588:0:9916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9916:1876699798102144:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789760544.273633:0:9916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789760544.274015:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789760544.274042:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760544.274055:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ee00/0xc2b9a3a739856c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c73 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.274068:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e57fd8ee00/0xc2b9a3a739856c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c73 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760544.274079:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789760544.274083:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789760544.274086:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789760544.274127:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.274136:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.274147:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760544.274178:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798102272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.274229:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.275176:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.275276:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798102272 00000100:00100000:2.0:1789760544.275286:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798102272 00000100:00100000:2.0:1789760544.275338:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789760544.275349:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798102272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760544.275366:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760544.275398:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856c7a expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.275430:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856c7a expref: 21 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.275443:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8e800/0xc2b9a3a739856c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856c7a expref: 21 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.275454:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e800, rc 0) 00000100:00100000:2.0:1789760544.275524:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798102272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.275531:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789760544.276044:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798102272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760544.276066:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856c7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c81 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.276077:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856c7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856c81 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760544.276160:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798102400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.276201:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.276225:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.276379:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798102400 00000100:00100000:2.0:1789760544.276385:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798102400 00000100:00100000:2.0:1789760544.276409:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789760544.276417:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798102400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.277324:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798102400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 904us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.277334:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789760544.277470:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798102400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.277526:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798102528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.277585:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.277630:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8eb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.278039:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798102528 00000100:00100000:3.0:1789760544.278046:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798102528 00000100:00100000:3.0:1789760544.278080:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789760544.278088:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798102528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.278283:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798102528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.278290:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789760544.278384:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798102528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.279360:0:9917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9917:1876699798102656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760544.280190:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.280509:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798102656 00000100:00100000:1.0:1789760544.280520:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798102656 00000100:00100000:3.0:1789760544.280607:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789760544.280632:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9917:x1876699798102656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.281236:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9917:x1876699798102656:12345-0@lo:502:llog_process_th.0 Request processed in 606us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.281245:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789760544.281319:0:9917:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8ebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.281346:0:9917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9917:1876699798102656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760544.281465:0:9917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760544.281476:0:9917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760544.281479:0:9917:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789760544.281487:0:9917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789760544.281526:0:9917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9917:1876699798102784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.281584:0:9917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.281616:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798102784 00000100:00100000:3.0:1789760544.281622:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798102784 00000100:00100000:3.0:1789760544.281997:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789760544.282007:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9917:x1876699798102784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760544.282174:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:9917:x1876699798102784:12345-0@lo:502:llog_process_th.0 Request processed in 169us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.282181:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789760544.282221:0:9917:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.282236:0:9917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9917:1876699798102784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760544.282258:0:9917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760544.282263:0:9917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760544.282265:0:9917:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789760544.282270:0:9917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789760544.282548:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789760544.282584:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789760544.282598:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856c7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c81 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.282622:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541482000/0xc2b9a3a739856c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c81 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760544.282634:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789760544.282646:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e546616000 from 48 10000000:01000000:2.0:1789760544.282650:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789760544.283057:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f200/0xc2b9a3a739856c88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.283071:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8f200/0xc2b9a3a739856c88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.283085:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8f200/0xc2b9a3a739856c88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760544.283112:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798102912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.283211:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.283257:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.283282:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798102912 00000100:00100000:2.0:1789760544.283289:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798102912 00000100:00100000:2.0:1789760544.283325:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789760544.283332:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798102912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760544.283345:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760544.283360:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856c8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856c88 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.284094:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856c88 expref: 22 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.284109:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8f600/0xc2b9a3a739856c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856c88 expref: 22 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.284120:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8f600, rc 0) 00000100:00100000:2.0:1789760544.284181:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798102912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 848us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.284189:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789760544.284289:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798102912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760544.284308:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8f200/0xc2b9a3a739856c88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c8f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.284329:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8f200/0xc2b9a3a739856c88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856c8f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760544.284975:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.285021:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.285062:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760544.285175:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798103040 00000100:00100000:1.0:1789760544.285182:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798103040 00000100:00100000:1.0:1789760544.285226:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789760544.285236:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798103040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.286650:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.287102:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760544.287174:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760544.287213:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760544.287331:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798103040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1132us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760544.287343:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789760544.287487:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798103168 00000100:00100000:2.0:1789760544.287497:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798103168 00000100:00100000:2.0:1789760544.287555:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789760544.287565:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798103168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.288458:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798103168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 890us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.288467:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789760544.288553:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.293114:0:9918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9918:1876699798103296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760544.293245:0:9918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.293301:0:9918:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.293626:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798103296 00000100:00100000:0.0:1789760544.293643:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798103296 00000100:00100000:0.0:1789760544.293726:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789760544.293738:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:9918:x1876699798103296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760544.294296:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:9918:x1876699798103296:12345-0@lo:502:llog_process_th.0 Request processed in 559us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760544.294306:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789760544.294485:0:9918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9918:1876699798103296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760544.294558:0:9918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9918:1876699798103424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760544.294610:0:9918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.294656:0:9918:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.294734:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798103424 00000100:00100000:2.0:1789760544.294748:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798103424 00000100:00100000:2.0:1789760544.294818:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789760544.294826:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:9918:x1876699798103424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760544.295158:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:9918:x1876699798103424:12345-0@lo:502:llog_process_th.0 Request processed in 332us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.295168:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789760544.295252:0:9918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9918:1876699798103424:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789760544.295273:0:9918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789760544.295642:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789760544.295664:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789760544.295676:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f200/0xc2b9a3a739856c88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c8f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.295689:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8f200/0xc2b9a3a739856c88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c8f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760544.295711:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789760544.295714:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789760544.295718:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789760544.295751:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.295760:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.295771:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760544.295819:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.296043:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.296079:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.296136:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798103552 00000100:00100000:0.0:1789760544.296143:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798103552 00000100:00100000:0.0:1789760544.296184:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789760544.296194:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798103552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760544.296207:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760544.296230:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dda00/0xc2b9a3a739856c9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856c96 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.296257:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dda00/0xc2b9a3a739856c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856c96 expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.296269:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dda00/0xc2b9a3a739856c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856c96 expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760544.296279:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dda00, rc 0) 00000100:00100000:0.0:1789760544.296321:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798103552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760544.296327:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789760544.296694:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760544.296769:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856c96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c9d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.296781:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856c96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856c9d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760544.296968:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.297001:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.297032:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760544.298984:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798103680 00000100:00100000:0.0:1789760544.299002:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798103680 00000100:00100000:0.0:1789760544.299074:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789760544.299086:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798103680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760544.300260:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798103680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1169us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760544.300272:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789760544.300568:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.300665:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.300736:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.300769:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.301050:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798103808 00000100:00100000:2.0:1789760544.301058:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798103808 00000100:00100000:2.0:1789760544.301117:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789760544.301127:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798103808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.301343:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798103808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.301351:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789760544.302184:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798103808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.303679:0:9919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9919:1876699798103936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760544.304105:0:9919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.304157:0:9919:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.304233:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798103936 00000100:00100000:2.0:1789760544.304242:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798103936 00000100:00100000:2.0:1789760544.304301:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789760544.304312:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:9919:x1876699798103936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760544.304693:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:9919:x1876699798103936:12345-0@lo:502:llog_process_th.0 Request processed in 381us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.304712:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789760544.305356:0:9919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9919:1876699798103936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760544.305412:0:9919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760544.305425:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760544.305429:0:9919:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789760544.305437:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789760544.305477:0:9919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9919:1876699798104064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760544.305539:0:9919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.305582:0:9919:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.306041:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798104064 00000100:00100000:2.0:1789760544.306051:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798104064 00000100:00100000:2.0:1789760544.306113:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789760544.306135:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:9919:x1876699798104064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760544.307055:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:9919:x1876699798104064:12345-0@lo:502:llog_process_th.0 Request processed in 913us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760544.307069:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789760544.308205:0:9919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:9919:1876699798104064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760544.308343:0:9919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760544.308357:0:9919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760544.308361:0:9919:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789760544.308452:0:9919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789760544.309201:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789760544.309307:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789760544.309324:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856c96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c9d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.309339:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8f000/0xc2b9a3a739856c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856c9d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760544.309354:0:6462:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789760544.309358:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e550c219b8 from 1 10000000:01000000:2.0:1789760544.309362:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789760544.309498:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.309509:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760544.309522:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760544.309557:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798104192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.310103:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760544.310213:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f8eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1789760544.310342:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798104192 00000100:00100000:3.0:1789760544.310353:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798104192 00000100:00100000:3.0:1789760544.310541:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789760544.310554:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798104192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760544.310584:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760544.310624:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541483000/0xc2b9a3a739856cab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856ca4 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.310679:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541483000/0xc2b9a3a739856cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856ca4 expref: 24 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.310693:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541483000/0xc2b9a3a739856cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856ca4 expref: 24 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760544.310741:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541483000, rc 0) 00000100:00100000:3.0:1789760544.310887:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798104192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 335us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760544.310896:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789760544.311133:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798104192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760544.311168:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856ca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cab expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.311180:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856ca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856cab expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760544.311295:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798104320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760544.311344:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760544.314362:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760544.315084:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798104320 00000100:00100000:2.0:1789760544.315099:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798104320 00000100:00100000:2.0:1789760544.315197:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789760544.315208:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798104320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760544.316117:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798104320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 906us (4768us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760544.316129:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789760544.316389:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798104320:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789760544.316447:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789760544.316462:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856ca4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cab expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760544.316474:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8f800/0xc2b9a3a739856ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cab expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760545.287006:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760545.480367:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798104448:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.480441:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798104704:0@lo:400:kworker.0 00000100:00100000:1.0:1789760545.480458:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760545.480521:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798104960:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.480531:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760545.480700:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798104704 00000100:00100000:3.0:1789760545.480711:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798104704 00000100:00100000:2.0:1789760545.480726:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798104448 00000100:00100000:2.0:1789760545.480735:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798104448 00000100:00100000:3.0:1789760545.480835:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760545.480836:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789760545.480858:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798104704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760545.480859:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798104448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.485561:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798104576:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.485667:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.485714:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798105088:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.485739:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.485802:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798105600:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.485830:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.485851:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798106112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760545.485878:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.485939:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798104576 00000100:00100000:0.0:1789760545.485949:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798104576 00000100:00100000:0.0:1789760545.486007:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798105088 00000100:00100000:0.0:1789760545.486011:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798105088 00000100:00100000:0.0:1789760545.486036:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798105600 00000100:00100000:0.0:1789760545.486038:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798105600 00000100:00100000:0.0:1789760545.486056:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789760545.486065:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798104576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.486132:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798104576:12345-0@lo:400:kworker.0 Request processed in 67us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.486140:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789760545.486160:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789760545.486166:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.486196:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798105088:12345-0@lo:400:kworker.0 Request processed in 31us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.486307:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789760545.486323:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789760545.486330:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798105600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.486363:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798105600:12345-0@lo:400:kworker.0 Request processed in 34us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.486369:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789760545.486389:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798106112 00000100:00100000:0.0:1789760545.486393:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798106112 00000100:00100000:0.0:1789760545.486434:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760545.486441:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798106112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760545.486477:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760545.486587:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798106112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.486594:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789760545.486612:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760545.486617:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760545.486896:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798104576:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.486912:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798105088:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.486923:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798105600:0@lo:400:kworker.0 00010000:00080000:0.0:1789760545.486937:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543285500 x1876699798106112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760545.486956:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798106112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760545.487006:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798105216:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.487037:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.487057:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798105728:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.487074:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.487084:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798106240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760545.487104:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.487136:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789760545.487144:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798104832:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.487186:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.487472:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798105344:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.487642:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.487665:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798105856:0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.487687:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.487724:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798105344 00000100:00100000:0.0:1789760545.487730:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798105344 00000100:00100000:0.0:1789760545.487776:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798105856 00000100:00100000:0.0:1789760545.487779:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798105856 00000100:00100000:0.0:1789760545.487822:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760545.487830:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798105344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.487878:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798105344:12345-0@lo:400:kworker.0 Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.487884:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760545.487899:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760545.487906:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798105856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.487934:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798105856:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.487940:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789760545.487960:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760545.487969:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798106240 00000100:00100000:0.0:1789760545.487973:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798106240 00000100:00100000:0.0:1789760545.488001:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789760545.488006:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798106240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760545.488019:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760545.488048:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798106240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.488055:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789760545.488069:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760545.488087:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798105216 00000100:00100000:0.0:1789760545.488091:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798105216 00000100:00100000:0.0:1789760545.488116:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798105728 00000100:00100000:0.0:1789760545.488119:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798105728 00000100:00100000:0.0:1789760545.488130:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798104832 00000100:00100000:0.0:1789760545.488133:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798104832 00000100:00100000:0.0:1789760545.488146:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789760545.488151:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798105216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.488184:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798105216:12345-0@lo:400:kworker.0 Request processed in 33us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.488191:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789760545.488553:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789760545.488573:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798105728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.488609:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798105728:12345-0@lo:400:kworker.0 Request processed in 49us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.488615:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789760545.488629:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789760545.488635:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798104832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.488665:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798104832:12345-0@lo:400:kworker.0 Request processed in 29us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.488671:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789760545.488692:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760545.488719:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760545.488741:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798104832:0@lo:400:kworker.0 00010000:00080000:0.0:1789760545.488773:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f094700 x1876699798105344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760545.488781:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798105472:0@lo:400:kworker.0 00000100:00100000:1.0:1789760545.488847:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760545.488871:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798105984:0@lo:400:kworker.0 00000100:00100000:1.0:1789760545.488895:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760545.488968:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798105472 00000100:00100000:1.0:1789760545.488977:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798105472 00000100:00100000:1.0:1789760545.489026:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798105984 00000100:00100000:1.0:1789760545.489029:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798105984 00000100:00100000:1.0:1789760545.489045:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760545.489055:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798105472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.489078:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798105344:0@lo:400:kworker.0 00010000:00080000:0.0:1789760545.489122:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f096a00 x1876699798105856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760545.489132:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798105856:0@lo:400:kworker.0 00010000:00080000:0.0:1789760545.489146:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f095f80 x1876699798105216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760545.489154:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798105216:0@lo:400:kworker.0 00010000:00080000:0.0:1789760545.489165:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f094a80 x1876699798105728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760545.489173:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798105728:0@lo:400:kworker.0 00010000:00080000:0.0:1789760545.489185:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a187b80 x1876699798106240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760545.489255:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798106240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760545.489314:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760545.489323:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798105984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760545.489383:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798105984:12345-0@lo:400:kworker.0 Request processed in 62us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.489390:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789760545.489411:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760545.489431:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad2300 x1876699798105984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760545.489440:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798105984:0@lo:400:kworker.0 00000100:00100000:2.0:1789760545.490186:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798104448:12345-0@lo:400:kworker.0 Request processed in 9329us (9733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760545.490198:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789760545.490871:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798105472:12345-0@lo:400:kworker.0 Request processed in 1815us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760545.490880:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789760545.491914:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798104448:0@lo:400:kworker.0 00010000:00080000:2.0:1789760545.491940:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f095c00 x1876699798105472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760545.492052:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798105472:0@lo:400:kworker.0 00000100:00100000:2.0:1789760545.492120:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798104960 00000100:00100000:2.0:1789760545.492128:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798104960 00000100:00100000:2.0:1789760545.492178:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760545.492192:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798104960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760545.492277:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798104960:12345-0@lo:400:kworker.0 Request processed in 90us (3565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760545.492284:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760545.492531:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798104960:0@lo:400:kworker.0 00000100:00100000:2.0:1789760545.492599:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798104704:12345-0@lo:400:kworker.0 Request processed in 11751us (12075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760545.492618:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789760545.492670:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798104704:0@lo:400:kworker.0 00000100:00100000:3.0:1789760545.595056:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760545.595266:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777078784 00000100:00100000:0.0:1789760545.595300:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777078784 00000100:00100000:0.0:1789760545.595377:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:0.0:1789760545.595389:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+8:6392:x1876699777078784:12345-192.168.203.38@tcp:101: 00010000:00010000:0.0:1789760545.595414:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760545.595440:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dd200/0xc2b9a3a739856cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521176c expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760545.595492:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dd200/0xc2b9a3a739856cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521176c expref: 9 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760545.595506:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dd200/0xc2b9a3a739856cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521176c expref: 9 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760545.595518:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dd200, rc 0) 00000100:00100000:0.0:1789760545.595612:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+9:6392:x1876699777078784:12345-192.168.203.38@tcp:101: Request processed in 224us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.595620:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:3.0:1789760545.602647:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760545.611091:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777078912 00000100:00100000:1.0:1789760545.611113:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777078912 00000100:00100000:2.0:1789760545.611539:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00100000:2.0:1789760545.611554:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+9:6392:x1876699777078912:12345-192.168.203.38@tcp:501: 00000100:00100000:2.0:1789760545.612105:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+9:6392:x1876699777078912:12345-192.168.203.38@tcp:501: Request processed in 551us (9468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760545.612115:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00100000:1.0:1789760545.614527:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760545.615913:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777079040 00000100:00100000:2.0:1789760545.615930:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777079040 00000100:00100000:2.0:1789760545.616002:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:2.0:1789760545.616195:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+9:6392:x1876699777079040:12345-192.168.203.38@tcp:503: 00000100:00100000:2.0:1789760545.616540:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+9:6392:x1876699777079040:12345-192.168.203.38@tcp:503: Request processed in 351us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760545.616551:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:3.0:1789760545.620705:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760545.621941:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777079168 00000100:00100000:2.0:1789760545.621956:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777079168 00000100:00100000:2.0:1789760545.622021:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 243 00000100:00100000:2.0:1789760545.622031:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+9:6883:x1876699777079168:12345-192.168.203.38@tcp:502: 00000100:00100000:2.0:1789760545.622459:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+9:6883:x1876699777079168:12345-192.168.203.38@tcp:502: Request processed in 427us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760545.622469:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 243 00000100:00100000:3.0:1789760545.625001:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760545.625244:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777079296 00000100:00100000:2.0:1789760545.625256:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777079296 00000100:00100000:2.0:1789760545.625325:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 244 00000100:00100000:2.0:1789760545.625338:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+9:6883:x1876699777079296:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789760545.625685:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+9:6883:x1876699777079296:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 350us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760545.625694:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 244 00000100:00100000:1.0:1789760545.628989:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760545.629200:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777079424 00000100:00100000:0.0:1789760545.629213:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777079424 00000100:00100000:0.0:1789760545.629283:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 245 00000100:00100000:0.0:1789760545.629294:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+9:6392:x1876699777079424:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760545.629315:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760545.629341:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e4486dd400/0xc2b9a3a739856cb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211773 expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760545.629376:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e4486dd400/0xc2b9a3a739856cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211773 expref: 10 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760545.629389:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e4486dd400/0xc2b9a3a739856cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211773 expref: 10 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760545.629431:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dd400, rc 0) 00000100:00100000:0.0:1789760545.629502:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6392:x1876699777079424:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 209us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760545.629510:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 245 00000100:00100000:0.0:1789760545.633928:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760545.634044:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777079552 00000100:00100000:3.0:1789760545.634058:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777079552 00000100:00100000:3.0:1789760545.634138:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 246 00000100:00100000:3.0:1789760545.634151:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:6392:x1876699777079552:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760545.636127:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:6392:x1876699777079552:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 1963us (2325us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760545.636148:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 246 00000100:00100000:1.0:1789760545.992699:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798106368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760545.992832:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760545.994081:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798106368 00000100:00100000:2.0:1789760545.994100:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798106368 00000100:00100000:2.0:1789760545.994195:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789760545.994207:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798106368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760545.994574:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760545.994682:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798106368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 475us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760545.994690:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789760545.995130:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798106368:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789760546.311162:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760546.505029:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760546.505074:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798106496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760546.505178:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760546.505458:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798106496 00000100:00100000:2.0:1789760546.505470:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798106496 00000100:00100000:2.0:1789760546.505554:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760546.505575:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798106496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760546.505645:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760546.505709:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798106496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760546.505717:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789760546.507303:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798106496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760547.017517:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798106624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760547.017531:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760547.017547:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798106752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760547.030510:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760547.030613:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798106752 00000100:00100000:3.0:1789760547.030625:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798106752 00000100:00100000:3.0:1789760547.030708:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760547.030721:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798106752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760547.030773:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789760547.030834:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760547.030852:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798106752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760547.030859:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789760547.030870:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543286300 x1876699798106752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760547.030894:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798106752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760547.031938:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760547.032326:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798106624 00000100:00100000:2.0:1789760547.032337:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798106624 00000100:00100000:2.0:1789760547.033490:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789760547.033504:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798106624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760547.033545:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760547.033658:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798106624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760547.033666:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789760547.033754:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad1180 x1876699798106624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760547.033781:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798106624:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789760547.035463:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760547.335424:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789760547.833201:0:9958:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd2330ed0 20000000:00000080:2.0:1789760547.833220:0:9958:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e57f728800 uarg=0000000000000000 20000000:01000000:2.0:1789760547.833259:0:9958:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789760547.833266:0:9958:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789760547.833271:0:9958:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789760547.834361:0:9959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789760547.834499:0:9958:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789760547.857425:0:9958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789760547.857483:0:9958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789760547.857555:0:9958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789760547.857572:0:9958:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789760547.857591:0:9958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.857608:0:9958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e540030400/0xc2b9a3a739856971 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.857616:0:9958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.857632:0:9958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.857652:0:9958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856add expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.857662:0:9958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 9 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.857669:0:9958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.857710:0:9958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 9 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.857727:0:9958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 9 pid: 6460 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.857741:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798106880:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760547.858104:0:9958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856add expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.858114:0:9958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856add expref: 23 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.858123:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798107008:0@lo:104: 00000100:00100000:2.0:1789760547.858163:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760547.858426:0:9958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.858435:0:9958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 23 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.858456:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798107136:0@lo:104: 00000100:00100000:2.0:1789760547.858492:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760547.858514:0:6448:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789760547.858524:0:9958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760547.858527:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798107008 00010000:00010000:2.0:1789760547.858532:0:9958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 23 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760547.858533:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798107008 00000100:00100000:2.0:1789760547.858539:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798107264:0@lo:104: 00000100:00100000:2.0:1789760547.858569:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760547.858576:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798107136 00000100:00100000:1.0:1789760547.858584:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798107136 00000100:00100000:1.0:1789760547.858597:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798107264 00000100:00100000:1.0:1789760547.858608:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798107264 00000100:00100000:1.0:1789760547.858625:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789760547.858633:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:9958:x1876699798107008:12345-0@lo:104: 00010000:00010000:1.0:1789760547.858643:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.858948:0:9958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e540030400/0xc2b9a3a739856971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 23 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.858957:0:9958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e540030400/0xc2b9a3a739856971 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 23 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.858966:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798107392:0@lo:104: 00010000:00010000:1.0:1789760547.864499:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760547.864516:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:9958:x1876699798107008:12345-0@lo:104: Request processed in 5879us (6348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760547.864527:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789760547.864573:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789760547.864585:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:9958:x1876699798107136:12345-0@lo:104: 00010000:00010000:3.0:1789760547.864615:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760547.864623:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.864639:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d3a00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760547.864643:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.864652:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760547.864660:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760547.864665:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760547.864706:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.864712:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760547.864733:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.864740:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856add lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ae4 expref: -99 pid: 9064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.864753:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760547.864755:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760547.864756:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760547.864773:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789760547.864775:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760547.864808:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798107520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760547.864839:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760547.864845:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:9958:x1876699798107136:12345-0@lo:104: Request processed in 265us (6352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760547.864851:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789760547.864866:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760547.864884:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760547.864890:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:9958:x1876699798107264:12345-0@lo:104: 00010000:00010000:1.0:1789760547.864898:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760547.864978:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789760547.864985:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:9958:x1876699798107264:12345-0@lo:104: Request processed in 95us (6415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760547.864991:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760547.867720:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760547.867773:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798107520 00000100:00100000:0.0:1789760547.867782:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798107520 00010000:00010000:0.0:1789760547.867843:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856add expref: 24 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760547.867873:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777079680 00000100:00100000:0.0:1789760547.867877:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777079680 00010000:00010000:0.0:1789760547.867890:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 10 pid: 6460 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760547.867909:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760547.867918:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798107520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760547.867931:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760547.867937:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856add expref: 24 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760547.867947:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856add expref: 24 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760547.867992:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760547.868043:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798107520:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760547.868050:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760547.868068:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:0.0:1789760547.868074:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777079680:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760547.868083:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760547.868088:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 10 pid: 6460 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760547.868099:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 10 pid: 6460 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760547.868110:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760547.868143:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777079680:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 68us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760547.868150:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1789760547.868956:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760547.869062:0:9958:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e56c76f240 going to sleep for 11 seconds 00010000:00010000:2.0:1789760547.869088:0:9958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856bfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211734 expref: 9 pid: 6460 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.869103:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798106880:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760547.869116:0:9958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e4486dc400/0xc2b9a3a739856ae4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856add expref: 23 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.869125:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798107008:0@lo:104: 00000100:00100000:2.0:1789760547.869135:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798107136:0@lo:104: 00000100:00100000:2.0:1789760547.869155:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798107264:0@lo:104: 00000100:00100000:0.0:1789760547.869272:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798107392 00000100:00100000:0.0:1789760547.869279:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798107392 00000100:00100000:0.0:1789760547.869317:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789760547.869326:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:9958:x1876699798107392:12345-0@lo:104: 00010000:00010000:0.0:1789760547.869338:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.869421:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9958:1876699798107392:0@lo:104: 00010000:00010000:2.0:1789760547.869450:0:9958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.870334:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798107520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760547.871054:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789760547.871064:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871074:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541482800 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760547.871078:0:6453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871088:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760547.871094:0:6453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760547.871099:0:6453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760547.871148:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871156:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760547.871179:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871186:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a7398569b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a7398569be expref: -99 pid: 8108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760547.871223:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798107648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760547.871272:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760547.871317:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760547.871321:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871336:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030a00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760547.871339:0:6453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871345:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760547.871351:0:6453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760547.871355:0:6453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760547.871382:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871388:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760547.871410:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871417:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e540030a00/0xc2b9a3a739856978 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985697f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760547.871431:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760547.871439:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798107776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760547.871465:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760547.871484:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760547.871489:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871495:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c7a00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760547.871503:0:6453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871509:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760547.871515:0:6453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760547.871520:0:6453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760547.871536:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871542:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760547.871569:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.871576:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e5820c7a00/0xc2b9a3a73985696a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856971 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760547.871597:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798107904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760547.871631:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760547.871664:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760547.871667:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760547.871668:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760547.871910:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798107648 00000100:00100000:2.0:1789760547.871917:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798107648 00010000:00010000:2.0:1789760547.871943:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 23 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.871974:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798107776 00000100:00100000:2.0:1789760547.871985:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798107776 00010000:00010000:2.0:1789760547.871996:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 24 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760547.872008:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798107904 00000100:00100000:2.0:1789760547.872011:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798107904 00010000:00010000:2.0:1789760547.872020:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e540030400/0xc2b9a3a739856971 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 25 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760547.872032:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760547.872042:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+25:3463:x1876699798107648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760547.872055:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760547.872061:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 25 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.872082:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 25 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.872097:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e5820c6000/0xc2b9a3a7398569be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a7398569b7 expref: 25 pid: 6460 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760547.872109:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760547.872141:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798107648:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (869us total) trans 0 rc 0/0 00010000:00010000:1.0:1789760547.872363:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760547.877339:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789760547.877359:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:9958:x1876699798107392:12345-0@lo:104: Request processed in 8029us (8399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760547.877388:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789760547.877456:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760547.878011:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789760547.878025:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545670450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798107776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760547.878043:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760547.878052:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 24 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878066:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 24 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878095:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e541483800/0xc2b9a3a73985697f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856978 expref: 24 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878109:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760547.878172:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545670450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:3463:x1876699798107776:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (6706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760547.878180:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789760547.878197:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789760547.878215:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:3461:x1876699798107904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760547.878223:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760547.878227:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e540030400/0xc2b9a3a739856971 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 22 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878237:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e540030400/0xc2b9a3a739856971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 22 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878248:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e540030400/0xc2b9a3a739856971 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a73985696a expref: 22 pid: 6459 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878259:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878266:0:6451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878280:0:6451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878288:0:6451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878301:0:6451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878307:0:6451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878313:0:6451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760547.878317:0:6451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878325:0:6451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878341:0:6451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878351:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760547.878380:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:3461:x1876699798107904:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (6748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760547.878387:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1789760547.878412:0:9958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878419:0:9958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760547.878426:0:9958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8f400/0xc2b9a3a739856cc0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760547.881074:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760547.881191:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798107776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760547.881318:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798107648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760547.881424:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798107904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760548.369229:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760548.912327:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760548.912373:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760548.912411:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760548.912440:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760548.912471:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777080320 00000100:00100000:0.0:1789760548.912480:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777080320 00000100:00100000:0.0:1789760548.912534:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1789760548.912556:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777080320:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760548.912630:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777080320:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.912637:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1789760548.912659:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777080064 00000100:00100000:0.0:1789760548.912663:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777080064 00000100:00100000:0.0:1789760548.912689:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777079936 00000100:00100000:0.0:1789760548.912692:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777079936 00000100:00100000:0.0:1789760548.912717:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:0.0:1789760548.912726:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777080064:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760548.912763:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777080064:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.912770:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:0.0:1789760548.912812:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1789760548.912822:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777079936:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760548.912848:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777079936:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.912871:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00080000:0.0:1789760548.912888:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760548.912892:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760548.912894:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760548.913100:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777079808 00000100:00100000:2.0:1789760548.913111:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777079808 00000100:00100000:2.0:1789760548.913157:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 247 00000100:00100000:2.0:1789760548.913166:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+9:2405:x1876699777079808:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760548.913207:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+9:2405:x1876699777079808:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 43us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760548.913214:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 247 00000100:00100000:3.0:1789760548.917708:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760548.917817:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777080192 00000100:00100000:2.0:1789760548.917829:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777080192 00000100:00100000:2.0:1789760548.917902:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1789760548.917914:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777080192:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760548.917985:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777080192:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 73us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760548.917992:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00080000:3.0:1789760548.918131:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760549.042251:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760549.042286:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777080448 00000100:00100000:3.0:1789760549.043436:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777080448 00000100:00100000:3.0:1789760549.043804:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 248 00000100:00100000:3.0:1789760549.043815:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+9:6392:x1876699777080448:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760549.043832:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760549.045646:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521177a expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.045685:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 10 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.045713:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 10 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.045724:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541482800, rc 0) 00000100:00100000:3.0:1789760549.045806:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6392:x1876699777080448:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 1992us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760549.045815:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 248 10000000:01000000:3.0:1789760549.065209:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789760549.065218:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e4489b2000 from 4 10000000:01000000:3.0:1789760549.065225:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760549.065281:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.065293:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.065305:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760549.065329:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760549.065396:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.065454:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5502d33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760549.065567:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798108032 00000100:00100000:1.0:1789760549.065575:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798108032 00000100:00100000:1.0:1789760549.065625:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789760549.065635:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798108032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760549.065649:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760549.065663:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856cce expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760549.065687:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760549.065697:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 21 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760549.065705:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f400, rc 0) 00000100:00100000:1.0:1789760549.065741:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798108032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760549.065747:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789760549.065888:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760549.065903:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.065911:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760549.065973:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760549.065997:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.066024:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5502d33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760549.067774:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798108160 00000100:00100000:1.0:1789760549.067798:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798108160 00000100:00100000:1.0:1789760549.067849:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789760549.067860:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798108160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760549.068153:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798108160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760549.068160:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789760549.068249:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.068303:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.068368:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.068405:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e56c76fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760549.068459:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798108288 00000100:00100000:0.0:1789760549.068464:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798108288 00000100:00100000:0.0:1789760549.068500:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789760549.068508:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798108288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760549.069183:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798108288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 676us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760549.069192:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789760549.069235:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.069498:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760549.069524:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777080576 00000100:00100000:2.0:1789760549.069529:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777080576 00000100:00100000:2.0:1789760549.069579:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 252 00000100:00100000:2.0:1789760549.069588:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:6392:x1876699777080576:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.069822:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:6392:x1876699777080576:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 234us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.069831:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 252 00000100:00100000:1.0:1789760549.072395:0:10021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10021:1876699798108416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760549.072475:0:10021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760549.072523:0:10021:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448ceb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.072586:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798108416 00000100:00100000:2.0:1789760549.072594:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798108416 00000100:00100000:2.0:1789760549.072639:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789760549.072648:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:10021:x1876699798108416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.072890:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:10021:x1876699798108416:12345-0@lo:502:llog_process_th.0 Request processed in 242us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.072898:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789760549.072990:0:10021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10021:1876699798108416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760549.073031:0:10021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760549.073041:0:10021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760549.073043:0:10021:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789760549.073053:0:10021:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e4489b2000 00000020:00000080:1.0:1789760549.073056:0:10021:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789760549.073128:0:10021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10021:1876699798108544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760549.073158:0:10021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760549.073171:0:10021:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448ceb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.075615:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798108544 00000100:00100000:2.0:1789760549.075625:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798108544 00000100:00100000:2.0:1789760549.075672:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789760549.075681:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:10021:x1876699798108544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.075961:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:10021:x1876699798108544:12345-0@lo:502:llog_process_th.0 Request processed in 280us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.075969:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789760549.076039:0:10021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543286300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10021:1876699798108544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760549.076074:0:10021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760549.076082:0:10021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760549.076084:0:10021:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789760549.076089:0:10021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789760549.076146:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789760549.076165:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760549.076174:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.076185:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760549.076196:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789760549.076206:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e44128d800 from 4 10000000:01000000:2.0:1789760549.076209:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760549.076246:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.076254:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.076264:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760549.076283:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.076320:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.076349:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e56c76ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.076363:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798108672 00000100:00100000:2.0:1789760549.076366:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798108672 00000100:00100000:2.0:1789760549.076390:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789760549.076397:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798108672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760549.076405:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760549.076417:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856cdc expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.076438:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 22 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.076448:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 22 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.076456:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e400, rc 0) 00000100:00100000:2.0:1789760549.076482:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798108672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.076493:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789760549.076524:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760549.076534:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.076630:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760549.076670:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.076694:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.076712:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e56c76ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.076723:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798108800 00000100:00100000:2.0:1789760549.076726:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798108800 00000100:00100000:2.0:1789760549.076746:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789760549.076752:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798108800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.076980:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798108800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.076987:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789760549.077021:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.077050:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.077095:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.077111:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e56c76ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.077121:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798108928 00000100:00100000:2.0:1789760549.077124:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798108928 00000100:00100000:2.0:1789760549.077143:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789760549.077154:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798108928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.077262:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798108928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.077269:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789760549.077301:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798108928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760549.082188:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760549.082219:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777080704 00000100:00100000:2.0:1789760549.082230:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777080704 00000100:00100000:2.0:1789760549.082277:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 258 00000100:00100000:2.0:1789760549.082290:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6392:x1876699777080704:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760549.082384:0:10023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10023:1876699798109056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760549.082447:0:10023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.082480:0:10023:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5502d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.082500:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6392:x1876699777080704:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 212us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.082508:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 258 00000100:00100000:2.0:1789760549.082532:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798109056 00000100:00100000:2.0:1789760549.082731:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798109056 00000100:00100000:2.0:1789760549.082753:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789760549.082761:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:10023:x1876699798109056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760549.087034:0:10023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10023:1876699798109056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760549.087073:0:10023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760549.087083:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760549.087085:0:10023:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789760549.087092:0:10023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e44128d800 00000020:00000080:3.0:1789760549.087094:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789760549.087176:0:10023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10023:1876699798109184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.094344:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:10023:x1876699798109056:12345-0@lo:502:llog_process_th.0 Request processed in 11569us (11882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.094359:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789760549.100316:0:10023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.100363:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798109184 00000100:00100000:2.0:1789760549.100373:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798109184 00000100:00100000:2.0:1789760549.100424:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789760549.100435:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:10023:x1876699798109184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.100668:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:10023:x1876699798109184:12345-0@lo:502:llog_process_th.0 Request processed in 235us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.100687:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789760549.100861:0:10023:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5502d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.100885:0:10023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10023:1876699798109184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760549.100915:0:10023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760549.100923:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760549.100926:0:10023:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789760549.100930:0:10023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789760549.101070:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789760549.101086:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760549.101096:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.101108:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760549.101118:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789760549.101121:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e544828000 from 4 10000000:01000000:2.0:1789760549.101124:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760549.101152:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.101161:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.101170:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760549.101189:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798109312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.101223:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.101250:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544f4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.101262:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798109312 00000100:00100000:2.0:1789760549.101267:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798109312 00000100:00100000:2.0:1789760549.101297:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789760549.101304:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798109312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760549.101313:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760549.101326:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856cea expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.101348:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.101358:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.101366:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8fa00, rc 0) 00000100:00100000:2.0:1789760549.101398:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798109312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.101406:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789760549.101443:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798109312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760549.101454:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.101462:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760549.101504:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798109440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.101527:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.101570:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544f4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.101582:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798109440 00000100:00100000:2.0:1789760549.101586:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798109440 00000100:00100000:2.0:1789760549.101609:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789760549.101615:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798109440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.102078:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798109440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 461us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.102087:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789760549.108670:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798109440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.108738:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798109568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.108824:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.108862:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544f4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.108889:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798109568 00000100:00100000:2.0:1789760549.108895:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798109568 00000100:00100000:2.0:1789760549.108940:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789760549.108949:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798109568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.109147:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798109568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.109156:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789760549.109208:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798109568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.113287:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760549.114051:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777080832 00000100:00100000:1.0:1789760549.114065:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777080832 00000100:00100000:1.0:1789760549.114129:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:1.0:1789760549.114141:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6946:x1876699777080832:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789760549.114399:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:6946:x1876699777080832:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 259us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760549.114409:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:2.0:1789760549.114773:0:10027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10027:1876699798109696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.114895:0:10027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.114920:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798109696 00000100:00100000:2.0:1789760549.114925:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798109696 00000100:00100000:2.0:1789760549.114957:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789760549.114964:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:10027:x1876699798109696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.115163:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:10027:x1876699798109696:12345-0@lo:502:llog_process_th.0 Request processed in 198us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.115170:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789760549.115214:0:10027:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544f4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.115234:0:10027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10027:1876699798109696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760549.115263:0:10027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760549.115273:0:10027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760549.115275:0:10027:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789760549.115282:0:10027:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e544828000 00000020:00000080:2.0:1789760549.115284:0:10027:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789760549.115642:0:10027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10027:1876699798109824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.115679:0:10027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.115694:0:10027:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544f4b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760549.115775:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798109824 00000100:00100000:1.0:1789760549.115781:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798109824 00000100:00100000:2.0:1789760549.115954:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789760549.115963:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:10027:x1876699798109824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.116244:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:10027:x1876699798109824:12345-0@lo:502:llog_process_th.0 Request processed in 282us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.116251:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789760549.117125:0:10027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10027:1876699798109824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760549.117161:0:10027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760549.117168:0:10027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760549.117169:0:10027:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789760549.117174:0:10027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789760549.117285:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789760549.117313:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760549.117323:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.117334:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760549.117344:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789760549.117347:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e546616000 from 4 10000000:01000000:2.0:1789760549.117350:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760549.117381:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.117389:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.117398:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760549.117416:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798109952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.117473:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.117511:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544f4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.117531:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798109952 00000100:00100000:2.0:1789760549.117547:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798109952 00000100:00100000:2.0:1789760549.117581:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789760549.117590:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798109952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760549.117601:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760549.119372:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856cf8 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.119493:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 24 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.119692:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 24 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.119704:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e200, rc 0) 00000100:00100000:2.0:1789760549.119773:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798109952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2183us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.119782:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789760549.119861:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798109952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760549.119877:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.119886:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760549.119948:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798110080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.119990:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.120019:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544f4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.121178:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798110080 00000100:00100000:2.0:1789760549.121188:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798110080 00000100:00100000:2.0:1789760549.121237:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789760549.121247:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798110080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.121927:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798110080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 680us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.121945:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789760549.121996:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798110080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.122042:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798110208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.122086:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760549.122104:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e544f4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.122120:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798110208 00000100:00100000:2.0:1789760549.122124:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798110208 00000100:00100000:2.0:1789760549.122148:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789760549.122155:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798110208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760549.122307:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798110208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.122313:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789760549.122353:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798110208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760549.124574:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760549.126240:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777080960 00000100:00100000:2.0:1789760549.126254:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777080960 00000100:00100000:2.0:1789760549.126307:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:2.0:1789760549.126318:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:6946:x1876699777080960:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789760549.126565:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:6946:x1876699777080960:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 249us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.126573:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:1.0:1789760549.128174:0:10030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10030:1876699798110336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760549.128265:0:10030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760549.128307:0:10030:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448ceb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.132623:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798110336 00000100:00100000:2.0:1789760549.132637:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798110336 00000100:00100000:2.0:1789760549.132686:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789760549.132695:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:10030:x1876699798110336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760549.133123:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:10030:x1876699798110336:12345-0@lo:502:llog_process_th.0 Request processed in 427us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.133131:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789760549.138987:0:10030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10030:1876699798110336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760549.139031:0:10030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760549.139042:0:10030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760549.139044:0:10030:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789760549.139050:0:10030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e546616000 00000020:00000080:1.0:1789760549.139053:0:10030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789760549.139143:0:10030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10030:1876699798110464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760549.139962:0:10030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760549.140008:0:10030:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448ceb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760549.140096:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798110464 00000100:00100000:0.0:1789760549.140104:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798110464 00000100:00100000:0.0:1789760549.140149:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789760549.140156:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:10030:x1876699798110464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760549.140442:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:10030:x1876699798110464:12345-0@lo:502:llog_process_th.0 Request processed in 285us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760549.140450:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789760549.140556:0:10030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:10030:1876699798110464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760549.140581:0:10030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760549.140588:0:10030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760549.140589:0:10030:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789760549.140592:0:10030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789760549.141144:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789760549.141161:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760549.141170:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.141182:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760549.387038:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760550.407293:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760550.599220:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798110592:0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.599282:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798110848:0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.599296:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.599331:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.599352:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798111104:0@lo:400:kworker.0 00000100:00100000:2.0:1789760550.599361:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798110592 00000100:00100000:0.0:1789760550.599363:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798111360:0@lo:400:kworker.0 00000100:00100000:2.0:1789760550.599371:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798110592 00000100:00100000:3.0:1789760550.599378:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.599403:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798111616:0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.599404:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760550.599423:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789760550.599433:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798111872:0@lo:400:kworker.0 00000100:00100000:2.0:1789760550.599437:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798110592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.599438:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.599463:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798112128:0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.599472:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.599601:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.599648:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798110592:0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.599663:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789760550.599669:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798110976:0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.599691:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.599708:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798111488:0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.599739:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.599755:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798112000:0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.599773:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.600706:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798110848 00000100:00100000:3.0:1789760550.600713:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798110848 00000100:00100000:3.0:1789760550.600747:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798111104 00000100:00100000:3.0:1789760550.600749:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798111104 00000100:00100000:3.0:1789760550.600764:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789760550.600771:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798110848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.600851:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798110848:12345-0@lo:400:kworker.0 Request processed in 80us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.600860:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789760550.600879:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789760550.600885:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798111104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.600912:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798111104:12345-0@lo:400:kworker.0 Request processed in 28us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.600918:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789760550.600933:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798111616 00000100:00100000:3.0:1789760550.600936:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798111616 00000100:00100000:3.0:1789760550.600964:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798112128 00000100:00100000:3.0:1789760550.600967:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798112128 00000100:00100000:3.0:1789760550.600983:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798111488 00000100:00100000:3.0:1789760550.600992:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798111488 00000100:00100000:3.0:1789760550.601020:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798112000 00000100:00100000:3.0:1789760550.601022:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798112000 00000100:00100000:3.0:1789760550.601039:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760550.601047:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798111616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.601084:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798111616:12345-0@lo:400:kworker.0 Request processed in 39us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.601090:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760550.601100:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760550.601106:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798112128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.601129:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798112128:12345-0@lo:400:kworker.0 Request processed in 25us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.601135:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760550.601147:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760550.601153:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798111488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.601182:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798111488:12345-0@lo:400:kworker.0 Request processed in 28us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.601186:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760550.601196:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760550.601201:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798112000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.601224:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798112000:12345-0@lo:400:kworker.0 Request processed in 23us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.601230:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760550.601254:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798111360 00000100:00100000:3.0:1789760550.601259:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798111360 00000100:00100000:3.0:1789760550.601283:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798111872 00000100:00100000:3.0:1789760550.601286:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798111872 00000100:00100000:3.0:1789760550.601314:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798110976 00000100:00100000:3.0:1789760550.601318:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798110976 00000100:00100000:3.0:1789760550.601330:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789760550.601336:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798111360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.601365:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798111360:12345-0@lo:400:kworker.0 Request processed in 31us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.601371:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789760550.601383:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789760550.601390:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798111872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760550.601631:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798110720:0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.604980:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789760550.605005:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798110976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.605087:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798110976:12345-0@lo:400:kworker.0 Request processed in 94us (5395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760550.605094:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1789760550.605159:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad3b80 x1876699798111872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760550.605174:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798111872:0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.605283:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798112384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760550.605617:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.605658:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798110848:0@lo:400:kworker.0 00010000:00080000:0.0:1789760550.605672:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad1f80 x1876699798111360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760550.605681:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798111360:0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.605727:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.605759:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798111232:0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.605779:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.605809:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798111744:0@lo:400:kworker.0 00000100:00100000:0.0:1789760550.605828:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.605839:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798112256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760550.606838:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760550.607391:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798110720 00000100:00100000:1.0:1789760550.607400:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798110720 00000100:00100000:1.0:1789760550.607434:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798111232 00000100:00100000:1.0:1789760550.607437:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798111232 00000100:00100000:1.0:1789760550.607453:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798111744 00000100:00100000:1.0:1789760550.607456:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798111744 00000100:00100000:1.0:1789760550.607473:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789760550.607481:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798110720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.607727:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798111872:12345-0@lo:400:kworker.0 Request processed in 6335us (8252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.607736:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789760550.607775:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760550.607779:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760550.607781:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760550.607784:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760550.607816:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789760550.607825:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798111232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.607862:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798111232:12345-0@lo:400:kworker.0 Request processed in 39us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.607868:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789760550.607881:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789760550.607887:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798111744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.607914:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798111744:12345-0@lo:400:kworker.0 Request processed in 27us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.607919:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789760550.608515:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798110976:0@lo:400:kworker.0 00010000:00080000:3.0:1789760550.608560:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad0700 x1876699798111488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760550.608572:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798111488:0@lo:400:kworker.0 00010000:00080000:3.0:1789760550.608583:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad0a80 x1876699798112000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760550.608591:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798112000:0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.608603:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798111104:0@lo:400:kworker.0 00010000:00080000:3.0:1789760550.608613:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad1c00 x1876699798111616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760550.608620:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798111616:0@lo:400:kworker.0 00010000:00080000:3.0:1789760550.608629:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad3480 x1876699798112128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760550.608637:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798112128:0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.608888:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798112384 00000100:00100000:3.0:1789760550.608894:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798112384 00000100:00100000:3.0:1789760550.608917:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798112256 00000100:00100000:3.0:1789760550.608920:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798112256 00000100:00100000:3.0:1789760550.608932:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760550.608938:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798112384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760550.608994:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760550.609061:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798111232:0@lo:400:kworker.0 00000100:00100000:3.0:1789760550.609480:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798112384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 540us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.609487:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760550.609512:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789760550.609519:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798112256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760550.609544:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760550.609896:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798112256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 376us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.609903:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789760550.611760:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543285c00 x1876699798112384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760550.611895:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798112384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760550.612604:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798110592:12345-0@lo:400:kworker.0 Request processed in 13168us (13304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760550.612615:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789760550.620141:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798111744:0@lo:400:kworker.0 00010000:00080000:0.0:1789760550.620169:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd13100 x1876699798112256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760550.620188:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798112256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760550.621523:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798110720:12345-0@lo:400:kworker.0 Request processed in 14034us (15787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.621904:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798110720:0@lo:400:kworker.0 00000100:00100000:1.0:1789760550.623235:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789760551.114331:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760551.118027:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798112512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760551.118110:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760551.118416:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798112512 00000100:00100000:2.0:1789760551.118425:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798112512 00000100:00100000:2.0:1789760551.118475:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760551.118485:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798112512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760551.118533:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760551.118595:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798112512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760551.118612:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789760551.118777:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798112512:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789760551.444532:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760551.623203:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798112640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760551.623272:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760551.623393:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798112640 00000100:00100000:2.0:1789760551.623402:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798112640 00000100:00100000:2.0:1789760551.623450:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789760551.623460:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798112640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760551.623497:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760551.623554:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798112640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760551.623561:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789760551.623615:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798112640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760552.135831:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760552.135852:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798112768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760552.135919:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760552.136041:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798112768 00000100:00100000:3.0:1789760552.136048:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798112768 00000100:00100000:3.0:1789760552.136108:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789760552.136118:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798112768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760552.136151:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760552.136197:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798112768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760552.136204:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789760552.136440:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760552.136470:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543285f80 x1876699798112768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760552.136487:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798112768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760552.139200:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798112896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760552.139263:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760552.139394:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798112896 00000100:00100000:3.0:1789760552.139401:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798112896 00000100:00100000:3.0:1789760552.139466:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789760552.139474:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798112896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760552.139493:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760552.139555:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798112896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760552.139571:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789760552.139661:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760552.139690:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0ad80 x1876699798112896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760552.139706:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798112896:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789760552.454921:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760553.480029:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760554.034822:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760554.034868:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760554.034898:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760554.034931:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777081600 00000100:00100000:1.0:1789760554.034952:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777081600 00000100:00100000:1.0:1789760554.035013:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:1.0:1789760554.035024:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777081600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760554.035097:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777081600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760554.035105:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00080000:1.0:1789760554.035126:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760554.035171:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760554.035279:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760554.035301:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777081344 00000100:00100000:1.0:1789760554.035305:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777081344 00000100:00100000:1.0:1789760554.035336:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777081216 00000100:00100000:1.0:1789760554.035339:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777081216 00000100:00100000:1.0:1789760554.035361:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1789760554.035367:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777081344:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760554.035402:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777081344:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760554.035408:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1789760554.035420:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:1.0:1789760554.035426:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777081216:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760554.035448:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777081216:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760554.035453:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:1.0:1789760554.035470:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777081472 00000100:00100000:1.0:1789760554.035474:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777081472 00000100:00100000:1.0:1789760554.035498:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1789760554.035515:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777081472:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760554.035547:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777081472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760554.035553:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00080000:1.0:1789760554.035618:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760554.035621:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760554.035623:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760554.036143:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777081088 00000100:00100000:0.0:1789760554.036148:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777081088 00000100:00100000:0.0:1789760554.036190:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 274 00000100:00100000:0.0:1789760554.036198:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:2403:x1876699777081088:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760554.036236:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:2403:x1876699777081088:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760554.036243:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 274 00000001:02000400:2.0:1789760554.041458:0:10260:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789760554.503011:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760555.528088:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760555.719187:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760555.719210:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798113024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760555.719291:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760555.719422:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798113024 00000100:00100000:2.0:1789760555.719430:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798113024 00000100:00100000:2.0:1789760555.719512:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789760555.719524:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798113024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760555.719569:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760555.719615:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798113024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760555.719623:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789760555.719905:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789760555.719936:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd10a80 x1876699798113024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760555.719956:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798113024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760555.722576:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798113152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760555.722639:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760555.722688:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798113152 00000100:00100000:1.0:1789760555.722695:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798113152 00000100:00100000:1.0:1789760555.722747:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789760555.722750:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760555.722756:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798113152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760555.722776:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760555.722847:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798113152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.722854:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789760555.723069:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433dd180 x1876699798113152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760555.723105:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798113152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760555.723992:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798113664:0@lo:400:kworker.0 00000100:00100000:0.0:1789760555.724035:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760555.724059:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798114176:0@lo:400:kworker.0 00000100:00100000:0.0:1789760555.724082:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760555.724100:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789760555.724106:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798113536:0@lo:400:kworker.0 00000100:00100000:0.0:1789760555.724128:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760555.724143:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798114048:0@lo:400:kworker.0 00000100:00100000:0.0:1789760555.724163:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760555.724176:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798114560:0@lo:400:kworker.0 00000100:00100000:0.0:1789760555.724198:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760555.724439:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798113408:0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.724479:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760555.724517:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798113920:0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.724538:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760555.724560:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798114432:0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.724582:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760555.724595:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789760555.724600:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798113280:0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.724628:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760555.724652:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798113792:0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.724673:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760555.724692:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798114304:0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.724713:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760555.724741:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798113664 00000100:00100000:1.0:1789760555.724747:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798113664 00000100:00100000:1.0:1789760555.724776:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798114048 00000100:00100000:1.0:1789760555.724779:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798114048 00000100:00100000:1.0:1789760555.724830:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798114560 00000100:00100000:1.0:1789760555.724833:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798114560 00000100:00100000:1.0:1789760555.724847:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798113408 00000100:00100000:1.0:1789760555.724849:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798113408 00000100:00100000:1.0:1789760555.724860:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798113920 00000100:00100000:1.0:1789760555.724862:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798113920 00000100:00100000:1.0:1789760555.724873:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798114432 00000100:00100000:1.0:1789760555.724876:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798114432 00000100:00100000:1.0:1789760555.724890:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789760555.724898:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798113664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.724947:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798113664:12345-0@lo:400:kworker.0 Request processed in 49us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.725093:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789760555.725113:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789760555.725120:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798114048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.725151:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798114048:12345-0@lo:400:kworker.0 Request processed in 32us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.725157:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789760555.725167:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789760555.725172:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798114560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.725198:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798114560:12345-0@lo:400:kworker.0 Request processed in 26us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.725204:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789760555.725215:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789760555.725233:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798113408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.725264:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798113408:12345-0@lo:400:kworker.0 Request processed in 32us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.725270:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789760555.725280:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789760555.725287:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.725312:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798113920:12345-0@lo:400:kworker.0 Request processed in 27us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.725318:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789760555.725330:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789760555.725335:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798114432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.725359:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798114432:12345-0@lo:400:kworker.0 Request processed in 24us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.725369:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789760555.725388:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798114176 00000100:00100000:1.0:1789760555.725391:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798114176 00000100:00100000:1.0:1789760555.725411:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798114304 00000100:00100000:1.0:1789760555.725413:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798114304 00000100:00100000:1.0:1789760555.725430:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789760555.725436:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798114176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.725467:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798114176:12345-0@lo:400:kworker.0 Request processed in 31us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.725473:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789760555.725483:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789760555.725500:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798114304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760555.725526:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798114304:12345-0@lo:400:kworker.0 Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760555.725531:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760555.725739:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798113536 00000100:00100000:3.0:1789760555.725744:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798113536 00000100:00100000:3.0:1789760555.725768:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798113792 00000100:00100000:3.0:1789760555.725771:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798113792 00000100:00100000:3.0:1789760555.725801:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789760555.725809:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798113536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760555.725844:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798113536:12345-0@lo:400:kworker.0 Request processed in 36us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760555.725850:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789760555.725861:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789760555.725867:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798113792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760555.725893:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798113792:12345-0@lo:400:kworker.0 Request processed in 26us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760555.725898:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1789760555.725933:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760555.725937:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760555.725940:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760555.725990:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798113792:0@lo:400:kworker.0 00010000:00080000:3.0:1789760555.726003:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad3800 x1876699798114304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760555.726013:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798114304:0@lo:400:kworker.0 00000100:00100000:3.0:1789760555.726024:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798113408:0@lo:400:kworker.0 00000100:00100000:3.0:1789760555.726032:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798113920:0@lo:400:kworker.0 00000100:00100000:3.0:1789760555.726040:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798114432:0@lo:400:kworker.0 00000100:00100000:3.0:1789760555.726097:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798113536:0@lo:400:kworker.0 00010000:00080000:3.0:1789760555.726110:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad3480 x1876699798114048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760555.726118:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798114048:0@lo:400:kworker.0 00010000:00080000:3.0:1789760555.726132:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad0700 x1876699798114560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760555.726140:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798114560:0@lo:400:kworker.0 00000100:00100000:3.0:1789760555.726151:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798113664:0@lo:400:kworker.0 00010000:00080000:3.0:1789760555.726161:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fad1c00 x1876699798114176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760555.726168:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798114176:0@lo:400:kworker.0 00000100:00100000:2.0:1789760555.726645:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798113280 00000100:00100000:2.0:1789760555.726653:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798113280 00000100:00100000:2.0:1789760555.726699:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789760555.726708:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798113280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760555.726761:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798113280:12345-0@lo:400:kworker.0 Request processed in 55us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760555.726769:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789760555.728965:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798113280:0@lo:400:kworker.0 00000100:00100000:1.0:1789760556.232056:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760556.232079:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798114688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760556.232252:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760556.232566:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798114688 00000100:00100000:3.0:1789760556.232573:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798114688 00000100:00100000:3.0:1789760556.232647:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789760556.232656:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798114688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789760556.232693:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789760556.232753:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798114688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760556.232760:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789760556.232868:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798114688:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760556.551363:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760556.742939:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760556.742961:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798114816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760556.743029:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760556.743199:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798114816 00000100:00100000:1.0:1789760556.743209:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798114816 00000100:00100000:1.0:1789760556.743265:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789760556.743274:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798114816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789760556.743313:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760556.743425:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798114816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760556.743433:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789760556.744102:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798114816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760557.255980:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798114944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760557.256064:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760557.256609:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798114944 00000100:00100000:1.0:1789760557.256618:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798114944 00000100:00100000:2.0:1789760557.256723:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798115072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760557.256756:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760557.256806:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798115072 00000100:00100000:2.0:1789760557.256810:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798115072 00000100:00100000:1.0:1789760557.265519:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789760557.265533:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798114944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760557.265571:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760557.265649:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798114944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (9584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760557.265656:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789760557.265698:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546385180 x1876699798114944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760557.265717:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798114944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760557.269981:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760557.269995:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798115072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760557.270020:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760557.270100:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798115072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (13343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760557.270105:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789760557.270150:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd13800 x1876699798115072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760557.270170:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798115072:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760557.270411:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760557.575194:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760558.599155:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760559.005431:0:10505:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing yml_node 00000100:00100000:0.0:1789760559.164922:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760559.164956:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760559.164984:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760559.165007:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760559.165084:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760559.165112:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777082112 00000100:00100000:0.0:1789760559.165127:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777082112 00000100:00100000:0.0:1789760559.165178:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777082240 00000100:00100000:0.0:1789760559.165181:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777082240 00000100:00100000:0.0:1789760559.165206:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1789760559.165216:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2402:x1876699777082112:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1789760559.165255:0:8114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2b9a3a739856c11 00000100:00080000:0.0:1789760559.165265:0:8114:0:(import.c:65:import_set_state_nolock()) ffff97e544917000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789760559.165304:0:8114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789760559.165579:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+2:2402:x1876699777082112:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 363us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760559.165588:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1789760559.165604:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1789760559.165610:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2402:x1876699777082240:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1789760559.165624:0:8114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2b9a3a739856c18 00000100:00080000:0.0:1789760559.165630:0:8114:0:(import.c:65:import_set_state_nolock()) ffff97e5435d7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789760559.165650:0:8114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789760559.165783:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+2:2402:x1876699777082240:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 172us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760559.165815:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1789760559.165836:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777081984 00000100:00100000:0.0:1789760559.165841:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777081984 00000100:00100000:0.0:1789760559.165866:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777081856 00000100:00100000:0.0:1789760559.165868:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777081856 00000100:00100000:0.0:1789760559.165884:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:0.0:1789760559.165889:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777081984:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760559.165914:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777081984:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760559.165921:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:0.0:1789760559.165930:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:0.0:1789760559.165935:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777081856:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760559.165971:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777081856:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760559.165977:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00010000:00010000:0.0:1789760559.166041:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760559.166857:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777081728 00000100:00100000:1.0:1789760559.166865:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777081728 00000100:00100000:1.0:1789760559.166900:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 276 00000100:00100000:1.0:1789760559.166983:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2406:x1876699777081728:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760559.167031:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2406:x1876699777081728:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 123us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760559.167038:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 276 00000100:00080000:1.0:1789760559.167074:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760559.167079:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760559.167082:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760559.167084:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760559.167813:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760559.628702:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760560.647656:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760560.840209:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798115328:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.840291:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760560.840358:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798115840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.840381:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760560.843991:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798116352:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.844184:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760560.844232:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789760560.844238:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798115456:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.845138:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.845140:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798115200:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.845180:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798115968:0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.845187:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760560.845227:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.845237:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798115712:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.845263:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798116480:0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.845270:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.845295:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798116224:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.845305:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.845322:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.845343:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798116736:0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.845362:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.845380:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789760560.845386:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798115584:0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.845412:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798116224 00000100:00100000:3.0:1789760560.845418:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798116224 00000100:00100000:1.0:1789760560.845478:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798116864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760560.845509:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760560.845528:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760560.845534:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798116992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760560.845551:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760560.845579:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798115328 00000100:00100000:1.0:1789760560.845583:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798115328 00000100:00100000:1.0:1789760560.845615:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798115840 00000100:00100000:3.0:1789760560.845616:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798116736 00000100:00100000:1.0:1789760560.845619:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798115840 00000100:00100000:3.0:1789760560.845623:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798116736 00000100:00100000:1.0:1789760560.845636:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798116352 00000100:00100000:1.0:1789760560.845640:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798116352 00000100:00100000:1.0:1789760560.845656:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798115968 00000100:00100000:1.0:1789760560.845658:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798115968 00000100:00100000:3.0:1789760560.845671:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760560.845684:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798116480 00000100:00100000:3.0:1789760560.845684:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798116224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.845689:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798116480 00000100:00100000:1.0:1789760560.845708:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789760560.845716:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798115328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.845741:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798116224:12345-0@lo:400:kworker.0 Request processed in 60us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760560.845749:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789760560.845766:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789760560.845773:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e581c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798116736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.846164:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e581c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798116736:12345-0@lo:400:kworker.0 Request processed in 390us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760560.846171:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789760560.846307:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.846323:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798116096:0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.846343:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.846356:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798116608:0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.846380:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789760560.846402:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dd180 x1876699798116224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760560.846414:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798116224:0@lo:400:kworker.0 00010000:00080000:3.0:1789760560.846424:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e449748e00 x1876699798116736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760560.846432:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798116736:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.846538:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798115328:12345-0@lo:400:kworker.0 Request processed in 821us (6248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760560.846547:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789760560.846563:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798115584 00000100:00100000:1.0:1789760560.846567:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798115584 00000100:00100000:1.0:1789760560.846588:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789760560.846595:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798115840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.846633:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798115840:12345-0@lo:400:kworker.0 Request processed in 39us (6251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760560.846641:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789760560.846644:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798116096 00000100:00100000:2.0:1789760560.846651:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798116096 00000100:00100000:1.0:1789760560.846659:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760560.846670:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798116352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760560.846679:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798116608 00000100:00100000:2.0:1789760560.846683:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798116608 00000100:00100000:2.0:1789760560.846704:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789760560.846709:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798116352:12345-0@lo:400:kworker.0 Request processed in 41us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760560.846716:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798116096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.846721:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760560.846738:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789760560.846747:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798115968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760560.846761:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798116096:12345-0@lo:400:kworker.0 Request processed in 47us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760560.846768:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789760560.846812:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798115968:12345-0@lo:400:kworker.0 Request processed in 43us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760560.846814:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789760560.846823:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789760560.846827:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798116608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.846843:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789760560.846855:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798116480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760560.846861:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798116608:12345-0@lo:400:kworker.0 Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760560.846874:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789760560.846903:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798115456 00000100:00100000:2.0:1789760560.846908:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798115456 00000100:00100000:1.0:1789760560.846912:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798116480:12345-0@lo:400:kworker.0 Request processed in 61us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760560.846920:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760560.846934:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798115712 00000100:00100000:1.0:1789760560.846944:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760560.846946:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798115712 00000100:00100000:1.0:1789760560.846954:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798115584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760560.846970:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789760560.846978:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798115456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.846992:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798115584:12345-0@lo:400:kworker.0 Request processed in 40us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760560.846999:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789760560.847017:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760560.847021:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760560.847023:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760560.847025:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760560.847035:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798116864 00000100:00100000:1.0:1789760560.847039:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798116864 00000100:00100000:1.0:1789760560.847056:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798116992 00000100:00100000:1.0:1789760560.847059:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798116992 00000100:00100000:1.0:1789760560.847070:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789760560.847076:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798116864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789760560.847101:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760560.847132:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798116864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760560.847137:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789760560.847149:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760560.847154:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798116992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760560.847164:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760560.847190:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798116992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760560.847205:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789760560.847213:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798115584:0@lo:400:kworker.0 00010000:00080000:3.0:1789760560.847227:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f877b80 x1876699798116096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760560.847236:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798116096:0@lo:400:kworker.0 00010000:00080000:1.0:1789760560.847244:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e09880 x1876699798116992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789760560.847252:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dc380 x1876699798116608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760560.847260:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798116608:0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.847301:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789760560.847309:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798115712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.847358:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798115712:12345-0@lo:400:kworker.0 Request processed in 50us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760560.847365:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789760560.847384:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798115200 00000100:00100000:3.0:1789760560.847388:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798115200 00000100:00100000:3.0:1789760560.847410:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789760560.847416:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798115200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760560.847472:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798115200:12345-0@lo:400:kworker.0 Request processed in 56us (2286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760560.847483:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789760560.847497:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798116992:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789760560.847519:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0b800 x1876699798116864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760560.847527:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798115200:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.847537:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798116864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760560.847543:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798115712:0@lo:400:kworker.0 00010000:00080000:1.0:1789760560.847558:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546384e00 x1876699798115968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760560.847569:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798115968:0@lo:400:kworker.0 00010000:00080000:1.0:1789760560.847585:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dc000 x1876699798116480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760560.847594:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798116480:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.847608:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798115328:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.847622:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798115840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760560.847634:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798116352:0@lo:400:kworker.0 00000100:00100000:2.0:1789760560.848637:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798115456:12345-0@lo:400:kworker.0 Request processed in 1655us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760560.848646:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789760560.848659:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798115456:0@lo:400:kworker.0 00000100:00100000:3.0:1789760561.351038:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760561.351061:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798117120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760561.351319:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760561.351510:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798117120 00000100:00100000:1.0:1789760561.351518:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798117120 00000100:00100000:1.0:1789760561.351579:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789760561.351588:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798117120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760561.351623:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760561.351696:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798117120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760561.351704:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789760561.351744:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798117120:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789760561.671024:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760561.863460:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760561.866767:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798117248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760561.866865:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760561.868646:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798117248 00000100:00100000:2.0:1789760561.868659:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798117248 00000100:00100000:2.0:1789760561.868723:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789760561.868734:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798117248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760561.868774:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760561.868862:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798117248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760561.868869:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789760561.869083:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798117248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760562.375812:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798117376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760562.375919:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760562.376127:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798117376 00000100:00100000:0.0:1789760562.376139:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798117376 00000100:00100000:0.0:1789760562.376272:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789760562.376284:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798117376:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760562.376301:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789760562.376321:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760562.376416:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798117376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760562.376423:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789760562.376601:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd11f80 x1876699798117376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760562.376621:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798117376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760562.376641:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760562.376651:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798117504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760562.376687:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760562.376750:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798117504 00000100:00100000:3.0:1789760562.376756:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798117504 00000100:00080000:1.0:1789760562.377114:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760562.377124:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760562.377133:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798117504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760562.377146:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760562.377191:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798117504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760562.377199:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789760562.377222:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd13800 x1876699798117504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760562.377236:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798117504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789760562.695177:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789760562.966217:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:1.0:1789760562.966230:0:8141:0:(genops.c:885:class_export_put()) final put ffff97e544911800/ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:0.0:1789760562.968226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97e544911800/ac82f857-edfe-4201-bbe8-4599ba569acb for lustre-OST0000 00000020:00000080:0.0:1789760562.968299:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e544917000 for lustre-OST0000 00000001:00100000:3.0:1789760563.039016:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:3.0:1789760563.039032:0:9084:0:(genops.c:885:class_export_put()) final put ffff97e5435d5000/ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:0.0:1789760563.039164:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e5435d5000/ac82f857-edfe-4201-bbe8-4599ba569acb for lustre-OST0001 00000020:00000080:0.0:1789760563.039235:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e5435d7800 for lustre-OST0001 00000001:02000400:2.0:1789760563.538425:0:10698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:0.0:1789760563.719249:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760564.271314:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760564.271416:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760564.271505:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760564.271541:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777082496 00000100:00100000:1.0:1789760564.271549:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777082496 00000100:00100000:1.0:1789760564.271608:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777082624 00000100:00100000:1.0:1789760564.271611:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777082624 00000100:00100000:1.0:1789760564.271655:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:1.0:1789760564.271667:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777082496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760564.271750:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777082496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760564.271758:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:1.0:1789760564.271777:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:1.0:1789760564.271784:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777082624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760564.271831:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777082624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760564.271839:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00080000:1.0:1789760564.271858:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760564.271861:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760564.274457:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777082368 00000100:00100000:2.0:1789760564.274469:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777082368 00000100:00100000:2.0:1789760564.274532:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 278 00000100:00100000:2.0:1789760564.274543:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777082368:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760564.274805:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777082368:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 247us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760564.274813:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 278 00010000:00010000:1.0:1789760564.742928:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760565.767056:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760565.965521:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760565.965540:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798117632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760565.965603:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760565.965673:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798117632 00000100:00100000:3.0:1789760565.965680:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798117632 00000100:00100000:3.0:1789760565.965732:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789760565.965742:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798117632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760565.965775:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760565.965847:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798117632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760565.965855:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789760565.965875:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789760565.965904:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0bb80 x1876699798117632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760565.965932:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798117632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760565.967747:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798117760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760565.967830:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760565.967863:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798118272:0@lo:400:kworker.0 00000100:00100000:0.0:1789760565.967900:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760565.967927:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798118784:0@lo:400:kworker.0 00000100:00100000:0.0:1789760565.967952:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760565.967969:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798119296:0@lo:400:kworker.0 00000100:00100000:0.0:1789760565.967987:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760565.968005:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789760565.968011:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798118144:0@lo:400:kworker.0 00000100:00100000:0.0:1789760565.968033:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760565.968048:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798118656:0@lo:400:kworker.0 00000100:00100000:0.0:1789760565.968081:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760565.968096:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798119168:0@lo:400:kworker.0 00000100:00100000:0.0:1789760565.968116:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760565.968153:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798118784 00000100:00100000:0.0:1789760565.968160:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798118784 00000100:00100000:0.0:1789760565.968201:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798119296 00000100:00100000:0.0:1789760565.968204:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798119296 00000100:00100000:0.0:1789760565.968229:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760565.968236:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798118784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760565.968284:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798118784:12345-0@lo:400:kworker.0 Request processed in 48us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760565.968290:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760565.968307:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789760565.968314:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798119296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760565.968341:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798119296:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760565.968346:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789760565.968397:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd12300 x1876699798118784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760565.968409:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798118784:0@lo:400:kworker.0 00010000:00080000:0.0:1789760565.968434:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd13800 x1876699798119296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760565.968442:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798119296:0@lo:400:kworker.0 00000100:00100000:2.0:1789760565.968674:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798117760 00000100:00100000:2.0:1789760565.968680:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798117760 00000100:00100000:2.0:1789760565.968723:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789760565.968730:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798117760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760565.968744:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760565.968782:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798117760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760565.968807:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789760565.968834:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd13480 x1876699798117760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760565.968849:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798117760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760565.968942:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798117888:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.968980:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.969013:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798118400:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969035:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.969052:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798118912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969083:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.969102:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789760565.969107:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798118016:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969138:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.969156:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798118528:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969182:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.969193:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798119040:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969212:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.969484:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798118272 00000100:00100000:1.0:1789760565.969489:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798118272 00000100:00100000:1.0:1789760565.969511:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798118656 00000100:00100000:1.0:1789760565.969514:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798118656 00000100:00100000:1.0:1789760565.969527:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798119168 00000100:00100000:1.0:1789760565.969530:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798119168 00000100:00100000:1.0:1789760565.969540:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798118016 00000100:00100000:1.0:1789760565.969543:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798118016 00000100:00100000:1.0:1789760565.969552:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798118528 00000100:00100000:1.0:1789760565.969554:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798118528 00000100:00100000:1.0:1789760565.969565:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798119040 00000100:00100000:1.0:1789760565.969566:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798119040 00000100:00100000:1.0:1789760565.969579:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789760565.969585:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798118272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969624:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798118272:12345-0@lo:400:kworker.0 Request processed in 39us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.969631:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789760565.969644:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789760565.969650:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798118656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969675:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798118656:12345-0@lo:400:kworker.0 Request processed in 26us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.969681:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789760565.969692:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789760565.969698:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798119168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969724:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798119168:12345-0@lo:400:kworker.0 Request processed in 26us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.969729:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789760565.969740:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789760565.969745:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798118016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969802:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798118016:12345-0@lo:400:kworker.0 Request processed in 40us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.969809:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789760565.969823:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789760565.969829:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798118528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969853:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798118528:12345-0@lo:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.969858:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789760565.969869:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789760565.969874:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798119040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969901:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798119040:12345-0@lo:400:kworker.0 Request processed in 27us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.969907:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789760565.969924:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798118912 00000100:00100000:1.0:1789760565.969927:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798118912 00000100:00100000:1.0:1789760565.969951:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789760565.969957:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798118912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.969985:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798118912:12345-0@lo:400:kworker.0 Request processed in 28us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.969990:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789760565.970013:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798118144 00000100:00100000:1.0:1789760565.970017:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798118144 00000100:00100000:1.0:1789760565.970038:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798118400 00000100:00100000:1.0:1789760565.970041:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798118400 00000100:00100000:1.0:1789760565.970054:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789760565.970060:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798118144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.970101:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798118144:12345-0@lo:400:kworker.0 Request processed in 42us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.970108:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789760565.970121:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789760565.970127:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798118400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.970153:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798118400:12345-0@lo:400:kworker.0 Request processed in 27us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.970160:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789760565.970265:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798118016:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.970274:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798118528:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.970282:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798119040:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.970289:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798118400:0@lo:400:kworker.0 00010000:00080000:1.0:1789760565.970298:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd13b80 x1876699798118912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760565.970307:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798118912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.970348:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798118144:0@lo:400:kworker.0 00010000:00080000:1.0:1789760565.970359:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd11180 x1876699798118656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760565.970367:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798118656:0@lo:400:kworker.0 00010000:00080000:1.0:1789760565.970377:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd10700 x1876699798119168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760565.970385:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798119168:0@lo:400:kworker.0 00000100:00100000:1.0:1789760565.970408:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798118272:0@lo:400:kworker.0 00000100:00100000:2.0:1789760565.973461:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798117888 00000100:00100000:2.0:1789760565.973476:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798117888 00000100:00100000:2.0:1789760565.973531:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789760565.973539:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798117888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760565.973625:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798117888:12345-0@lo:400:kworker.0 Request processed in 87us (4644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760565.973632:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789760565.973781:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798117888:0@lo:400:kworker.0 00000100:00080000:3.0:1789760565.974017:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760565.974023:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760565.974026:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760565.974030:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760566.471211:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798119424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760566.471285:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760566.471371:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798119424 00000100:00100000:1.0:1789760566.471379:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798119424 00000100:00100000:1.0:1789760566.471434:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789760566.471443:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798119424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760566.471478:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760566.486949:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798119424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 15498us (15654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760566.486963:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789760566.493310:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798119424:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1789760566.521284:0:10796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:2.0:1789760566.790979:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760566.984737:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798119552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760566.984872:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760566.985079:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798119552 00000100:00100000:2.0:1789760566.985090:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798119552 00000100:00100000:2.0:1789760566.985173:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789760566.985185:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798119552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760566.985238:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760566.985298:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798119552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760566.985306:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789760566.985392:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798119552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760567.495482:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798119680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760567.495582:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760567.496076:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798119680 00000100:00100000:1.0:1789760567.496087:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798119680 00000100:00100000:1.0:1789760567.496168:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789760567.496182:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798119680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760567.496228:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760567.496293:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798119680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760567.496302:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789760567.496362:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b4380 x1876699798119680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760567.496384:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798119680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789760567.496672:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760567.497592:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798119808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760567.497662:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.497778:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798119808 00000100:00100000:0.0:1789760567.497817:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798119808 00000100:00100000:0.0:1789760567.497996:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760567.498009:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798119808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789760567.498039:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760567.498098:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798119808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.498106:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789760567.498386:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760567.498434:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd13480 x1876699798119808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760567.498469:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798119808:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789760567.818225:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760568.839315:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760569.397569:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760569.397637:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760569.397674:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760569.397711:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777082880 00000100:00100000:0.0:1789760569.397723:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777082880 00000100:00100000:0.0:1789760569.397835:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777083008 00000100:00100000:0.0:1789760569.397839:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777083008 00000100:00100000:2.0:1789760569.397845:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:2.0:1789760569.397863:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777082880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760569.397878:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:0.0:1789760569.397904:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777083008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760569.398015:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777083008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 112us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760569.398020:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777082752 00000100:00100000:3.0:1789760569.398025:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777082752 00000100:00100000:0.0:1789760569.398037:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00080000:0.0:1789760569.398074:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760569.398079:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00080000:0.0:1789760569.398080:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760569.398089:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777082752:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760569.401989:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777082880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 4115us (4693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760569.402006:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:3.0:1789760569.404413:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777082752:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 6300us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760569.404429:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 280 00000001:02000400:3.0:1789760569.732599:0:10894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:2.0:1789760569.867010:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760570.887479:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760571.079291:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798119936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760571.079396:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760571.079438:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798119936 00000100:00100000:0.0:1789760571.079450:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798119936 00000100:00080000:1.0:1789760571.079518:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760571.086678:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789760571.086713:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798119936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760571.086769:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760571.086982:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798119936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 287us (7585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760571.086990:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789760571.089467:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798120064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760571.089581:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789760571.090096:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e08000 x1876699798119936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760571.090128:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798119936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760571.092629:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798120320:0@lo:400:kworker.0 00000100:00100000:0.0:1789760571.092713:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760571.092752:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798120832:0@lo:400:kworker.0 00000100:00100000:0.0:1789760571.092775:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760571.092809:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798121344:0@lo:400:kworker.0 00000100:00100000:0.0:1789760571.092829:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760571.092930:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789760571.092938:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798120192:0@lo:400:kworker.0 00000100:00100000:0.0:1789760571.092969:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760571.092994:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798120704:0@lo:400:kworker.0 00000100:00100000:0.0:1789760571.093019:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760571.093256:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798121216:0@lo:400:kworker.0 00000100:00100000:0.0:1789760571.093284:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760571.093322:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798120320 00000100:00100000:0.0:1789760571.093330:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798120320 00000100:00100000:0.0:1789760571.093396:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798120832 00000100:00100000:0.0:1789760571.093399:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798120832 00000100:00100000:0.0:1789760571.093426:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798121344 00000100:00100000:0.0:1789760571.093429:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798121344 00000100:00100000:2.0:1789760571.093584:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798120576:0@lo:400:kworker.0 00000100:00100000:2.0:1789760571.093613:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760571.093623:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798121088:0@lo:400:kworker.0 00000100:00100000:2.0:1789760571.093640:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760571.093654:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798121600:0@lo:400:kworker.0 00000100:00100000:2.0:1789760571.093671:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760571.093684:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789760571.093688:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798120448:0@lo:400:kworker.0 00000100:00100000:2.0:1789760571.093708:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760571.093724:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798120960:0@lo:400:kworker.0 00000100:00100000:2.0:1789760571.093765:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760571.093778:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798121472:0@lo:400:kworker.0 00000100:00100000:2.0:1789760571.093816:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760571.093956:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798120704 00000100:00100000:2.0:1789760571.093967:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798120704 00000100:00100000:2.0:1789760571.093999:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798120448 00000100:00100000:2.0:1789760571.094002:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798120448 00000100:00100000:2.0:1789760571.094019:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789760571.094186:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798120576 00000100:00100000:0.0:1789760571.094190:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798120576 00000100:00100000:0.0:1789760571.094204:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798120960 00000100:00100000:0.0:1789760571.094207:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798120960 00000100:00100000:0.0:1789760571.094221:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798121472 00000100:00100000:0.0:1789760571.094224:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798121472 00000100:00100000:1.0:1789760571.094232:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789760571.094237:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789760571.094241:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798120448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760571.094243:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.094307:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798120448:12345-0@lo:400:kworker.0 Request processed in 66us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760571.094308:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798120320:12345-0@lo:400:kworker.0 Request processed in 62us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760571.094316:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789760571.094316:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789760571.094336:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789760571.094342:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798120832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.094342:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798121216 00000100:00100000:1.0:1789760571.094345:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798121216 00000100:00100000:0.0:1789760571.094369:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798120832:12345-0@lo:400:kworker.0 Request processed in 28us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.094385:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798121088 00000100:00100000:0.0:1789760571.094387:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789760571.094388:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798121088 00000100:00100000:0.0:1789760571.094398:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789760571.094401:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798121600 00000100:00100000:1.0:1789760571.094403:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798121600 00000100:00100000:0.0:1789760571.094404:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798121344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.094418:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760571.094424:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798121216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760571.094430:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798121344:12345-0@lo:400:kworker.0 Request processed in 27us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.094455:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798121216:12345-0@lo:400:kworker.0 Request processed in 31us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.094461:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760571.094473:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789760571.094478:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798121088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.094506:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798121088:12345-0@lo:400:kworker.0 Request processed in 28us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.094512:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789760571.094516:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798120704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.094522:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789760571.094527:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798121600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760571.094550:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798120704:12345-0@lo:400:kworker.0 Request processed in 524us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760571.094556:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789760571.094560:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798121600:12345-0@lo:400:kworker.0 Request processed in 34us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.094565:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789760571.094611:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798120448:0@lo:400:kworker.0 00010000:00080000:1.0:1789760571.094627:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f876d80 x1876699798121088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760571.094639:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798121088:0@lo:400:kworker.0 00010000:00080000:1.0:1789760571.094648:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57a220000 x1876699798121600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760571.094655:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798121600:0@lo:400:kworker.0 00000100:00080000:1.0:1789760571.094690:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760571.094694:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760571.094697:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760571.094699:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760571.094757:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798120192 00000100:00100000:1.0:1789760571.094762:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798120192 00000100:00100000:1.0:1789760571.094809:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789760571.094816:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798120192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.094851:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798120192:12345-0@lo:400:kworker.0 Request processed in 36us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.094857:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789760571.094889:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789760571.094897:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.094929:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798120576:12345-0@lo:400:kworker.0 Request processed in 34us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.094944:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789760571.094958:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760571.094964:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798120960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.094993:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798120960:12345-0@lo:400:kworker.0 Request processed in 30us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.094999:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760571.095010:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789760571.095017:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798121472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.095045:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798121472:12345-0@lo:400:kworker.0 Request processed in 28us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.095051:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1789760571.095087:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f877b80 x1876699798120960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760571.095097:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798120960:0@lo:400:kworker.0 00010000:00080000:1.0:1789760571.095107:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f875c00 x1876699798121472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760571.095115:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798121472:0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.095127:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798120576:0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.095175:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798120064 00000100:00100000:1.0:1789760571.095178:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798120064 00000100:00100000:1.0:1789760571.095206:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789760571.095213:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798120064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760571.095230:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760571.095274:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798120064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (5696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760571.095281:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789760571.095309:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd11f80 x1876699798120064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760571.095327:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798120064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760571.095368:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789760571.095394:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798120192:0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.095408:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798120704:0@lo:400:kworker.0 00010000:00080000:1.0:1789760571.095421:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f877800 x1876699798121216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760571.095429:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798121216:0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.095442:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798120320:0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.095455:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798120832:0@lo:400:kworker.0 00000100:00100000:1.0:1789760571.095467:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798121344:0@lo:400:kworker.0 00000100:00100000:3.0:1789760571.592201:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798121728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760571.592298:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760571.592394:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798121728 00000100:00100000:3.0:1789760571.592405:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798121728 00000100:00100000:3.0:1789760571.592472:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789760571.592482:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798121728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789760571.592534:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789760571.592596:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798121728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760571.592604:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789760571.592675:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798121728:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789760571.643700:0:10943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanityn ============----- Fri Sep 18 15:42:49 EDT 2026 00010000:00010000:0.0:1789760571.920282:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760572.106054:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760572.106089:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798121856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760572.106188:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760572.106410:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798121856 00000100:00100000:1.0:1789760572.106421:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798121856 00000100:00100000:1.0:1789760572.106492:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789760572.106503:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798121856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789760572.106556:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760572.106619:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798121856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.106626:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789760572.107905:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798121856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760572.615415:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798121984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760572.615493:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.615658:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798121984 00000100:00100000:0.0:1789760572.615667:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798121984 00000100:00100000:0.0:1789760572.615734:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789760572.615745:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798121984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760572.615781:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760572.620640:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798121984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4888us (5138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760572.620655:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789760572.624669:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798122112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760572.624820:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760572.624847:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798122112 00000100:00100000:1.0:1789760572.624867:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798122112 00000100:00100000:1.0:1789760572.624909:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789760572.624918:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798122112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760572.624939:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760572.624986:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798122112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.624993:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789760572.625627:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0b480 x1876699798122112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760572.625645:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798122112:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789760572.628999:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b7b80 x1876699798121984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760572.629027:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798121984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760572.936036:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760573.960166:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760574.510995:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760574.511044:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760574.511067:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760574.511096:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777083264 00000100:00100000:0.0:1789760574.511105:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777083264 00000100:00100000:0.0:1789760574.511160:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777083392 00000100:00100000:0.0:1789760574.511164:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777083392 00000100:00100000:0.0:1789760574.511188:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:1.0:1789760574.511219:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:1.0:1789760574.511229:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777083392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760574.511305:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777083392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 77us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760574.511312:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:0.0:1789760574.511380:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777083264:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760574.511599:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777083136 00000100:00100000:2.0:1789760574.511603:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777083136 00000100:00100000:2.0:1789760574.511639:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 282 00000100:00100000:2.0:1789760574.511646:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2405:x1876699777083136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760574.511677:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2405:x1876699777083136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760574.511686:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 282 00000100:00100000:0.0:1789760574.511759:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777083264:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 562us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760574.511775:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00080000:1.0:1789760574.511854:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760574.511858:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789760574.983007:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760576.006914:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760576.199080:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798122240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760576.199154:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760576.199418:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798122240 00000100:00100000:3.0:1789760576.199425:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798122240 00000100:00100000:3.0:1789760576.199495:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789760576.199506:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798122240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760576.199541:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760576.199584:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798122240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760576.199591:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789760576.199777:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789760576.199857:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0b480 x1876699798122240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760576.199875:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798122240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760576.200344:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798122624:0@lo:400:kworker.0 00000100:00100000:3.0:1789760576.200380:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760576.200400:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798123136:0@lo:400:kworker.0 00000100:00100000:3.0:1789760576.200423:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760576.200437:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798123648:0@lo:400:kworker.0 00000100:00100000:3.0:1789760576.200455:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760576.200470:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789760576.200475:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798122496:0@lo:400:kworker.0 00000100:00100000:3.0:1789760576.200494:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760576.200508:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798123008:0@lo:400:kworker.0 00000100:00100000:3.0:1789760576.200527:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760576.200541:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798123520:0@lo:400:kworker.0 00000100:00100000:3.0:1789760576.200559:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760576.200582:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798122624 00000100:00100000:3.0:1789760576.200586:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798122624 00000100:00100000:1.0:1789760576.201069:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798122368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.201104:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760576.201214:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798123136 00000100:00100000:0.0:1789760576.201219:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798123136 00000100:00100000:0.0:1789760576.201249:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798123648 00000100:00100000:0.0:1789760576.201252:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798123648 00000100:00100000:0.0:1789760576.201264:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798122496 00000100:00100000:0.0:1789760576.201267:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798122496 00000100:00100000:0.0:1789760576.201277:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798123008 00000100:00100000:0.0:1789760576.201279:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798123008 00000100:00100000:0.0:1789760576.201290:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798123520 00000100:00100000:0.0:1789760576.201293:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798123520 00000100:00100000:0.0:1789760576.201307:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789760576.201315:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798123136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.201373:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798123136:12345-0@lo:400:kworker.0 Request processed in 59us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760576.201380:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789760576.201395:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789760576.201401:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798123648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.201429:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798123648:12345-0@lo:400:kworker.0 Request processed in 28us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760576.201446:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789760576.201458:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789760576.201465:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798122496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.201493:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798122496:12345-0@lo:400:kworker.0 Request processed in 29us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760576.201498:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789760576.201509:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789760576.201515:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798123008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.201539:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798123008:12345-0@lo:400:kworker.0 Request processed in 24us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760576.201545:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789760576.201555:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789760576.201561:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798123520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.201587:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798123520:12345-0@lo:400:kworker.0 Request processed in 26us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760576.201593:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1789760576.203104:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760576.203241:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798122752:0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.203293:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760576.203836:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798122752 00000100:00100000:2.0:1789760576.203907:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798122752 00000100:00100000:2.0:1789760576.204078:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789760576.204097:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798122752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760576.204157:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798122752:12345-0@lo:400:kworker.0 Request processed in 62us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760576.204164:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789760576.206138:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798122880:0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.206196:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760576.206231:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798123392:0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.206255:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760576.206281:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798123904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760576.206301:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760576.206353:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798122368 00000100:00100000:1.0:1789760576.206359:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798122368 00000100:00100000:1.0:1789760576.206395:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789760576.206415:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798122368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.206459:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798122368:12345-0@lo:400:kworker.0 Request processed in 46us (5355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760576.206466:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789760576.206503:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798123392 00000100:00100000:1.0:1789760576.206507:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798123392 00000100:00100000:1.0:1789760576.206535:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789760576.206542:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798123392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.206572:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798123392:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760576.206578:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789760576.206622:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798122368:0@lo:400:kworker.0 00010000:00080000:1.0:1789760576.206637:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433ddf80 x1876699798123392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760576.206647:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798123392:0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.206670:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798123904 00000100:00100000:1.0:1789760576.206673:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798123904 00000100:00100000:1.0:1789760576.206697:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789760576.206702:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798123904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760576.206714:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760576.206743:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798123904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760576.206748:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789760576.206769:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd10000 x1876699798123904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760576.206816:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798123904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760576.207081:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798122880 00000100:00100000:2.0:1789760576.207085:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798122880 00000100:00100000:2.0:1789760576.207107:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789760576.207114:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798122624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760576.207151:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798122624:12345-0@lo:400:kworker.0 Request processed in 37us (6771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760576.207156:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789760576.207169:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789760576.207174:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798122880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760576.207201:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798122880:12345-0@lo:400:kworker.0 Request processed in 27us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760576.207206:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789760576.208076:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798122880:0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.210436:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798122496:0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.210453:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798123008:0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.210466:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798123520:0@lo:400:kworker.0 00000100:00100000:1.0:1789760576.210478:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798122624:0@lo:400:kworker.0 00010000:00080000:1.0:1789760576.210492:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0a680 x1876699798123136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760576.210503:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798123136:0@lo:400:kworker.0 00010000:00080000:1.0:1789760576.210514:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a0000 x1876699798123648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760576.210521:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798123648:0@lo:400:kworker.0 00000100:00080000:1.0:1789760576.210558:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760576.210564:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760576.210567:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760576.211778:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798122752:0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.212281:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798123264:0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.212356:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760576.212421:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798123776:0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.212460:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760576.212704:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798123264 00000100:00100000:1.0:1789760576.212711:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798123264 00000100:00080000:1.0:1789760576.212900:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760576.213235:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798123776 00000100:00100000:2.0:1789760576.213240:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798123776 00000100:00100000:2.0:1789760576.213307:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789760576.213317:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798123264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760576.213393:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798123264:12345-0@lo:400:kworker.0 Request processed in 77us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760576.213400:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789760576.213417:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789760576.213424:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760576.213451:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798123776:12345-0@lo:400:kworker.0 Request processed in 28us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760576.213465:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789760576.213553:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433dce00 x1876699798123264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760576.213565:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798123264:0@lo:400:kworker.0 00010000:00080000:3.0:1789760576.213578:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a1500 x1876699798123776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760576.213593:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798123776:0@lo:400:kworker.0 00000100:00100000:0.0:1789760576.718065:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760576.718224:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798124032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760576.718342:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760576.718430:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798124032 00000100:00100000:0.0:1789760576.718440:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798124032 00000100:00100000:0.0:1789760576.718501:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789760576.718512:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798124032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760576.718583:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760576.718645:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798124032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760576.718653:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789760576.718718:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798124032:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789760577.032048:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760577.223005:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760577.223039:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798124160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760577.223139:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760577.223216:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798124160 00000100:00100000:0.0:1789760577.223224:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798124160 00000100:00100000:0.0:1789760577.223274:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789760577.223283:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798124160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760577.223343:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789760577.223391:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798124160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760577.223399:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789760577.223463:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798124160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760577.739503:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798124288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760577.739631:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760577.739774:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798124288 00000100:00100000:1.0:1789760577.739870:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798124288 00000100:00100000:1.0:1789760577.740138:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789760577.740150:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798124288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760577.740209:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760577.740281:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798124288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760577.740289:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789760577.740923:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b7b80 x1876699798124288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760577.740950:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798124288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760577.740978:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760577.740987:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798124416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760577.741031:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760577.750871:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798124416 00000100:00100000:0.0:1789760577.750896:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798124416 00000100:00100000:0.0:1789760577.750989:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789760577.751001:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798124416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789760577.751038:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760577.751163:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798124416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (10131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760577.751171:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789760577.751704:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d4700 x1876699798124416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760577.751733:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798124416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789760578.057068:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760579.079529:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760579.632870:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760579.632925:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760579.632953:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760579.632993:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777083776 00000100:00100000:0.0:1789760579.633006:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777083776 00000100:00100000:0.0:1789760579.633090:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777083648 00000100:00100000:0.0:1789760579.633094:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777083648 00000100:00100000:0.0:1789760579.633127:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:0.0:1789760579.633138:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777083776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760579.633429:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777083776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 291us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760579.633438:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:0.0:1789760579.633460:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:0.0:1789760579.633467:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777083648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760579.633492:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777083648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760579.633498:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00080000:1.0:1789760579.636476:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760579.636491:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760579.636606:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777083520 00000100:00100000:2.0:1789760579.636621:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777083520 00000100:00100000:2.0:1789760579.636694:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 284 00000100:00100000:2.0:1789760579.636707:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777083520:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760579.636826:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+10:2404:x1876699777083520:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 121us (3972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760579.636835:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 284 00010000:00010000:1.0:1789760580.103442:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760581.126923:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760581.319367:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798124544:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.319532:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760581.319616:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798125056:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.319647:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760581.319672:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798125568:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.319703:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760581.319722:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798126080:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.319746:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760581.319773:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789760581.319779:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798124672:0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.319826:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798126208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760581.319840:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760581.319861:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760581.319862:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798125184:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.319887:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760581.319897:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798124544 00000100:00100000:1.0:1789760581.319906:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798124544 00000100:00100000:3.0:1789760581.319907:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798125696:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.319935:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760581.319961:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789760581.319962:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798124928:0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.319971:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798124544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.319984:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760581.320003:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798125440:0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.320021:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798124544:12345-0@lo:400:kworker.0 Request processed in 53us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760581.320021:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760581.320029:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789760581.320035:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798125952:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.320051:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760581.320080:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798126208 00000100:00100000:1.0:1789760581.320084:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798126208 00000100:00100000:1.0:1789760581.320123:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789760581.320133:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798126208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789760581.320162:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760581.320203:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798126208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760581.320209:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789760581.320230:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798124672 00000100:00100000:1.0:1789760581.320234:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798124672 00000100:00100000:1.0:1789760581.320265:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798125184 00000100:00100000:1.0:1789760581.320269:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798125184 00000100:00100000:1.0:1789760581.320287:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798125696 00000100:00100000:1.0:1789760581.320289:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798125696 00000100:00100000:1.0:1789760581.320318:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798124928 00000100:00100000:1.0:1789760581.320321:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798124928 00000100:00100000:1.0:1789760581.320336:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789760581.320344:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798124672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.320386:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798124672:12345-0@lo:400:kworker.0 Request processed in 43us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760581.320393:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789760581.320405:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789760581.320405:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789760581.320411:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798125184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.320444:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798125184:12345-0@lo:400:kworker.0 Request processed in 33us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760581.320449:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789760581.320463:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789760581.320470:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798125696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.320505:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798125696:12345-0@lo:400:kworker.0 Request processed in 36us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760581.320512:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789760581.320529:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789760581.320537:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.320538:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798124800:0@lo:400:kworker.0 00000100:00100000:2.0:1789760581.320565:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798125568 00000100:00100000:2.0:1789760581.320571:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798125568 00000100:00100000:2.0:1789760581.320605:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798126080 00000100:00100000:2.0:1789760581.320608:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798126080 00000100:00100000:2.0:1789760581.320631:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798125440 00000100:00100000:2.0:1789760581.320634:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798125440 00000100:00100000:2.0:1789760581.320653:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798125952 00000100:00100000:2.0:1789760581.320664:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798125952 00000100:00100000:2.0:1789760581.320683:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789760581.320691:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798125568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.322573:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798124928:12345-0@lo:400:kworker.0 Request processed in 2029us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760581.322573:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760581.322588:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789760581.322624:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798125312:0@lo:400:kworker.0 00000100:00080000:1.0:1789760581.322653:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760581.322670:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760581.322674:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789760581.322675:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760581.322842:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798125568:12345-0@lo:400:kworker.0 Request processed in 2150us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760581.322854:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789760581.322890:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789760581.322902:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798126080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760581.322941:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798126080:12345-0@lo:400:kworker.0 Request processed in 44us (3194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760581.322947:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789760581.322958:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760581.322963:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798125440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760581.322987:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798125440:12345-0@lo:400:kworker.0 Request processed in 24us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760581.322992:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760581.323002:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760581.323008:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798125952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760581.323032:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798125952:12345-0@lo:400:kworker.0 Request processed in 25us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760581.323038:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760581.323106:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798126336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760581.323129:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760581.323525:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798126336 00000100:00100000:2.0:1789760581.323533:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798126336 00010000:00080000:1.0:1789760581.324237:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b7b80 x1876699798126208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760581.324260:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798126208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760581.324589:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798125824:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.324631:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760581.325221:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760581.325246:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798126336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760581.325268:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760581.325337:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798126336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760581.325346:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789760581.325381:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd13800 x1876699798126336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760581.325396:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798126336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760581.326144:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798124928:0@lo:400:kworker.0 00010000:00080000:3.0:1789760581.326162:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a185500 x1876699798125440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760581.326172:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798125440:0@lo:400:kworker.0 00010000:00080000:3.0:1789760581.326186:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ab71c00 x1876699798125952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760581.326196:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798125952:0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.326497:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798125312 00000100:00100000:1.0:1789760581.326504:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798125312 00000100:00100000:1.0:1789760581.326550:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798125824 00000100:00100000:1.0:1789760581.326553:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798125824 00000100:00100000:1.0:1789760581.326571:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789760581.326580:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798125312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.326639:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798125312:12345-0@lo:400:kworker.0 Request processed in 60us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760581.326647:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789760581.326661:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789760581.326667:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798125824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.326913:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798125824:12345-0@lo:400:kworker.0 Request processed in 245us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760581.326920:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1789760581.326940:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760581.326972:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798124672:0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.326985:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798125184:0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.326998:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798125696:0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.327021:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798124544:0@lo:400:kworker.0 00010000:00080000:1.0:1789760581.327041:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a184380 x1876699798125568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760581.327069:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798125568:0@lo:400:kworker.0 00010000:00080000:1.0:1789760581.327087:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ab71180 x1876699798126080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760581.327096:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798126080:0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.327360:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798125056 00000100:00100000:1.0:1789760581.327366:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798125056 00000100:00100000:1.0:1789760581.327400:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798124800 00000100:00100000:1.0:1789760581.327404:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798124800 00000100:00100000:1.0:1789760581.327417:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789760581.327423:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798125056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.327465:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798125056:12345-0@lo:400:kworker.0 Request processed in 42us (7818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760581.327472:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789760581.327483:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760581.327488:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798124800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760581.327516:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798124800:12345-0@lo:400:kworker.0 Request processed in 27us (4945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760581.327522:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760581.327553:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798125056:0@lo:400:kworker.0 00000100:00100000:3.0:1789760581.328096:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798124800:0@lo:400:kworker.0 00010000:00080000:3.0:1789760581.328111:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a186300 x1876699798125312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760581.328122:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798125312:0@lo:400:kworker.0 00010000:00080000:3.0:1789760581.328131:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ab70700 x1876699798125824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760581.328141:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798125824:0@lo:400:kworker.0 00000100:00100000:2.0:1789760581.832992:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798126464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760581.833088:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760581.833325:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798126464 00000100:00100000:0.0:1789760581.833335:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798126464 00000100:00100000:0.0:1789760581.833407:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789760581.833419:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798126464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760581.833476:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760581.833540:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798126464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760581.833548:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789760581.837673:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798126464:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760582.151219:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760582.343109:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760582.343129:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798126592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760582.343199:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760582.343316:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798126592 00000100:00100000:2.0:1789760582.343325:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798126592 00000100:00100000:2.0:1789760582.343474:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760582.343491:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798126592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760582.343524:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760582.343581:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798126592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760582.343591:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789760582.343766:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798126592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760582.854991:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798126720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760582.855071:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760582.855140:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798126720 00000100:00100000:2.0:1789760582.855146:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798126720 00000100:00100000:2.0:1789760582.855187:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760582.855203:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798126720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760582.855249:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760582.855304:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798126720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760582.855312:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789760582.855351:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57fd10000 x1876699798126720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760582.855369:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798126720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760582.856239:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798126848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760582.856276:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760582.856366:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798126848 00000100:00100000:1.0:1789760582.856373:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798126848 00000100:00100000:1.0:1789760582.856411:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789760582.856418:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798126848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760582.856431:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760582.856477:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798126848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760582.856485:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789760582.856550:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a0000 x1876699798126848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760582.856565:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798126848:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789760583.183662:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760584.199144:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760584.757651:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760584.757690:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760584.757739:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760584.757750:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777083904 00000100:00100000:1.0:1789760584.757760:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777083904 00000100:00100000:2.0:1789760584.757781:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777084032 00000100:00100000:3.0:1789760584.757781:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777084160 00000100:00100000:2.0:1789760584.757814:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777084032 00000100:00100000:3.0:1789760584.757826:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777084160 00000100:00100000:1.0:1789760584.757831:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 286 00000100:00100000:1.0:1789760584.757844:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:2406:x1876699777083904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760584.757866:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:2.0:1789760584.757875:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777084032:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760584.757928:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:2406:x1876699777083904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760584.757936:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 286 00000100:00080000:1.0:1789760584.757971:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760584.757975:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760584.758491:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777084032:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 614us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760584.758499:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:2.0:1789760584.758520:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:2.0:1789760584.758537:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777084160:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760584.758571:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777084160:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760584.758578:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00010000:00010000:0.0:1789760585.225915:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760586.246941:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760586.439124:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798127104:0@lo:400:kworker.0 00000100:00100000:3.0:1789760586.439132:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798127232:0@lo:400:kworker.0 00000100:00100000:1.0:1789760586.439209:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798126976:0@lo:400:kworker.0 00000100:00100000:0.0:1789760586.440593:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798127360:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.442122:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760586.442189:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798127616:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.442222:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760586.442255:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798128128:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.442291:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760586.442319:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798128640:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.442342:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760586.442362:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760586.442368:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798128768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760586.442390:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760586.442424:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798128128 00000100:00100000:2.0:1789760586.442432:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798128128 00000100:00100000:2.0:1789760586.442481:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798128640 00000100:00100000:2.0:1789760586.442484:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798128640 00000100:00100000:2.0:1789760586.442506:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760586.442514:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798128128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.442567:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798128128:12345-0@lo:400:kworker.0 Request processed in 54us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.442573:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760586.442588:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760586.442605:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798128640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.442636:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798128640:12345-0@lo:400:kworker.0 Request processed in 31us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.442642:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760586.442661:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798128768 00000100:00100000:2.0:1789760586.442665:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798128768 00000100:00100000:2.0:1789760586.442691:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760586.442698:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798128768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760586.442722:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760586.442754:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798128768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.442760:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789760586.442776:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760586.442780:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789760586.444747:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f923100 x1876699798128768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760586.444771:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798128768:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789760586.444800:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d5f80 x1876699798128640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760586.444809:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798128640:0@lo:400:kworker.0 00010000:00080000:2.0:1789760586.445167:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a187b80 x1876699798128128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760586.445177:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798128128:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.445233:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798127104 00000100:00100000:2.0:1789760586.445239:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798127104 00000100:00100000:2.0:1789760586.445299:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798127616 00000100:00100000:2.0:1789760586.445303:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798127616 00000100:00100000:2.0:1789760586.445332:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789760586.445341:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798127104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.445413:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798127104:12345-0@lo:400:kworker.0 Request processed in 73us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.445420:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789760586.445436:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789760586.445443:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798127616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.445472:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798127616:12345-0@lo:400:kworker.0 Request processed in 30us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.445477:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1789760586.445496:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760586.445516:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798127104:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.445526:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798127616:0@lo:400:kworker.0 00000100:00100000:3.0:1789760586.446936:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760586.446973:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798127744:0@lo:400:kworker.0 00000100:00100000:3.0:1789760586.447006:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760586.447109:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798127744 00000100:00100000:3.0:1789760586.447116:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798127744 00000100:00100000:3.0:1789760586.447161:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789760586.447168:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798127744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760586.447213:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798127744:12345-0@lo:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760586.447219:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1789760586.447252:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789760586.447283:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a186300 x1876699798127744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760586.447295:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798127744:0@lo:400:kworker.0 00000100:00100000:3.0:1789760586.447302:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798128256:0@lo:400:kworker.0 00000100:00100000:3.0:1789760586.447325:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760586.447346:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798128256 00000100:00100000:3.0:1789760586.447361:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798128256 00000100:00100000:3.0:1789760586.447390:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789760586.447396:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798128256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760586.447426:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798128256:12345-0@lo:400:kworker.0 Request processed in 30us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760586.447431:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1789760586.447446:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760586.447483:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798128256:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.447592:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798127232 00000100:00100000:2.0:1789760586.447597:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798127232 00000100:00100000:2.0:1789760586.447627:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760586.447759:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798127232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.447940:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798127232:12345-0@lo:400:kworker.0 Request processed in 186us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.447948:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789760586.449342:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760586.449393:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798127488:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.449422:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798126976 00000100:00100000:1.0:1789760586.449423:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760586.449428:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798126976 00000100:00100000:1.0:1789760586.449446:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798127488 00000100:00100000:1.0:1789760586.449449:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798127488 00000100:00100000:2.0:1789760586.449462:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789760586.449469:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798126976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760586.449471:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789760586.449476:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798127488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760586.449515:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798127488:12345-0@lo:400:kworker.0 Request processed in 38us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760586.449521:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789760586.449571:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798127488:0@lo:400:kworker.0 00000100:00100000:1.0:1789760586.449586:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798128000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760586.449614:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760586.449639:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798128000 00000100:00100000:1.0:1789760586.449642:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798128000 00000100:00100000:1.0:1789760586.449678:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789760586.449685:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798128000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760586.449715:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798128000:12345-0@lo:400:kworker.0 Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760586.449721:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789760586.449739:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760586.449756:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a184380 x1876699798128000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760586.449767:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798128000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760586.449773:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798128512:0@lo:400:kworker.0 00000100:00100000:0.0:1789760586.450142:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760586.450172:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798127872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760586.450196:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760586.450219:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798127872 00000100:00100000:0.0:1789760586.450222:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798127872 00000100:00100000:0.0:1789760586.450253:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789760586.450269:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798127872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760586.450284:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760586.450313:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798127872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760586.450319:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1789760586.450356:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543577b80 x1876699798127872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760586.450380:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798127872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760586.450387:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798128384:0@lo:400:kworker.0 00000100:00100000:0.0:1789760586.450412:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760586.450561:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798127360 00000100:00100000:3.0:1789760586.450565:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798127360 00000100:00100000:3.0:1789760586.450587:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798128384 00000100:00100000:3.0:1789760586.450589:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798128384 00000100:00100000:3.0:1789760586.450623:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760586.450629:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798127360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760586.450675:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798127360:12345-0@lo:400:kworker.0 Request processed in 46us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760586.450681:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789760586.450782:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798126976:12345-0@lo:400:kworker.0 Request processed in 1311us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.450805:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789760586.450850:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789760586.450859:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798128384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.450890:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798128384:12345-0@lo:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.450896:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789760586.450926:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798127232:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.450970:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798127360:0@lo:400:kworker.0 00010000:00080000:2.0:1789760586.450981:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a185500 x1876699798128384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760586.450990:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798128384:0@lo:400:kworker.0 00000100:00080000:0.0:1789760586.451819:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760586.452601:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760586.452682:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798128512 00000100:00100000:1.0:1789760586.452693:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798126976:0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.452697:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798128512 00000100:00100000:2.0:1789760586.452741:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760586.452749:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798128512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760586.452836:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798128512:12345-0@lo:400:kworker.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.452842:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789760586.452983:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d6a00 x1876699798128512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760586.452994:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798128512:0@lo:400:kworker.0 00000100:00100000:0.0:1789760586.952172:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760586.952218:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798128896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760586.952328:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760586.952592:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798128896 00000100:00100000:0.0:1789760586.952604:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798128896 00000100:00100000:0.0:1789760586.952670:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789760586.952683:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798128896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760586.952736:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760586.952817:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798128896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760586.952825:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789760586.952896:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798128896:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789760587.270921:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760587.465269:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798129024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760587.465377:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760587.465488:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798129024 00000100:00100000:0.0:1789760587.465498:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798129024 00000100:00100000:0.0:1789760587.465561:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789760587.465572:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798129024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760587.465624:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789760587.465677:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798129024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760587.466030:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798129024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760587.466272:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789760587.977977:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798129152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760587.977983:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798129280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760587.982048:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760587.982223:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760587.982331:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798129280 00000100:00100000:2.0:1789760587.982343:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798129280 00000100:00100000:2.0:1789760587.982407:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798129152 00000100:00100000:2.0:1789760587.982411:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798129152 00000100:00100000:2.0:1789760587.982430:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789760587.982440:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798129280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760587.982490:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760587.982553:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798129280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.982561:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789760587.982580:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760587.982586:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798129152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760587.982596:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760587.982643:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798129152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.982649:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1789760587.982694:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543576a00 x1876699798129152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760587.982719:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798129152:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789760587.983268:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d6a00 x1876699798129280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760587.983289:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798129280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789760588.296372:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760589.319580:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760589.876704:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760589.876778:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760589.876837:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760589.876871:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777084288 00000100:00100000:2.0:1789760589.876883:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777084288 00000100:00100000:2.0:1789760589.876962:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 288 00000100:00100000:2.0:1789760589.876975:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:2406:x1876699777084288:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760589.877066:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+10:2406:x1876699777084288:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 94us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760589.877086:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 288 00000100:00100000:2.0:1789760589.877133:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777084416 00000100:00100000:2.0:1789760589.877137:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777084416 00000100:00100000:2.0:1789760589.877183:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777084544 00000100:00100000:2.0:1789760589.877186:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777084544 00000100:00100000:2.0:1789760589.877226:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:2.0:1789760589.877244:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777084416:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760589.877280:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777084416:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760589.877287:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:2.0:1789760589.877299:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:2.0:1789760589.877306:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777084544:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760589.877333:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777084544:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760589.877340:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00080000:2.0:1789760589.877519:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760589.877525:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789760590.342943:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760590.398709:0:11670:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 40a 00010000:00010000:2.0:1789760591.368000:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760591.561395:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798129408:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.561472:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760591.561522:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798129408 00000100:00100000:2.0:1789760591.561532:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798129408 00000100:00100000:3.0:1789760591.561532:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798129920:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.561570:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760591.561589:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789760591.561598:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798130432:0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.561603:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798129408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.561629:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.561654:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798130944:0@lo:400:kworker.0 00000100:00100000:0.0:1789760591.561658:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798129920 00000100:00100000:2.0:1789760591.561661:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798129408:12345-0@lo:400:kworker.0 Request processed in 61us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760591.561663:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798129920 00000100:00100000:2.0:1789760591.561669:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789760591.561684:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760591.561697:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789760591.561705:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798129920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.561734:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798129408:0@lo:400:kworker.0 00000100:00100000:0.0:1789760591.561753:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798129920:12345-0@lo:400:kworker.0 Request processed in 47us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760591.561753:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798129920:0@lo:400:kworker.0 00000100:00100000:0.0:1789760591.561764:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789760591.561773:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789760591.561782:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798129536:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.561837:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.561859:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798130048:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.561879:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.561898:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798130560:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.561921:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.561936:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760591.561942:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798131072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760591.561963:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.561989:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798129664:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.562011:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.562027:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798130176:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.562057:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.562075:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798130688:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.562110:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.562129:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789760591.562135:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798129792:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.562152:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.562163:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798130304:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.562184:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760591.562213:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798130816:0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.562235:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798130432 00000100:00100000:2.0:1789760591.562241:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798130432 00000100:00100000:3.0:1789760591.562259:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760591.562278:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798130944 00000100:00100000:2.0:1789760591.562282:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798130944 00000100:00100000:2.0:1789760591.562294:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798130304 00000100:00100000:2.0:1789760591.562296:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798130304 00000100:00100000:2.0:1789760591.562306:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798130816 00000100:00100000:2.0:1789760591.562308:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798130816 00000100:00100000:2.0:1789760591.562326:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760591.562333:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798130432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.562373:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798130432:12345-0@lo:400:kworker.0 Request processed in 41us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.562379:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760591.562391:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789760591.562397:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798130944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.562422:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798130944:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.562428:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789760591.562437:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760591.562442:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798130304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.562467:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798130304:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.562472:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760591.562483:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789760591.562489:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798130816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.562513:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798130816:12345-0@lo:400:kworker.0 Request processed in 25us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.562529:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789760591.562546:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760591.562550:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760591.563880:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798129536 00000100:00100000:2.0:1789760591.563890:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798129536 00000100:00100000:2.0:1789760591.563928:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798130048 00000100:00100000:2.0:1789760591.563932:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798130048 00000100:00100000:2.0:1789760591.563972:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798130560 00000100:00100000:2.0:1789760591.563976:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798130560 00000100:00100000:2.0:1789760591.563988:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798130176 00000100:00100000:2.0:1789760591.563991:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798130176 00000100:00100000:2.0:1789760591.564002:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798130688 00000100:00100000:2.0:1789760591.564005:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798130688 00000100:00100000:2.0:1789760591.564017:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798129792 00000100:00100000:2.0:1789760591.564020:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798129792 00000100:00100000:2.0:1789760591.564652:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789760591.564666:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798129536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.564741:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798129536:12345-0@lo:400:kworker.0 Request processed in 80us (2905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.564748:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789760591.564766:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789760591.564773:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798130048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.564825:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798130048:12345-0@lo:400:kworker.0 Request processed in 53us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.564843:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789760591.564857:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789760591.564862:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798130560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.564890:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798130560:12345-0@lo:400:kworker.0 Request processed in 28us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.564908:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789760591.564919:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789760591.564925:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798130176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.564953:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798130176:12345-0@lo:400:kworker.0 Request processed in 29us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.564958:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789760591.564969:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789760591.564975:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798130688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.565000:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798130688:12345-0@lo:400:kworker.0 Request processed in 27us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.565006:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789760591.565017:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789760591.565023:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.565279:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798129792:12345-0@lo:400:kworker.0 Request processed in 255us (3125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.565286:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789760591.565317:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760591.565330:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798131200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760591.565365:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789760591.565460:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760591.565465:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760591.565876:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798131072 00000100:00100000:2.0:1789760591.565884:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798131072 00000100:00100000:2.0:1789760591.565910:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798131200 00000100:00100000:2.0:1789760591.565913:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798131200 00000100:00100000:2.0:1789760591.565926:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789760591.565933:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798131072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760591.565971:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760591.566013:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798131072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.566020:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789760591.566043:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f921c00 x1876699798131072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760591.566050:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789760591.566062:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798131200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760591.566071:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798131072:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760591.566073:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760591.566089:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798129536:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.566104:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798130048:0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.566112:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798131200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760591.566120:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798130560:0@lo:400:kworker.0 00000100:00100000:2.0:1789760591.566121:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789760591.566140:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f8a1180 x1876699798130432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760591.566149:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798130432:0@lo:400:kworker.0 00010000:00080000:2.0:1789760591.566158:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433dce00 x1876699798131200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789760591.566166:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f8a2a00 x1876699798130944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760591.566175:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798131200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760591.566179:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798130944:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.566240:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798129792:0@lo:400:kworker.0 00010000:00080000:3.0:1789760591.566253:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f8a2300 x1876699798130304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760591.566263:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798130304:0@lo:400:kworker.0 00010000:00080000:3.0:1789760591.566273:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f8a3480 x1876699798130816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760591.566280:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798130816:0@lo:400:kworker.0 00010000:00080000:3.0:1789760591.566291:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f8a3b80 x1876699798130176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760591.566308:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798130176:0@lo:400:kworker.0 00010000:00080000:3.0:1789760591.566327:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f8a1500 x1876699798130688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760591.566335:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798130688:0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.566646:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798129664 00000100:00100000:3.0:1789760591.566651:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798129664 00000100:00100000:3.0:1789760591.566690:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789760591.566697:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798129664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760591.566746:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798129664:12345-0@lo:400:kworker.0 Request processed in 50us (4734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760591.566753:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789760591.566994:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798129664:0@lo:400:kworker.0 00000001:02000400:3.0:1789760591.956123:0:11718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 33a 00000100:00100000:2.0:1789760592.071028:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798131328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760592.071102:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760592.071557:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798131328 00000100:00100000:0.0:1789760592.071566:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798131328 00000100:00100000:0.0:1789760592.071620:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789760592.071630:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798131328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760592.071765:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760592.071983:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798131328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 353us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760592.071990:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789760592.077190:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798131328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760592.393697:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760592.583414:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760592.583437:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798131456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760592.583517:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760592.583583:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798131456 00000100:00100000:0.0:1789760592.583591:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798131456 00000100:00100000:0.0:1789760592.583638:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789760592.583647:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798131456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760592.583683:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789760592.583739:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798131456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760592.583746:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789760592.584635:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798131456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760593.096086:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798131584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760593.096188:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760593.096332:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798131712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760593.096371:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760593.096373:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798131584 00000100:00100000:1.0:1789760593.096384:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798131584 00000100:00100000:2.0:1789760593.096421:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798131712 00000100:00100000:2.0:1789760593.096427:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798131712 00000100:00100000:1.0:1789760593.096454:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789760593.096472:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798131584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760593.096518:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760593.096568:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798131584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00080000:3.0:1789760593.104148:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760593.104234:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543574e00 x1876699798131584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760593.105921:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798131584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760593.108772:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789760593.108855:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789760593.108876:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798131712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760593.108909:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760593.109001:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798131712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (12632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760593.109006:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789760593.109130:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05e300 x1876699798131712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760593.109175:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798131712:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789760593.415055:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760593.653698:0:11767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: start setup 15:43:11 (1789760591) === 00000100:00100000:1.0:1789760594.079831:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760594.080025:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777084672 00000100:00100000:2.0:1789760594.080039:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777084672 00000100:00100000:2.0:1789760594.080121:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:2.0:1789760594.080133:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+10:9304:x1876699777084672:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789760594.080155:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760594.080177:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e441f8e600/0xc2b9a3a739856d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211781 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.080222:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e441f8e600/0xc2b9a3a739856d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211781 expref: 11 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.080237:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e441f8e600/0xc2b9a3a739856d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211781 expref: 11 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.080249:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e600, rc 0) 00000100:00100000:2.0:1789760594.080334:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+11:9304:x1876699777084672:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 203us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.080341:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:2.0:1789760594.090405:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760594.090546:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777084800 00000100:00100000:0.0:1789760594.090578:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777084800 00000100:00100000:0.0:1789760594.090650:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 291 00000100:00100000:0.0:1789760594.090663:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+11:9304:x1876699777084800:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789760594.091620:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+11:9304:x1876699777084800:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 954us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.091631:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 291 00000100:00100000:3.0:1789760594.094866:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.095139:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777084928 00000100:00100000:1.0:1789760594.095151:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777084928 00000100:00100000:1.0:1789760594.095230:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 292 00000100:00100000:1.0:1789760594.095241:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+11:9304:x1876699777084928:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789760594.096384:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+11:9304:x1876699777084928:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 472us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.096397:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 292 00000100:00100000:1.0:1789760594.105463:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760594.106038:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777085056 00000100:00100000:0.0:1789760594.106053:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777085056 00000100:00100000:0.0:1789760594.106198:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 293 00000100:00100000:0.0:1789760594.106221:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+11:9308:x1876699777085056:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789760594.107466:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+11:9308:x1876699777085056:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 1239us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.107487:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 293 00000100:00100000:2.0:1789760594.146957:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.152049:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777085184 00000100:00100000:1.0:1789760594.152082:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777085184 00000100:00100000:1.0:1789760594.152160:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 294 00000100:00100000:1.0:1789760594.152173:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+11:9308:x1876699777085184:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789760594.152658:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+11:9308:x1876699777085184:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 484us (5712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.152668:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 294 00000100:00100000:3.0:1789760594.154401:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760594.155449:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777085312 00000100:00100000:0.0:1789760594.155466:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777085312 00000100:00100000:0.0:1789760594.155548:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 295 00000100:00100000:0.0:1789760594.155560:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+11:9308:x1876699777085312:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789760594.156362:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+11:9308:x1876699777085312:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 800us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.156373:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 295 00000100:00100000:2.0:1789760594.164459:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.164583:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777085440 00000100:00100000:1.0:1789760594.164596:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777085440 00000100:00100000:1.0:1789760594.164667:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 296 00000100:00100000:1.0:1789760594.164678:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+11:9304:x1876699777085440:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789760594.164699:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760594.164734:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e57fd8e800/0xc2b9a3a739856d0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e652117b2 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.164772:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e57fd8e800/0xc2b9a3a739856d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b2 expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.164840:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e57fd8e800/0xc2b9a3a739856d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b2 expref: 12 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.164864:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8e800, rc 0) 00000100:00100000:1.0:1789760594.164958:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+12:9304:x1876699777085440:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 281us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.164966:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 296 00000100:00100000:2.0:1789760594.168579:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760594.168998:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777085568 00000100:00100000:0.0:1789760594.169009:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777085568 00000100:00100000:0.0:1789760594.169068:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 297 00000100:00100000:0.0:1789760594.169081:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+12:9304:x1876699777085568:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789760594.169116:0:6459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789760594.169163:0:6459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789760594.169168:0:6459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789760594.169172:0:6459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789760594.169175:0:6459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789760594.169178:0:6459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789760594.172637:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+12:9304:x1876699777085568:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 3540us (4052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.172656:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 297 00000100:00100000:2.0:1789760594.181636:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.181858:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777085696 00000100:00100000:1.0:1789760594.181870:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777085696 00000100:00100000:1.0:1789760594.181930:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 298 00000100:00100000:1.0:1789760594.181942:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+12:9304:x1876699777085696:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789760594.181965:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760594.181986:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e652117b9 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.182025:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 13 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.182035:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 13 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.182043:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f600, rc 0) 00000100:00100000:1.0:1789760594.182245:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:9304:x1876699777085696:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 303us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.182253:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 298 00000100:00100000:2.0:1789760594.185473:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760594.185605:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777085824 00000100:00100000:0.0:1789760594.185618:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777085824 00000100:00100000:0.0:1789760594.185838:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 299 00000100:00100000:0.0:1789760594.185852:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:9304:x1876699777085824:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789760594.186362:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:9304:x1876699777085824:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 512us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.186371:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 299 00000100:00100000:3.0:1789760594.188265:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.188350:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777085952 00000100:00100000:1.0:1789760594.188360:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777085952 00000100:00100000:1.0:1789760594.188411:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00100000:1.0:1789760594.188421:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:9304:x1876699777085952:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789760594.189185:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:9304:x1876699777085952:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 758us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.189220:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00100000:1.0:1789760594.194071:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760594.194258:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777086080 00000100:00100000:0.0:1789760594.194272:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777086080 00000100:00100000:0.0:1789760594.194520:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 301 00000100:00100000:0.0:1789760594.194534:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:9313:x1876699777086080:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789760594.195279:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:9313:x1876699777086080:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 742us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.195290:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 301 00000100:00100000:2.0:1789760594.197820:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.197941:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777086208 00000100:00100000:1.0:1789760594.197953:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777086208 00000100:00100000:1.0:1789760594.198017:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 302 00000100:00100000:1.0:1789760594.198027:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:9313:x1876699777086208:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789760594.198983:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:9313:x1876699777086208:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 951us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.198994:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 302 00000100:00100000:2.0:1789760594.209092:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760594.209143:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760594.209166:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760594.209210:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760594.209249:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777086336 00000100:00100000:2.0:1789760594.209261:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777086336 00000100:00100000:2.0:1789760594.209303:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777086592 00000100:00100000:2.0:1789760594.209306:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777086592 00000100:00100000:2.0:1789760594.209315:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777087104 00000100:00100000:2.0:1789760594.209317:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777087104 00000100:00100000:2.0:1789760594.209355:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777086976 00000100:00100000:2.0:1789760594.209358:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777086976 00000100:00100000:2.0:1789760594.209383:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:2.0:1789760594.209394:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777087104:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760594.209492:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777087104:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 99us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.209501:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:2.0:1789760594.209521:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:2.0:1789760594.209528:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777086976:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760594.209554:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777086976:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.209560:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:2.0:1789760594.209572:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:2.0:1789760594.209576:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1876699777086336:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789760594.209605:0:9081:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e138f4d1-d0ec-4b86-a7ba-bb29c025f420@192.168.203.38@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:2.0:1789760594.209659:0:9081:0:(genops.c:1385:class_connect()) connect: client e138f4d1-d0ec-4b86-a7ba-bb29c025f420, cookie 0xc2b9a3a739856d1b 00000100:00100000:1.0:1789760594.209849:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1789760594.209856:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1876699777086592:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789760594.209874:0:6466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e138f4d1-d0ec-4b86-a7ba-bb29c025f420@192.168.203.38@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1789760594.209906:0:6466:0:(genops.c:1385:class_connect()) connect: client e138f4d1-d0ec-4b86-a7ba-bb29c025f420, cookie 0xc2b9a3a739856d22 00000004:00100000:1.0:1789760594.209933:0:6466:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789760594.210277:0:6466:0:(import.c:65:import_set_state_nolock()) ffff97e544917800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760594.210319:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:2402:x1876699777086592:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 461us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.210326:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000004:00100000:2.0:1789760594.211182:0:9081:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789760594.211452:0:9081:0:(import.c:65:import_set_state_nolock()) ffff97e57fc88000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760594.211524:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:2402:x1876699777086336:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 1943us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.211534:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00080000:3.0:1789760594.212031:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760594.212037:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760594.236586:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.237444:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777086720 00000100:00100000:1.0:1789760594.237458:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777086720 00000100:00100000:1.0:1789760594.237561:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:1.0:1789760594.237574:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:0:x1876699777086720:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789760594.237631:0:6466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760594.237774:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:0:x1876699777086720:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 201us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.238504:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00080000:3.0:1789760594.238813:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760594.241721:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.241766:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760594.242010:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777086848 00000100:00100000:2.0:1789760594.242023:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777086848 00000100:00100000:2.0:1789760594.242119:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777086464 00000100:00100000:2.0:1789760594.242123:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777086464 00000100:00100000:2.0:1789760594.242148:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1789760594.242160:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+7:9304:x1876699777086848:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789760594.242228:0:9081:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760594.242343:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+7:9304:x1876699777086848:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 185us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.242351:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1789760594.242374:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1789760594.242382:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:0:x1876699777086464:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789760594.242393:0:9081:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760594.242418:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:0:x1876699777086464:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 38us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.242425:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00080000:0.0:1789760594.243371:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760594.246077:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760594.248381:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777087232 00000100:00100000:0.0:1789760594.248403:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777087232 00000100:00100000:0.0:1789760594.248504:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1789760594.248516:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:9304:x1876699777087232:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789760594.248667:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:9304:x1876699777087232:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 152us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.248675:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1789760594.260929:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.261449:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777087360 00000100:00100000:1.0:1789760594.261464:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777087360 00000100:00100000:1.0:1789760594.261524:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:1.0:1789760594.261534:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1876699777087360:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789760594.261578:0:8112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e138f4d1-d0ec-4b86-a7ba-bb29c025f420@192.168.203.38@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1789760594.261619:0:8112:0:(genops.c:1385:class_connect()) connect: client e138f4d1-d0ec-4b86-a7ba-bb29c025f420, cookie 0xc2b9a3a739856d29 00002000:00100000:1.0:1789760594.261636:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e138f4d1-d0ec-4b86-a7ba-bb29c025f420/ffff97e544915000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789760594.261649:0:8112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789760594.262558:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789760594.265324:0:8112:0:(import.c:65:import_set_state_nolock()) ffff97e544913800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760594.265481:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:2402:x1876699777087360:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 3939us (4560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.265494:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:1.0:1789760594.276448:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760594.276521:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760594.276697:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777087616 00000100:00100000:0.0:1789760594.276709:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777087616 00000100:00100000:0.0:1789760594.276831:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:0.0:1789760594.276844:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:9304:x1876699777087616:12345-192.168.203.38@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789760594.276959:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:9304:x1876699777087616:12345-192.168.203.38@tcp:900:mount.lustre.0 Request processed in 118us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.276968:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1789760594.277474:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777087488 00000100:00100000:2.0:1789760594.277482:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777087488 00000100:00100000:2.0:1789760594.277530:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1789760594.277538:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1876699777087488:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789760594.277574:0:9533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e138f4d1-d0ec-4b86-a7ba-bb29c025f420@192.168.203.38@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:2.0:1789760594.277612:0:9533:0:(genops.c:1385:class_connect()) connect: client e138f4d1-d0ec-4b86-a7ba-bb29c025f420, cookie 0xc2b9a3a739856d30 00002000:00100000:2.0:1789760594.277630:0:9533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e138f4d1-d0ec-4b86-a7ba-bb29c025f420/ffff97e57fc8d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760594.277664:0:9533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760594.278012:0:9533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789760594.279414:0:9533:0:(import.c:65:import_set_state_nolock()) ffff97e57fc8b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760594.279527:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:2402:x1876699777087488:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 1984us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.279540:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:1.0:1789760594.279719:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760594.281950:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777087744 00000100:00100000:2.0:1789760594.281971:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777087744 00000100:00100000:2.0:1789760594.282550:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1789760594.282565:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:9304:x1876699777087744:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789760594.282668:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789760594.282835:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+6:9304:x1876699777087744:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 272us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.282843:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00010000:00010000:2.0:1789760594.439134:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760595.463105:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760596.486922:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760596.678970:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798131840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760596.679044:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760596.679116:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798132096:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.679117:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798132352:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.679153:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.679201:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798132864:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.679432:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.679465:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798133376:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.679493:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.679527:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789760596.679533:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798132224:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.679562:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.679583:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798132736:0@lo:400:kworker.0 00000100:00100000:3.0:1789760596.679611:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798132864 00000100:00100000:3.0:1789760596.679619:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798132864 00000100:00100000:2.0:1789760596.679691:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.679718:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798133248:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.679743:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.679775:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798131968:0@lo:400:kworker.0 00000100:00100000:3.0:1789760596.679824:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798133376 00000100:00100000:3.0:1789760596.679828:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798133376 00000100:00100000:3.0:1789760596.679861:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789760596.679885:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.679947:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.679975:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798132480:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.680018:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760596.680024:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798132864:12345-0@lo:400:kworker.0 Request processed in 144us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760596.680034:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789760596.680043:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798132992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760596.680056:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789760596.680064:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798133376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.680094:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760596.680114:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798133376:12345-0@lo:400:kworker.0 Request processed in 51us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760596.680122:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760596.680134:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798131840 00000100:00100000:3.0:1789760596.680138:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798132992 00000100:00100000:2.0:1789760596.680140:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798131840 00000100:00100000:3.0:1789760596.680144:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798132992 00000100:00100000:3.0:1789760596.680189:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789760596.680194:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789760596.680199:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798132992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.680208:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798131840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760596.680238:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760596.680363:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798132992:12345-0@lo:400:kworker.0 Request processed in 166us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760596.680370:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789760596.680395:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760596.680399:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760596.680428:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798131840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.680436:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789760596.680457:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798132352 00000100:00100000:2.0:1789760596.680466:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798132352 00000100:00100000:2.0:1789760596.680495:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798132736 00000100:00100000:2.0:1789760596.680499:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798132736 00000100:00100000:2.0:1789760596.680524:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798133248 00000100:00100000:2.0:1789760596.680527:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798133248 00000100:00100000:2.0:1789760596.680546:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789760596.680552:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798132352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760596.680560:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789760596.680571:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798132736:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789760596.680590:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760596.680591:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798132352:12345-0@lo:400:kworker.0 Request processed in 37us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.680601:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789760596.680617:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798132736:12345-0@lo:400:kworker.0 Request processed in 48us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760596.680635:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789760596.680648:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789760596.680654:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798133248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.680691:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798132224 00000100:00100000:2.0:1789760596.680697:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798132224 00000100:00100000:2.0:1789760596.680727:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798132480 00000100:00100000:2.0:1789760596.680730:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798132480 00000100:00100000:2.0:1789760596.680743:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789760596.680749:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798132224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760596.680859:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798133248:12345-0@lo:400:kworker.0 Request processed in 204us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760596.680866:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789760596.680876:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798132224:12345-0@lo:400:kworker.0 Request processed in 36us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.680886:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789760596.680901:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789760596.680908:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.680938:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798132480:12345-0@lo:400:kworker.0 Request processed in 32us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.680945:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789760596.681039:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798131968 00000100:00100000:2.0:1789760596.681043:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798131968 00000100:00100000:2.0:1789760596.681074:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789760596.681081:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798131968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.681128:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798131968:12345-0@lo:400:kworker.0 Request processed in 47us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.681135:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789760596.681277:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.681435:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798132608:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.681466:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.681482:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798133120:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.681502:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.681519:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760596.681526:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798133504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760596.681548:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760596.681570:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798132096 00000100:00100000:2.0:1789760596.681574:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798132096 00000100:00100000:2.0:1789760596.681594:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798132608 00000100:00100000:2.0:1789760596.681597:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798132608 00000100:00100000:2.0:1789760596.681683:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798133120 00000100:00100000:2.0:1789760596.681687:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798133120 00000100:00100000:2.0:1789760596.681705:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789760596.681711:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798132096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.681750:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798132096:12345-0@lo:400:kworker.0 Request processed in 38us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.681755:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789760596.681768:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789760596.681774:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798132608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.681885:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798132608:12345-0@lo:400:kworker.0 Request processed in 110us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.681900:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789760596.681914:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789760596.681920:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798133120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.681948:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798133120:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.681954:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789760596.681987:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798131968:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.682000:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798132480:0@lo:400:kworker.0 00010000:00080000:2.0:1789760596.682014:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05ce00 x1876699798132992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760596.682023:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798132992:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.682077:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798132096:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.682085:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798132608:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.682094:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798133120:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.682119:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798132224:0@lo:400:kworker.0 00010000:00080000:2.0:1789760596.682130:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05e680 x1876699798132736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760596.682138:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798132736:0@lo:400:kworker.0 00010000:00080000:2.0:1789760596.682148:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05d880 x1876699798133248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760596.682155:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798133248:0@lo:400:kworker.0 00000100:00100000:2.0:1789760596.682175:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798132352:0@lo:400:kworker.0 00010000:00080000:2.0:1789760596.682194:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05ed80 x1876699798132864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760596.682201:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798132864:0@lo:400:kworker.0 00010000:00080000:2.0:1789760596.682211:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05e300 x1876699798133376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760596.682219:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798133376:0@lo:400:kworker.0 00010000:00080000:2.0:1789760596.682229:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05d180 x1876699798131840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760596.682242:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798131840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760596.687093:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798133504 00000100:00100000:2.0:1789760596.687108:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798133504 00000100:00100000:2.0:1789760596.687163:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789760596.687174:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798133504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760596.687210:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760596.687294:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798133504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (5744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760596.687301:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789760596.687322:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789760596.687389:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a187b80 x1876699798133504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760596.687409:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798133504:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1789760596.725428:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e138f4d1-d0ec-4b86-a7ba-bb29c025f420 00000001:00100000:0.0:1789760596.727675:0:7272:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e138f4d1-d0ec-4b86-a7ba-bb29c025f420 00000100:00100000:2.0:1789760597.193436:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798133632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760597.193545:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760597.193709:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798133632 00000100:00100000:1.0:1789760597.193719:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798133632 00000100:00100000:1.0:1789760597.193781:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789760597.193809:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798133632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760597.195409:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760597.196490:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798133632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2673us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760597.196503:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789760597.196656:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798133632:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760597.517660:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760597.707289:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798133760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760597.707362:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760597.707443:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798133760 00000100:00100000:2.0:1789760597.707451:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798133760 00000100:00100000:2.0:1789760597.707495:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789760597.707505:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798133760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760597.707543:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760597.707590:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798133760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760597.707597:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789760597.707644:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798133760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760598.215512:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760598.215534:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798133888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760598.215601:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760598.215856:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798134016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760598.215886:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760598.216025:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798133888 00000100:00100000:2.0:1789760598.216033:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798133888 00000100:00100000:2.0:1789760598.216099:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798134016 00000100:00100000:2.0:1789760598.216103:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798134016 00000100:00100000:2.0:1789760598.216124:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789760598.216132:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798133888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760598.216166:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789760598.216283:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760598.216444:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798133888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 311us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760598.216451:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789760598.216468:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789760598.216475:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798134016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760598.216485:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760598.216530:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798134016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760598.216536:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789760598.216612:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05d180 x1876699798134016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760598.216631:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798134016:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789760598.216663:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f718700 x1876699798133888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760598.216675:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798133888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789760598.535501:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789760598.858394:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e138f4d1-d0ec-4b86-a7ba-bb29c025f420 00000001:00100000:1.0:1789760598.864035:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e138f4d1-d0ec-4b86-a7ba-bb29c025f420 00010000:00010000:1.0:1789760599.559033:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760599.607200:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760599.607271:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760599.607307:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760599.607343:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760599.607364:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760599.607381:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760599.607406:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760599.607430:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777088128 00000100:00100000:0.0:1789760599.607440:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777088128 00000100:00100000:0.0:1789760599.607522:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777088384 00000100:00100000:0.0:1789760599.607525:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777088384 00000100:00100000:0.0:1789760599.607541:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777088000 00000100:00100000:0.0:1789760599.607544:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777088000 00000100:00100000:0.0:1789760599.607557:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777088256 00000100:00100000:0.0:1789760599.607560:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777088256 00000100:00100000:0.0:1789760599.607577:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:0.0:1789760599.607586:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777088128:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760599.607653:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:3.0:1789760599.607663:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777088384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760599.607682:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777088128:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 96us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760599.607707:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777088384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760599.607715:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:3.0:1789760599.607729:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:0.0:1789760599.607738:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:0.0:1789760599.607747:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777088000:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760599.607753:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:3.0:1789760599.607763:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777088256:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760599.607784:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777088000:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760599.607839:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:3.0:1789760599.607840:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777088256:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760599.607850:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:3.0:1789760599.607874:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777088640 00000100:00100000:3.0:1789760599.607879:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777088640 00000100:00100000:0.0:1789760599.607919:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777088512 00000100:00100000:3.0:1789760599.607923:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:0.0:1789760599.607925:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777088512 00000100:00100000:3.0:1789760599.607934:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777088640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760599.607957:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:0.0:1789760599.607969:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777088512:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760599.607969:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777088640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760599.607982:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:0.0:1789760599.608004:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777088512:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760599.608011:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00080000:1.0:1789760599.608540:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760599.608556:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760599.608559:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760599.608561:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760599.609151:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777087872 00000100:00100000:2.0:1789760599.609166:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777087872 00000100:00100000:2.0:1789760599.609213:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 304 00000100:00100000:2.0:1789760599.609229:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777087872:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760599.609267:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777087872:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 46us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760599.609274:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 304 00000001:02000400:2.0:1789760600.563602:0:11965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789760600.587919:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760601.607916:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760601.801400:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798134144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760601.801464:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760601.801539:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798134272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760601.801564:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760601.801595:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798134144 00000100:00100000:2.0:1789760601.801601:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798134144 00000100:00100000:2.0:1789760601.801641:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798134272 00000100:00100000:2.0:1789760601.801644:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798134272 00000100:00100000:2.0:1789760601.801659:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789760601.801666:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798134144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760601.801697:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760601.801737:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798134144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760601.801744:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789760601.801759:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789760601.801775:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798134272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760601.801801:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760601.801831:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798134272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760601.801836:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1789760601.801853:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789760601.801878:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f719c00 x1876699798134144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760601.801897:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798134144:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789760601.801923:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f718380 x1876699798134272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760601.801934:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798134272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760601.802362:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798134528:0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.802406:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760601.802430:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798135040:0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.802451:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760601.802470:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798135552:0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.802488:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760601.802505:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789760601.802510:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798134656:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.802598:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798134400:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.802632:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760601.802656:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798134912:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.802697:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760601.802713:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798135424:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.802736:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760601.802755:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789760601.802759:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798134784:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.802779:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760601.802815:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798135296:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.802844:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760601.802863:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798135424 00000100:00100000:3.0:1789760601.802869:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798135424 00000100:00100000:0.0:1789760601.802879:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798134528 00000100:00100000:0.0:1789760601.802882:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798134528 00000100:00100000:0.0:1789760601.802901:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798135040 00000100:00100000:0.0:1789760601.802904:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798135040 00000100:00100000:3.0:1789760601.802904:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798135296 00000100:00100000:3.0:1789760601.802906:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798135296 00000100:00100000:0.0:1789760601.802916:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798135552 00000100:00100000:0.0:1789760601.802918:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798135552 00000100:00100000:3.0:1789760601.802922:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789760601.802928:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798135424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.802929:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798134784 00000100:00100000:0.0:1789760601.802931:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798134784 00000100:00100000:0.0:1789760601.802953:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789760601.802958:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798134528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.803247:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760601.803292:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798134528:12345-0@lo:400:kworker.0 Request processed in 333us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.803300:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789760601.803315:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789760601.803321:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798135040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.803348:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798135040:12345-0@lo:400:kworker.0 Request processed in 28us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.803354:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789760601.803365:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789760601.803370:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798135552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.803393:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798135552:12345-0@lo:400:kworker.0 Request processed in 23us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.803397:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789760601.803407:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789760601.803411:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798134784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.803433:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798134784:12345-0@lo:400:kworker.0 Request processed in 21us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.803445:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789760601.803481:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798134400 00000100:00100000:0.0:1789760601.803485:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798134400 00000100:00100000:0.0:1789760601.803508:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789760601.803514:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798134400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.803559:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798134400:12345-0@lo:400:kworker.0 Request processed in 45us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.803564:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789760601.803588:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798134912 00000100:00100000:0.0:1789760601.803591:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798134912 00000100:00100000:0.0:1789760601.803634:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798134656 00000100:00100000:0.0:1789760601.803637:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798134656 00000100:00100000:0.0:1789760601.803649:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789760601.803654:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798134912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.803684:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798134912:12345-0@lo:400:kworker.0 Request processed in 30us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.803691:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789760601.807835:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798135424:12345-0@lo:400:kworker.0 Request processed in 4896us (5087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760601.807851:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789760601.807879:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789760601.807882:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789760601.807890:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798135296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.807891:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798134656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.810178:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798134656:12345-0@lo:400:kworker.0 Request processed in 2251us (6894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.810193:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789760601.810496:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798134784:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.810511:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798134400:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.810522:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798134912:0@lo:400:kworker.0 00010000:00080000:0.0:1789760601.810550:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f71b100 x1876699798135424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760601.810562:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798135424:0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.810759:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798134656:0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.810770:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798135168:0@lo:400:kworker.0 00000100:00080000:1.0:1789760601.810896:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760601.810902:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760601.811135:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760601.811174:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798135680:0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.811196:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760601.811220:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798134528:0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.811231:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798135040:0@lo:400:kworker.0 00000100:00100000:2.0:1789760601.811240:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798135552:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.815006:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798135168 00000100:00100000:0.0:1789760601.815022:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798135168 00000100:00100000:0.0:1789760601.815087:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798135680 00000100:00100000:0.0:1789760601.815090:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798135680 00000100:00100000:0.0:1789760601.815115:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789760601.815123:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798135168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760601.815266:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798135296:12345-0@lo:400:kworker.0 Request processed in 7378us (12418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760601.815276:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1789760601.819910:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f718a80 x1876699798135296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760601.819928:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798135296:0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.822653:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798135168:12345-0@lo:400:kworker.0 Request processed in 7522us (11508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.822667:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789760601.822709:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789760601.822724:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798135680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760601.822815:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798135680:12345-0@lo:400:kworker.0 Request processed in 99us (11617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.823175:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1789760601.823310:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789760601.832949:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f71aa00 x1876699798135168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760601.832968:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798135168:0@lo:400:kworker.0 00010000:00080000:3.0:1789760601.832982:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a187b80 x1876699798135680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760601.832990:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798135680:0@lo:400:kworker.0 00000100:00100000:3.0:1789760602.311241:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760602.311268:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798135808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760602.311363:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760602.311453:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798135808 00000100:00100000:0.0:1789760602.311471:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798135808 00000100:00100000:0.0:1789760602.311524:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789760602.311534:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798135808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760602.311569:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760602.311620:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798135808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760602.311627:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789760602.311685:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798135808:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789760602.638075:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760602.823059:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760602.823092:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798135936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760602.823220:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760602.823315:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798135936 00000100:00100000:2.0:1789760602.823337:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798135936 00000100:00100000:2.0:1789760602.823399:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789760602.823410:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798135936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760602.823466:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760602.823520:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798135936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760602.823528:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789760602.823589:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798135936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760603.349755:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798136064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760603.349883:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.349974:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798136064 00000100:00100000:1.0:1789760603.349984:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798136064 00000100:00100000:1.0:1789760603.350055:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789760603.350065:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a7d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798136064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760603.350111:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760603.350203:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a7d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798136064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760603.350211:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789760603.350440:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760603.350512:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f875c00 x1876699798136064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760603.350533:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798136064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760603.358413:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798136192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760603.358507:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.358593:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798136192 00000100:00100000:1.0:1789760603.358609:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798136192 00000100:00100000:1.0:1789760603.358687:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789760603.358697:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798136192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760603.358727:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760603.358779:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798136192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760603.358802:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1789760603.358852:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05ed80 x1876699798136192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760603.358878:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798136192:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789760603.361419:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760603.655063:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760604.679923:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760604.717914:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760604.717982:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760604.718014:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760604.718046:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760604.718077:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760604.718079:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777088768 00000100:00100000:2.0:1789760604.718089:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777088768 00000100:00100000:3.0:1789760604.718105:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760604.718147:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760604.718172:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777088896 00000100:00100000:3.0:1789760604.718177:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777088896 00000100:00100000:3.0:1789760604.718211:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777089152 00000100:00100000:3.0:1789760604.718214:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777089152 00000100:00100000:3.0:1789760604.718228:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777089024 00000100:00100000:3.0:1789760604.718230:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777089024 00000100:00100000:2.0:1789760604.718240:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 306 00000100:00100000:3.0:1789760604.718244:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777089280 00000100:00100000:3.0:1789760604.718248:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777089280 00000100:00100000:2.0:1789760604.718259:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777088768:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760604.718269:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:3.0:1789760604.718278:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777088896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760604.718335:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777088768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760604.718351:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 306 00000100:00100000:0.0:1789760604.718378:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:0.0:1789760604.718390:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777089152:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760604.723078:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777088896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 4788us (5161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760604.723095:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:3.0:1789760604.723146:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:3.0:1789760604.723162:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777089024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760604.723244:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777089024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 90us (5198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760604.723251:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:3.0:1789760604.723266:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:3.0:1789760604.723273:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777089280:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760604.723301:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777089280:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (5196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760604.723322:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:3.0:1789760604.723352:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777089408 00000100:00100000:3.0:1789760604.723359:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777089408 00000100:00100000:3.0:1789760604.723411:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777089536 00000100:00100000:3.0:1789760604.723415:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777089536 00000100:00100000:3.0:1789760604.723442:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:3.0:1789760604.723449:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777089408:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760604.723527:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:1.0:1789760604.723537:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777089536:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760604.723577:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777089408:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 128us (5500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760604.723585:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00080000:3.0:1789760604.723620:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760604.723624:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760604.723627:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760604.723629:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760604.732687:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777089152:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 14287us (14660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760604.732702:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:2.0:1789760604.736431:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777089536:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 12884us (18271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760604.736446:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00010000:00010000:1.0:1789760605.702954:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760606.729211:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760606.920418:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798136320:0@lo:400:kworker.0 00000100:00100000:1.0:1789760606.920430:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798136576:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.920732:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.920804:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798136832:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.920845:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.920866:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798137344:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.920889:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.920904:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798137856:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.920923:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.920941:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789760606.920946:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798136448:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.920966:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.920981:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798136960:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.920998:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.921012:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798137472:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.921030:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.921058:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798136320 00000100:00100000:0.0:1789760606.921064:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798136320 00000100:00100000:0.0:1789760606.921134:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789760606.921143:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798136320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.921191:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798136320:12345-0@lo:400:kworker.0 Request processed in 49us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760606.921198:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789760606.921465:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798136320:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.921993:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798136832 00000100:00100000:3.0:1789760606.921999:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798136832 00000100:00100000:3.0:1789760606.922039:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789760606.922046:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798136832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.922099:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798136832:12345-0@lo:400:kworker.0 Request processed in 53us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760606.922117:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789760606.922137:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798137344 00000100:00100000:3.0:1789760606.922141:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798137344 00000100:00100000:3.0:1789760606.922170:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798137856 00000100:00100000:3.0:1789760606.922173:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798137856 00000100:00100000:3.0:1789760606.922194:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760606.922201:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798137344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760606.922331:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.922358:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798136576 00000100:00100000:0.0:1789760606.922362:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798136576 00000100:00100000:0.0:1789760606.922383:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789760606.922383:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798136704:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.922388:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798136576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760606.922412:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.922417:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798136576:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760606.922423:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789760606.922430:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798137216:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.922439:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798136448 00000100:00100000:0.0:1789760606.922442:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798136448 00000100:00100000:1.0:1789760606.922451:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.922457:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798136960 00000100:00100000:0.0:1789760606.922460:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798136960 00000100:00100000:1.0:1789760606.922461:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798137728:0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.922472:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798137472 00000100:00100000:0.0:1789760606.922474:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798137472 00000100:00100000:1.0:1789760606.922481:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.922486:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798136704 00000100:00100000:0.0:1789760606.922488:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798136704 00000100:00100000:0.0:1789760606.922515:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789760606.922521:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798136448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.922550:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798136448:12345-0@lo:400:kworker.0 Request processed in 29us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760606.922557:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789760606.922567:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789760606.922572:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798136960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.922620:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798136960:12345-0@lo:400:kworker.0 Request processed in 47us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760606.922626:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789760606.922637:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789760606.922642:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798137472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.922666:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798137472:12345-0@lo:400:kworker.0 Request processed in 24us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760606.922672:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789760606.922683:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789760606.922688:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798136704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760606.922718:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798136704:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760606.922723:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789760606.922981:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798137344:12345-0@lo:400:kworker.0 Request processed in 780us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760606.922987:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760606.922999:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798137216 00000100:00100000:3.0:1789760606.923002:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798137216 00000100:00100000:3.0:1789760606.923017:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798137728 00000100:00100000:3.0:1789760606.923020:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798137728 00000100:00100000:3.0:1789760606.923032:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789760606.923037:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798137856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760606.923040:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798136576:0@lo:400:kworker.0 00000100:00100000:1.0:1789760606.923047:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798137088:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.923064:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798137856:12345-0@lo:400:kworker.0 Request processed in 28us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760606.923069:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789760606.923079:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760606.923080:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789760606.923085:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798137216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760606.923097:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798137600:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.923124:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798137216:12345-0@lo:400:kworker.0 Request processed in 39us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760606.923130:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789760606.923131:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760606.923141:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789760606.923147:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798137728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760606.923166:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798136704:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.923171:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798137728:12345-0@lo:400:kworker.0 Request processed in 25us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760606.923176:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1789760606.923178:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f920380 x1876699798137216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760606.923187:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798137216:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.923194:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798137088 00010000:00080000:1.0:1789760606.923196:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f920a80 x1876699798137728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760606.923197:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798137088 00000100:00100000:1.0:1789760606.923204:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798137728:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.924038:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798137600 00000100:00100000:3.0:1789760606.924045:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798137600 00000100:00100000:3.0:1789760606.924062:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789760606.924077:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798137088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.924138:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798137088:12345-0@lo:400:kworker.0 Request processed in 61us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760606.924144:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789760606.924157:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789760606.924163:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798137600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.924187:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798137600:12345-0@lo:400:kworker.0 Request processed in 25us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760606.924193:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1789760606.924397:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760606.924402:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760606.924405:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760606.924407:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760606.924478:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f923b80 x1876699798137088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760606.925715:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760606.925732:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798138112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760606.925914:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798137984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760606.926466:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760606.926513:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798137984 00000100:00100000:1.0:1789760606.926520:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798137984 00000100:00100000:1.0:1789760606.926562:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789760606.926571:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798137984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760606.926606:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760606.926649:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798137984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760606.926656:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1789760606.926691:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f71d180 x1876699798137984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760606.926708:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798137984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760606.927282:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798137088:0@lo:400:kworker.0 00010000:00080000:3.0:1789760606.927344:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f923100 x1876699798137600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760606.927355:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798137600:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.927480:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798136448:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.927492:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798136960:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.927514:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798137472:0@lo:400:kworker.0 00000100:00100000:3.0:1789760606.927525:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798136832:0@lo:400:kworker.0 00010000:00080000:3.0:1789760606.927550:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f921c00 x1876699798137344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760606.927558:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798137344:0@lo:400:kworker.0 00010000:00080000:3.0:1789760606.927569:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57a223800 x1876699798137856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760606.927576:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798137856:0@lo:400:kworker.0 00000100:00100000:2.0:1789760606.927882:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.928283:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798138112 00000100:00100000:0.0:1789760606.928290:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798138112 00000100:00100000:0.0:1789760606.928325:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789760606.928333:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798138112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760606.928351:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760606.928396:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798138112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760606.928402:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1789760606.928560:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f71d500 x1876699798138112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760606.928576:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798138112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760607.430962:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798138240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760607.431035:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760607.431298:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798138240 00000100:00100000:2.0:1789760607.431305:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798138240 00000100:00100000:2.0:1789760607.432167:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789760607.432181:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798138240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760607.432221:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760607.432475:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798138240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 298us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760607.432483:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789760607.432822:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798138240:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789760607.752026:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760607.943162:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798138368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760607.943269:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760607.943492:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798138368 00000100:00100000:0.0:1789760607.943502:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798138368 00000100:00100000:0.0:1789760607.943570:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789760607.943582:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798138368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760607.943657:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789760607.943768:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798138368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 187us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760607.943776:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789760607.946882:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798138368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760608.455169:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798138496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760608.455267:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760608.455463:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760608.455474:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798138624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760608.455508:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760608.455555:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798138496 00000100:00100000:3.0:1789760608.455564:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798138496 00000100:00100000:3.0:1789760608.455621:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798138624 00000100:00100000:3.0:1789760608.455624:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798138624 00000100:00100000:3.0:1789760608.455645:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789760608.455656:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798138496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760608.455704:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760608.455758:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798138496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760608.455766:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789760608.455784:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789760608.455831:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798138624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760608.455842:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760608.455871:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798138624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760608.455877:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789760608.455892:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760608.455923:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f05ce00 x1876699798138624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760608.455945:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798138624:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789760608.455987:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f874000 x1876699798138496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760608.455999:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798138496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789760608.776261:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760609.800410:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760609.840981:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760609.841045:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760609.841074:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760609.841125:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777089920 00000100:00100000:2.0:1789760609.841126:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760609.841140:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777089920 00000100:00100000:2.0:1789760609.841168:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760609.841194:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760609.841226:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760609.841252:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777090176 00000100:00100000:2.0:1789760609.841257:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777090176 00000100:00100000:2.0:1789760609.841306:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777089792 00000100:00100000:2.0:1789760609.841309:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777089792 00000100:00100000:2.0:1789760609.841325:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777090048 00000100:00100000:2.0:1789760609.841328:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777090048 00000100:00100000:2.0:1789760609.841348:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1789760609.841372:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090176:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760609.841476:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090176:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 119us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760609.841485:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1789760609.841518:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:2.0:1789760609.841525:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777089792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760609.841554:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777089792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760609.841560:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:2.0:1789760609.841573:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:2.0:1789760609.841579:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090048:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760609.841605:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090048:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760609.841612:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:2.0:1789760609.841632:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777090432 00000100:00100000:2.0:1789760609.841643:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777090432 00000100:00100000:2.0:1789760609.841677:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777090304 00000100:00100000:2.0:1789760609.841680:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777090304 00000100:00100000:2.0:1789760609.841702:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:2.0:1789760609.841709:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090432:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760609.841738:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090432:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760609.841744:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:2.0:1789760609.841755:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:2.0:1789760609.841761:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090304:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760609.841806:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090304:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760609.841813:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:1.0:1789760609.842067:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:1.0:1789760609.842077:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777089920:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760609.842127:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777089920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 52us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760609.842134:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00080000:1.0:1789760609.842152:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760609.842156:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760609.842159:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760609.842161:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760609.842286:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777089664 00000100:00100000:0.0:1789760609.842293:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777089664 00000100:00100000:0.0:1789760609.842327:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 308 00000100:00100000:0.0:1789760609.842335:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777089664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760609.842379:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777089664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 44us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760609.842386:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 308 00010000:00010000:0.0:1789760610.831183:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760611.847934:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760612.039236:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798138752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760612.039305:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.039372:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798138752 00000100:00100000:2.0:1789760612.039379:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798138752 00000100:00100000:2.0:1789760612.039428:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789760612.039437:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798138752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760612.039468:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760612.039510:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798138752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760612.039517:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789760612.039536:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789760612.039562:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f71d880 x1876699798138752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760612.039586:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798138752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760612.042383:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798138880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760612.042444:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.042886:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798138880 00000100:00100000:2.0:1789760612.042893:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798138880 00000100:00100000:2.0:1789760612.042944:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789760612.042953:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798138880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760612.042973:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760612.043017:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798138880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (571us total) trans 0 rc 0/0 00000100:00080000:3.0:1789760612.043886:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760612.044246:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789760612.044330:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f71d880 x1876699798138880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760612.044353:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798138880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760612.046290:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798139136:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046353:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.046383:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798139648:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046404:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.046423:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798140160:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046442:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.046472:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789760612.046479:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798139264:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046504:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.046531:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798139776:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046552:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.046568:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798140288:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046589:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.046612:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798139136 00000100:00100000:2.0:1789760612.046618:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798139136 00000100:00100000:2.0:1789760612.046649:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798139648 00000100:00100000:2.0:1789760612.046652:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798139648 00000100:00100000:2.0:1789760612.046675:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798140160 00000100:00100000:2.0:1789760612.046678:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798140160 00000100:00100000:2.0:1789760612.046692:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798139776 00000100:00100000:2.0:1789760612.046694:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798139776 00000100:00100000:2.0:1789760612.046734:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798140288 00000100:00100000:2.0:1789760612.046737:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798140288 00000100:00100000:2.0:1789760612.046755:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789760612.046763:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798139136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046835:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798139136:12345-0@lo:400:kworker.0 Request processed in 72us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760612.046842:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789760612.046857:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789760612.046864:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798139648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046893:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798139648:12345-0@lo:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760612.046899:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789760612.046912:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789760612.046919:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798140160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.046946:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798140160:12345-0@lo:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760612.046961:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789760612.046975:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789760612.046981:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798139776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760612.049547:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789760612.049563:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798140288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760612.049639:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798140288:12345-0@lo:400:kworker.0 Request processed in 81us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760612.049647:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789760612.049680:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798139008:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.051144:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798139776:12345-0@lo:400:kworker.0 Request processed in 4160us (4587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760612.051154:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789760612.051351:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798139264 00000100:00100000:2.0:1789760612.051361:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798139264 00000100:00100000:2.0:1789760612.051401:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789760612.051409:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798139264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.051469:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798139264:12345-0@lo:400:kworker.0 Request processed in 62us (4965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760612.051475:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1789760612.051500:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760612.051505:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760612.051537:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798139264:0@lo:400:kworker.0 00010000:00080000:2.0:1789760612.051553:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f095c00 x1876699798139776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760612.051562:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798139776:0@lo:400:kworker.0 00010000:00080000:2.0:1789760612.051573:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0a300 x1876699798140288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760612.051580:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798140288:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.051592:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798139136:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.051602:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798139648:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.051626:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798140160:0@lo:400:kworker.0 00000100:00100000:3.0:1789760612.051683:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760612.051734:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798139520:0@lo:400:kworker.0 00000100:00100000:3.0:1789760612.051766:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760612.051783:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798140032:0@lo:400:kworker.0 00000100:00100000:3.0:1789760612.051837:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760612.051859:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789760612.051866:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798139392:0@lo:400:kworker.0 00000100:00100000:3.0:1789760612.051890:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760612.051905:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798139904:0@lo:400:kworker.0 00000100:00100000:3.0:1789760612.051925:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760612.051952:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798140032 00000100:00100000:3.0:1789760612.051955:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798140032 00000100:00100000:3.0:1789760612.051986:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798139904 00000100:00100000:3.0:1789760612.051989:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798139904 00000100:00100000:3.0:1789760612.052006:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789760612.052012:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798140032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760612.052275:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798139520 00000100:00100000:1.0:1789760612.052279:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798139520 00000100:00100000:1.0:1789760612.052306:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789760612.052313:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798139520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760612.052354:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798139520:12345-0@lo:400:kworker.0 Request processed in 42us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760612.052360:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789760612.052391:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798139520:0@lo:400:kworker.0 00000100:00100000:1.0:1789760612.053420:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789760612.053434:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798139904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760612.053488:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798139904:12345-0@lo:400:kworker.0 Request processed in 59us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760612.053495:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789760612.053518:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798139392 00000100:00100000:1.0:1789760612.053523:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798139392 00000100:00100000:1.0:1789760612.053558:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789760612.053565:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798139392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760612.053595:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798139392:12345-0@lo:400:kworker.0 Request processed in 31us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760612.053601:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789760612.053632:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798139392:0@lo:400:kworker.0 00010000:00080000:1.0:1789760612.053645:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f094700 x1876699798139904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760612.053655:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798139904:0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.053816:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798139008 00000100:00100000:2.0:1789760612.053821:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798139008 00000100:00100000:2.0:1789760612.053850:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789760612.053856:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798139008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760612.053893:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798139008:12345-0@lo:400:kworker.0 Request processed in 37us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760612.053899:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789760612.055230:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798140032:12345-0@lo:400:kworker.0 Request processed in 3211us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760612.055240:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789760612.055292:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760612.055887:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798139008:0@lo:400:kworker.0 00010000:00080000:1.0:1789760612.055905:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f094000 x1876699798140032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760612.055918:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798140032:0@lo:400:kworker.0 00000100:00100000:0.0:1789760612.557964:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798140416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760612.558109:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760612.563826:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798140416 00000100:00100000:2.0:1789760612.563839:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798140416 00000100:00100000:2.0:1789760612.563887:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789760612.563897:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798140416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760612.563934:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760612.564014:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798140416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760612.564527:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789760612.564592:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798140416:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760612.870940:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760613.063169:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798140544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760613.063281:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760613.063525:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798140544 00000100:00100000:2.0:1789760613.063536:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798140544 00000100:00100000:2.0:1789760613.063613:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789760613.063624:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798140544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760613.063675:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760613.063750:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798140544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760613.063778:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789760613.063948:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798140544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760613.575189:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798140672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760613.575287:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760613.575362:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760613.575369:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798140800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760613.575395:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760613.575433:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798140672 00000100:00100000:3.0:1789760613.575442:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798140672 00000100:00100000:3.0:1789760613.575518:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798140800 00000100:00100000:3.0:1789760613.575521:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798140800 00000100:00100000:3.0:1789760613.580614:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760613.580649:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798140672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760613.580720:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760613.580874:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798140672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 242us (5585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760613.580883:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760613.580922:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789760613.580931:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798140800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760613.580944:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760613.580973:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798140800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (5577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760613.580980:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1789760613.582232:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f8a1f80 x1876699798140800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760613.582265:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798140800:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789760613.582282:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f8a0a80 x1876699798140672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760613.582294:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798140672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760613.896626:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760614.933494:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760614.965654:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760614.973387:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760614.973425:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760614.973513:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760614.973539:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777091200 00000100:00100000:3.0:1789760614.973539:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760614.973590:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777091200 00000100:00100000:1.0:1789760614.973672:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:1.0:1789760614.973685:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2402:x1876699777091200:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:1.0:1789760614.973737:0:8110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2b9a3a739856d29 00000100:00080000:1.0:1789760614.973749:0:8110:0:(import.c:65:import_set_state_nolock()) ffff97e544913800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789760614.973810:0:8110:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789760614.974165:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+2:2402:x1876699777091200:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 482us (8540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760614.974174:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00080000:1.0:1789760614.974200:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760614.982239:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760614.986501:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777090688 00000100:00100000:2.0:1789760614.986522:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777090688 00000100:00100000:2.0:1789760614.986608:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777090944 00000100:00100000:2.0:1789760614.986611:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777090944 00000100:00100000:2.0:1789760614.986625:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777090816 00000100:00100000:2.0:1789760614.986628:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777090816 00000100:00100000:2.0:1789760614.986653:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:2.0:1789760614.986663:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777090688:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760614.986777:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777090688:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 116us (13422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760614.986797:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:2.0:1789760614.986817:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:2.0:1789760614.986823:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090944:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760614.986848:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777090944:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (13423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760614.986855:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:2.0:1789760614.986866:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:2.0:1789760614.986873:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777090816:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760614.986896:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777090816:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (13358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760614.986902:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 172 00010000:00010000:2.0:1789760614.986935:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760614.990983:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777091072 00000100:00100000:3.0:1789760614.991004:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777091072 00000100:00100000:3.0:1789760614.991101:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:3.0:1789760614.991118:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777091072:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760614.991224:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777091072:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 112us (8997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760614.991233:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00080000:3.0:1789760614.991272:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760614.991278:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760614.991706:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760614.992095:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777090560 00000100:00100000:3.0:1789760614.992103:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777090560 00000100:00100000:2.0:1789760614.992186:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777091328 00000100:00100000:2.0:1789760614.992202:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777091328 00000100:00100000:3.0:1789760614.992220:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:3.0:1789760614.992233:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777090560:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760614.992256:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:2.0:1789760614.992266:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2402:x1876699777091328:12345-192.168.203.38@tcp:9:kworker.0 00000100:00100000:3.0:1789760614.992288:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777090560:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 58us (18773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760614.992298:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 310 00000020:00000080:2.0:1789760614.992299:0:8112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2b9a3a739856d30 00000100:00080000:2.0:1789760614.992314:0:8112:0:(import.c:65:import_set_state_nolock()) ffff97e57fc8b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789760614.992371:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789760614.992685:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+2:2402:x1876699777091328:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 420us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760614.992693:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00080000:2.0:1789760614.992718:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789760614.993879:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760615.943967:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760616.967459:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760617.173533:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798141056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760617.173637:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760617.173730:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760617.173737:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798140928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760617.173761:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760617.173822:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798141056 00000100:00100000:3.0:1789760617.173833:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798141056 00000100:00100000:3.0:1789760617.173888:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798140928 00000100:00100000:3.0:1789760617.173891:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798140928 00000100:00100000:3.0:1789760617.173911:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789760617.173920:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798141056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760617.173961:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760617.174008:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798141056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760617.174015:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789760617.174046:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789760617.174053:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798140928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760617.174274:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760617.174301:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798140928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 249us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760617.174308:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1789760617.174327:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789760617.174360:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0a300 x1876699798140928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760617.174392:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798140928:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789760617.174405:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e543e0bb80 x1876699798141056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760617.174416:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798141056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760617.175247:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798141312:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.175298:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760617.175319:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798141824:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.175336:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760617.175352:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798142336:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.175370:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760617.175395:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789760617.175400:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798141184:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.175428:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760617.175453:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798141696:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.175478:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760617.175496:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798142208:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.175533:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760617.175567:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798141312 00000100:00100000:1.0:1789760617.175573:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798141312 00000100:00100000:1.0:1789760617.175610:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798141824 00000100:00100000:1.0:1789760617.175613:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798141824 00000100:00100000:1.0:1789760617.175631:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798142336 00000100:00100000:1.0:1789760617.175634:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798142336 00000100:00100000:1.0:1789760617.175659:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789760617.175666:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798141312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.176259:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798141312:12345-0@lo:400:kworker.0 Request processed in 590us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760617.176268:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789760617.176289:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789760617.176297:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798141824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.176325:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798141824:12345-0@lo:400:kworker.0 Request processed in 30us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760617.176331:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789760617.176341:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789760617.176346:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798142336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.176385:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798142336:12345-0@lo:400:kworker.0 Request processed in 26us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760617.176392:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789760617.176417:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798141184 00000100:00100000:1.0:1789760617.176422:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798141184 00000100:00100000:1.0:1789760617.176451:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789760617.176457:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798141184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.176487:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798141184:12345-0@lo:400:kworker.0 Request processed in 31us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760617.176493:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789760617.176619:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798141696 00000100:00100000:1.0:1789760617.176623:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798141696 00000100:00100000:1.0:1789760617.176651:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789760617.176657:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798141696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.176813:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798141696:12345-0@lo:400:kworker.0 Request processed in 155us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760617.176819:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789760617.176839:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798142208 00000100:00100000:1.0:1789760617.176842:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798142208 00000100:00100000:1.0:1789760617.176869:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789760617.176875:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798142208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.176903:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798142208:12345-0@lo:400:kworker.0 Request processed in 29us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760617.176909:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789760617.176958:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798141184:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.176971:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798141696:0@lo:400:kworker.0 00010000:00080000:1.0:1789760617.176984:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dd180 x1876699798142208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760617.176996:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798142208:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.177007:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798141312:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.177016:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798141824:0@lo:400:kworker.0 00000100:00100000:1.0:1789760617.177039:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798142336:0@lo:400:kworker.0 00000100:00080000:3.0:1789760617.177189:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760617.177195:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760617.177209:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798141568:0@lo:400:kworker.0 00000100:00100000:3.0:1789760617.177248:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760617.177273:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798142080:0@lo:400:kworker.0 00000100:00100000:3.0:1789760617.177295:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760617.177313:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789760617.177320:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798141440:0@lo:400:kworker.0 00000100:00100000:3.0:1789760617.177343:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760617.177360:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798141952:0@lo:400:kworker.0 00000100:00100000:3.0:1789760617.177391:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760617.177409:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798142464:0@lo:400:kworker.0 00000100:00100000:3.0:1789760617.177429:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760617.177471:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798142080 00000100:00100000:3.0:1789760617.177476:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798142080 00000100:00100000:3.0:1789760617.177523:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789760617.177530:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798142080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760617.177774:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798141568 00000100:00100000:3.0:1789760617.177777:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798142080:12345-0@lo:400:kworker.0 Request processed in 246us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760617.177779:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798141568 00000100:00100000:3.0:1789760617.177784:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789760617.177816:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798141952 00000100:00100000:0.0:1789760617.177820:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798141952 00000100:00100000:3.0:1789760617.177825:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798141440 00000100:00100000:3.0:1789760617.177828:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798141440 00000100:00100000:0.0:1789760617.177834:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798142464 00000100:00100000:0.0:1789760617.177836:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798142464 00000100:00100000:3.0:1789760617.177849:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789760617.177850:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789760617.177856:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798141440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760617.177857:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798141568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760617.177945:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798141440:0@lo:400:kworker.0 00000100:00100000:2.0:1789760617.177957:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798141568:0@lo:400:kworker.0 00010000:00080000:2.0:1789760617.177968:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dfb80 x1876699798142080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760617.177977:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798142080:0@lo:400:kworker.0 00000100:00100000:2.0:1789760617.178246:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789760617.178255:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798141952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760617.190731:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798141440:12345-0@lo:400:kworker.0 Request processed in 12859us (13371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760617.190749:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1789760617.190835:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760617.190843:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760617.193672:0:6465:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789760617.193706:0:6465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789760617.193887:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789760617.193906:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798142464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760617.194387:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798142464:12345-0@lo:400:kworker.0 Request processed in 484us (16952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760617.194397:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:3.0:1789760617.194481:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1df100 x1876699798142464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760617.194501:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798142464:0@lo:400:kworker.0 00000100:00100000:0.0:1789760617.200754:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798141568:12345-0@lo:400:kworker.0 Request processed in 22882us (23489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760617.200804:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789760617.203025:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798141952:12345-0@lo:400:kworker.0 Request processed in 24761us (25622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760617.203052:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:0.0:1789760617.204564:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dea00 x1876699798141952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760617.204586:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798141952:0@lo:400:kworker.0 00000100:00100000:0.0:1789760617.675852:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760617.675881:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798142592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760617.675977:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760617.676089:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798142592 00000100:00100000:0.0:1789760617.676099:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798142592 00000100:00100000:0.0:1789760617.676161:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789760617.676172:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798142592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760617.676224:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760617.676276:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798142592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760617.676283:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789760617.676348:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798142592:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760617.991389:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760618.190731:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760618.190771:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798142720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760618.190885:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760618.190964:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798142720 00000100:00100000:3.0:1789760618.190974:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798142720 00000100:00100000:3.0:1789760618.191041:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789760618.191052:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798142720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760618.191111:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760618.191164:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798142720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760618.191172:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789760618.191231:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798142720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760618.698942:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760618.698968:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798142848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760618.699068:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760618.699285:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760618.699297:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798142976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760618.699327:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760618.699722:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798142848 00000100:00100000:3.0:1789760618.699732:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798142848 00000100:00100000:3.0:1789760618.699784:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798142976 00000100:00100000:3.0:1789760618.699804:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798142976 00000100:00100000:3.0:1789760618.699822:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789760618.699832:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798142848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760618.699874:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760618.699930:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798142848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760618.699938:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789760618.699954:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789760618.699960:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798142976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760618.699969:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760618.699993:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798142976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760618.699999:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1789760618.700158:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57a223800 x1876699798142976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760618.700179:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798142976:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789760618.700216:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e546386d80 x1876699798142848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760618.700228:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798142848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760619.015067:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789760619.330525:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e138f4d1-d0ec-4b86-a7ba-bb29c025f420 00000020:00000080:2.0:1789760619.330538:0:8141:0:(genops.c:885:class_export_put()) final put ffff97e544915000/e138f4d1-d0ec-4b86-a7ba-bb29c025f420 00000020:00000080:2.0:1789760619.330574:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97e544915000/e138f4d1-d0ec-4b86-a7ba-bb29c025f420 for lustre-OST0000 00000020:00000080:2.0:1789760619.330632:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e544913800 for lustre-OST0000 00000001:00100000:1.0:1789760619.382452:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e138f4d1-d0ec-4b86-a7ba-bb29c025f420 00000020:00000080:1.0:1789760619.382464:0:9084:0:(genops.c:885:class_export_put()) final put ffff97e57fc8d800/e138f4d1-d0ec-4b86-a7ba-bb29c025f420 00000020:00000080:1.0:1789760619.382513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97e57fc8d800/e138f4d1-d0ec-4b86-a7ba-bb29c025f420 for lustre-OST0001 00000020:00000080:1.0:1789760619.382567:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e57fc8b000 for lustre-OST0001 00010000:00010000:2.0:1789760620.039467:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760620.080344:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760620.080399:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760620.080434:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760620.080467:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760620.080500:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760620.080531:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777091712 00000100:00100000:2.0:1789760620.080543:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777091712 00000100:00100000:2.0:1789760620.080617:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777091968 00000100:00100000:2.0:1789760620.080621:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777091968 00000100:00100000:2.0:1789760620.080636:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777091584 00000100:00100000:2.0:1789760620.080639:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777091584 00000100:00100000:2.0:1789760620.080652:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777091840 00000100:00100000:2.0:1789760620.080654:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777091840 00000100:00100000:2.0:1789760620.080683:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1789760620.080693:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777091712:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760620.080854:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:3.0:1789760620.080866:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777091968:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760620.080938:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777091456 00000100:00100000:0.0:1789760620.080943:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777091456 00000100:00100000:0.0:1789760620.080976:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 312 00000100:00100000:0.0:1789760620.080984:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777091456:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760620.081057:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:1.0:1789760620.081068:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777091584:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760620.081174:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777091712:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 481us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760620.081182:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1789760620.081202:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:2.0:1789760620.081209:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777091840:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760620.096902:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777091968:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 16019us (16447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760620.096921:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00080000:3.0:1789760620.096993:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760620.097001:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760620.097738:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777091456:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 16748us (17404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760620.097779:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 312 00000100:00100000:1.0:1789760620.102001:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777091584:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 20916us (21512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760620.102028:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:2.0:1789760620.103979:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777091840:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22758us (23466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760620.103993:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 183 00010000:00010000:1.0:1789760621.063009:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760622.090414:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760622.279266:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760622.279304:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798143104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760622.279405:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760622.279512:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798143360:0@lo:400:kworker.0 00000100:00100000:2.0:1789760622.279554:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760622.279579:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760622.279585:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798143232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760622.279608:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760622.280201:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798143104 00000100:00100000:2.0:1789760622.280213:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798143104 00000100:00100000:2.0:1789760622.280269:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798143232 00000100:00100000:2.0:1789760622.280272:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798143232 00000100:00100000:2.0:1789760622.280292:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760622.280302:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798143104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760622.280343:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760622.280412:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798143104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760622.280422:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760622.282348:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760622.282372:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798143232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760622.282403:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760622.282572:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798143232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760622.282580:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1789760622.282648:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b4380 x1876699798143232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760622.282703:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798143232:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789760622.282777:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f71d880 x1876699798143104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760622.282824:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798143104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760622.282979:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798143360 00000100:00080000:2.0:1789760622.283096:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760622.283854:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798143360 00000100:00100000:1.0:1789760622.283975:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789760622.283986:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798143360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.284146:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798143360:12345-0@lo:400:kworker.0 Request processed in 162us (4591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760622.284154:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789760622.284212:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798143360:0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.301908:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760622.301940:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798143744:0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.302054:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760622.302133:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798143872:0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.302163:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760622.302201:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798143872 00000100:00100000:0.0:1789760622.302210:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798143872 00000100:00100000:0.0:1789760622.302267:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789760622.302277:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798143872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.302339:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798143872:12345-0@lo:400:kworker.0 Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760622.302347:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789760622.302406:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798143872:0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.302469:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760622.302476:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798144256:0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.302504:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760622.302536:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798144256 00000100:00100000:0.0:1789760622.302540:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798144256 00000100:00100000:0.0:1789760622.302585:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789760622.302592:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798144256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.302629:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798144256:12345-0@lo:400:kworker.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760622.302636:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789760622.302657:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760622.302699:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f923480 x1876699798144256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760622.302710:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798144256:0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.302741:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798144384:0@lo:400:kworker.0 00000100:00100000:0.0:1789760622.302765:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760622.303127:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798143744 00000100:00100000:3.0:1789760622.303132:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798143744 00000100:00100000:3.0:1789760622.303180:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789760622.303188:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798143744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.303237:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798143744:12345-0@lo:400:kworker.0 Request processed in 50us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.303244:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789760622.303268:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798144384 00000100:00100000:3.0:1789760622.303271:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798144384 00000100:00100000:3.0:1789760622.303300:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760622.303306:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798144384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.303334:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798144384:12345-0@lo:400:kworker.0 Request processed in 28us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.303349:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789760622.303366:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760622.303392:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f923480 x1876699798144384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760622.303404:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798144384:0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.303416:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798143744:0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.303566:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798143616:0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.303607:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760622.303637:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798144128:0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.303663:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760622.303680:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798144640:0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.303701:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760622.303722:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789760622.303728:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798143488:0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.303750:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760622.303776:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798144000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.303825:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760622.303839:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798144512:0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.303857:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760622.303878:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798144128 00000100:00100000:1.0:1789760622.303881:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798144128 00000100:00100000:1.0:1789760622.303909:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798144640 00000100:00100000:1.0:1789760622.303912:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798144640 00000100:00100000:1.0:1789760622.303925:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798143488 00000100:00100000:1.0:1789760622.303927:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798143488 00000100:00100000:1.0:1789760622.303939:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798144000 00000100:00100000:1.0:1789760622.303942:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798144000 00000100:00100000:1.0:1789760622.303953:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798144512 00000100:00100000:1.0:1789760622.303955:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798144512 00000100:00100000:1.0:1789760622.303967:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789760622.303974:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798144128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.304026:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798144128:12345-0@lo:400:kworker.0 Request processed in 52us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.304129:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798143616 00000100:00100000:3.0:1789760622.304134:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798143616 00000100:00100000:3.0:1789760622.304162:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789760622.304169:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798143616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.304207:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798143616:12345-0@lo:400:kworker.0 Request processed in 38us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.304213:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789760622.304234:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760622.304238:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760622.304246:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789760622.304253:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798144640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.304278:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798144640:12345-0@lo:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.304284:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789760622.304299:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789760622.304303:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798143488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.304327:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798143488:12345-0@lo:400:kworker.0 Request processed in 23us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.304332:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789760622.304352:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789760622.304358:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798144000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.304389:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798144000:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.304395:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789760622.304407:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789760622.304412:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798144512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.304452:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798144512:12345-0@lo:400:kworker.0 Request processed in 40us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.304458:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789760622.304523:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798143488:0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.304534:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798144000:0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.304543:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798144512:0@lo:400:kworker.0 00000100:00100000:3.0:1789760622.304551:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798143616:0@lo:400:kworker.0 00010000:00080000:3.0:1789760622.304563:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f920380 x1876699798144128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760622.304572:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798144128:0@lo:400:kworker.0 00010000:00080000:3.0:1789760622.304582:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434bb100 x1876699798144640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760622.304590:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798144640:0@lo:400:kworker.0 00000100:00100000:1.0:1789760622.304711:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789760622.791288:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798144768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760622.791371:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760622.791695:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798144768 00000100:00100000:2.0:1789760622.791704:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798144768 00000100:00100000:2.0:1789760622.791757:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789760622.791766:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798144768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760622.791832:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760622.791882:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798144768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760622.791889:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789760622.791977:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798144768:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760623.113768:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760623.303960:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798144896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760623.304054:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760623.304176:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798144896 00000100:00100000:3.0:1789760623.304185:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798144896 00000100:00100000:3.0:1789760623.304239:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789760623.304249:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798144896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760623.304351:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760623.304400:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798144896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760623.304407:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789760623.304448:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798144896:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1789760623.506917:0:12820:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789760623.817668:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760623.817694:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798145024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760623.817763:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760623.817973:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798145024 00000100:00100000:1.0:1789760623.817989:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798145024 00000100:00100000:1.0:1789760623.818043:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789760623.818053:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798145024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760623.818089:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760623.818145:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798145024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760623.818152:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1789760623.818307:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dc380 x1876699798145024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760623.818326:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798145024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760623.830883:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760623.830911:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798145152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760623.830994:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760623.831045:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798145152 00000100:00100000:1.0:1789760623.831054:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798145152 00000100:00100000:1.0:1789760623.831106:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789760623.831116:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798145152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760623.831139:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760623.831207:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798145152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760623.831214:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1789760623.831657:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1ddc00 x1876699798145152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760623.831677:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798145152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789760624.135225:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760625.170314:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760625.197472:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760625.197554:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760625.197588:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760625.197610:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760625.197649:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760625.197676:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777092352 00000100:00100000:2.0:1789760625.197686:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777092352 00000100:00100000:2.0:1789760625.197742:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777092608 00000100:00100000:2.0:1789760625.197746:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777092608 00000100:00100000:2.0:1789760625.197760:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777092224 00000100:00100000:2.0:1789760625.197762:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777092224 00000100:00100000:2.0:1789760625.197775:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777092480 00000100:00100000:2.0:1789760625.197777:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777092480 00000100:00100000:2.0:1789760625.197817:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:2.0:1789760625.197826:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777092352:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760625.197896:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777092352:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760625.197903:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:2.0:1789760625.197922:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:2.0:1789760625.197928:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777092608:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760625.197964:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777092608:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760625.197979:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:2.0:1789760625.197991:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:2.0:1789760625.197997:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777092224:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760625.198020:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777092224:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760625.198027:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:2.0:1789760625.198038:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:2.0:1789760625.198044:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777092480:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760625.198075:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777092480:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760625.198081:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 193 00000100:00080000:2.0:1789760625.198102:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760625.198106:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760625.204181:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777092096 00000100:00100000:0.0:1789760625.204194:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777092096 00000100:00100000:0.0:1789760625.204255:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 314 00000100:00100000:0.0:1789760625.204267:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777092096:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760625.204359:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777092096:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 95us (6897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760625.204365:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 314 00010000:00010000:2.0:1789760626.187975:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760627.208866:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760627.400865:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798145280:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.400941:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.400993:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798145792:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401021:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401044:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798146304:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401068:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401086:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798146816:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401106:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401128:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789760627.401134:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798145408:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401158:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401173:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798145920:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401193:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401209:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798146432:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401229:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401245:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798146944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760627.401265:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401292:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798145536:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401323:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401342:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798146048:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401360:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401375:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798146560:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401392:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401409:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789760627.401415:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798145664:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401437:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401447:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798146176:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401473:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401491:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798146688:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401512:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.401559:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798145280 00000100:00100000:2.0:1789760627.401566:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798145280 00000100:00100000:2.0:1789760627.401610:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789760627.401619:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798145280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401670:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798145280:12345-0@lo:400:kworker.0 Request processed in 52us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.401679:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789760627.401716:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798146304 00000100:00100000:2.0:1789760627.401720:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798146304 00000100:00100000:2.0:1789760627.401748:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798146816 00000100:00100000:2.0:1789760627.401751:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798146816 00000100:00100000:2.0:1789760627.401763:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798146176 00000100:00100000:2.0:1789760627.401765:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798146176 00000100:00100000:2.0:1789760627.401777:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798146688 00000100:00100000:2.0:1789760627.401780:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798146688 00000100:00100000:2.0:1789760627.401826:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789760627.401831:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798146304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401863:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798146304:12345-0@lo:400:kworker.0 Request processed in 32us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.401869:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789760627.401881:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789760627.401886:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798146816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401910:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798146816:12345-0@lo:400:kworker.0 Request processed in 24us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.401914:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789760627.401923:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789760627.401928:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798146176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.401970:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798146176:12345-0@lo:400:kworker.0 Request processed in 42us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.401977:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789760627.401991:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789760627.401998:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798146688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402030:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798146688:12345-0@lo:400:kworker.0 Request processed in 33us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402036:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789760627.402058:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798145408 00000100:00100000:2.0:1789760627.402062:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798145408 00000100:00100000:2.0:1789760627.402086:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798145920 00000100:00100000:2.0:1789760627.402089:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798145920 00000100:00100000:2.0:1789760627.402103:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798146432 00000100:00100000:2.0:1789760627.402105:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798146432 00000100:00100000:2.0:1789760627.402116:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798146048 00000100:00100000:2.0:1789760627.402125:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798146048 00000100:00100000:2.0:1789760627.402146:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798146560 00000100:00100000:2.0:1789760627.402149:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798146560 00000100:00100000:2.0:1789760627.402162:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798145664 00000100:00100000:2.0:1789760627.402164:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798145664 00000100:00100000:2.0:1789760627.402181:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789760627.402189:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798145408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402226:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798145408:12345-0@lo:400:kworker.0 Request processed in 39us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402232:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789760627.402248:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789760627.402255:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798145920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402282:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798145920:12345-0@lo:400:kworker.0 Request processed in 28us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402288:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789760627.402302:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789760627.402308:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798146432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402337:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798146432:12345-0@lo:400:kworker.0 Request processed in 31us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402343:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789760627.402356:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789760627.402364:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798146048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402395:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798146048:12345-0@lo:400:kworker.0 Request processed in 33us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402401:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789760627.402413:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789760627.402419:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798146560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402457:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798146560:12345-0@lo:400:kworker.0 Request processed in 39us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402464:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789760627.402476:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789760627.402482:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798145664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402508:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798145664:12345-0@lo:400:kworker.0 Request processed in 27us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402513:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789760627.402536:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798146944 00000100:00100000:2.0:1789760627.402538:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798146944 00000100:00100000:2.0:1789760627.402567:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789760627.402575:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798146944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760627.402599:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760627.402630:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798146944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402635:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789760627.402655:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798145792 00000100:00100000:2.0:1789760627.402659:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798145792 00000100:00100000:2.0:1789760627.402686:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798145536 00000100:00100000:2.0:1789760627.402689:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798145536 00000100:00100000:2.0:1789760627.402701:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789760627.402706:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798145792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402732:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798145792:12345-0@lo:400:kworker.0 Request processed in 26us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402737:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789760627.402745:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789760627.402749:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798145536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.402776:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798145536:12345-0@lo:400:kworker.0 Request processed in 27us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.402781:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789760627.403051:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798145408:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.403065:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798145920:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.403079:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798146432:0@lo:400:kworker.0 00010000:00080000:2.0:1789760627.403102:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ab70a80 x1876699798146944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760627.403121:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798146944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760627.403138:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798145280:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.403154:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798145792:0@lo:400:kworker.0 00010000:00080000:2.0:1789760627.403169:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac14a80 x1876699798146304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760627.403177:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798146304:0@lo:400:kworker.0 00010000:00080000:2.0:1789760627.403188:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ab70380 x1876699798146816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760627.403195:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798146816:0@lo:400:kworker.0 00000100:00080000:2.0:1789760627.403260:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760627.403264:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760627.403266:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760627.403268:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760627.403456:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798145664:0@lo:400:kworker.0 00010000:00080000:2.0:1789760627.403474:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac14380 x1876699798146176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760627.403482:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798146176:0@lo:400:kworker.0 00010000:00080000:2.0:1789760627.403492:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac15500 x1876699798146688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760627.403498:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798146688:0@lo:400:kworker.0 00000100:00100000:2.0:1789760627.403507:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798145536:0@lo:400:kworker.0 00010000:00080000:2.0:1789760627.403515:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac16680 x1876699798146048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760627.403523:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798146048:0@lo:400:kworker.0 00010000:00080000:2.0:1789760627.403530:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ac15c00 x1876699798146560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760627.403536:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798146560:0@lo:400:kworker.0 00000100:00100000:3.0:1789760627.404153:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760627.404165:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798147072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760627.404213:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760627.404275:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798147072 00000100:00100000:3.0:1789760627.404281:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798147072 00000100:00100000:3.0:1789760627.404323:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789760627.404332:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798147072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760627.404348:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760627.404386:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798147072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760627.404393:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1789760627.404420:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b7800 x1876699798147072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760627.404439:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798147072:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1789760627.476075:0:12967:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdac0e0f50 20000000:00000080:2.0:1789760627.476092:0:12967:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e444461000 uarg=0000000000000000 20000000:01000000:2.0:1789760627.476124:0:12967:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789760627.476130:0:12967:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789760627.476134:0:12967:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789760627.476678:0:12968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789760627.476840:0:12967:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789760627.480503:0:12967:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789760627.480530:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480550:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 12 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480559:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480568:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480574:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480593:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480601:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 12 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480669:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480707:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 12 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480722:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 12 pid: 6460 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.480737:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147200:192.168.203.38@tcp:104: 00010000:00010000:1.0:1789760627.480945:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.480966:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 23 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.480977:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147328:0@lo:104: 00000100:00100000:1.0:1789760627.481013:0:12967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760627.481047:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.481055:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 23 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.481069:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147456:0@lo:104: 00000100:00100000:1.0:1789760627.481091:0:12967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760627.481114:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.481123:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 23 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.481131:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147584:0@lo:104: 00000100:00100000:1.0:1789760627.481151:0:12967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760627.481166:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 23 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.481173:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 23 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.481181:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147712:0@lo:104: 00000100:00100000:1.0:1789760627.481195:0:12967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760627.481209:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 12 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.481218:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 12 pid: 6459 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.481226:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147840:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760627.481247:0:12967:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760627.481307:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798147328 00000100:00100000:0.0:1789760627.481314:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798147328 00000100:00100000:0.0:1789760627.481349:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798147456 00000100:00100000:0.0:1789760627.481351:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798147456 00000100:00100000:0.0:1789760627.481358:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798147584 00000100:00100000:0.0:1789760627.481360:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798147584 00000100:00100000:0.0:1789760627.481367:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798147712 00000100:00100000:0.0:1789760627.481369:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798147712 00000100:00100000:0.0:1789760627.481382:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789760627.481391:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:12967:x1876699798147328:12345-0@lo:104: 00010000:00010000:0.0:1789760627.481403:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.481449:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760627.481465:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+6:12967:x1876699798147328:12345-0@lo:104: Request processed in 75us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760627.481471:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789760627.481486:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789760627.481491:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:12967:x1876699798147456:12345-0@lo:104: 00010000:00010000:0.0:1789760627.481498:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.481527:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760627.481531:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+5:12967:x1876699798147456:12345-0@lo:104: Request processed in 41us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760627.481537:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789760627.481546:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760627.481551:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:12967:x1876699798147584:12345-0@lo:104: 00010000:00010000:0.0:1789760627.481557:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.481583:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789760627.481587:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+4:12967:x1876699798147584:12345-0@lo:104: Request processed in 37us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760627.481593:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760627.481604:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789760627.482923:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789760627.482935:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.482947:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ee00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760627.482967:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760627.483053:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:12967:x1876699798147712:12345-0@lo:104: 00010000:00010000:0.0:1789760627.483067:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.483122:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789760627.483135:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+3:12967:x1876699798147712:12345-0@lo:104: Request processed in 101us (1938us total) trans 0 rc 0/0 00010000:00010000:3.0:1789760627.484326:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760627.484525:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760627.484532:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760627.484573:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.484579:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760627.484597:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760627.484769:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760627.484842:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1789760627.485219:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e441f8ee00/0xc2b9a3a739856cf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cff expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485235:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789760627.485239:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485260:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fc00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760627.485264:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485271:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760627.485277:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760627.485283:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760627.485299:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485305:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789760627.485347:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798148096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789760627.485390:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760627.485459:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485467:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e441f8fc00/0xc2b9a3a739856cea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cf1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485476:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760627.485479:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485485:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ec00 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:3.0:1789760627.485488:0:7281:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485504:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760627.485510:0:7281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760627.485516:0:7281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760627.485528:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.485533:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789760627.485583:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789760627.485618:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760627.485624:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.485633:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541482600 already unused, calling callback (ffffffffc1accc20) 10000000:00010000:0.0:1789760627.485637:0:6454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.485645:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760627.485653:0:6454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760627.485658:0:6454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789760627.485673:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.485679:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760627.485686:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.485693:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e541482600/0xc2b9a3a739856cce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856cd5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760627.485703:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760627.485705:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760627.485707:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760627.485719:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760627.485898:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777092736 00000100:00100000:1.0:1789760627.485906:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777092736 00010000:00010000:1.0:1789760627.485936:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 13 pid: 6460 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.485970:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777092864 00000100:00100000:1.0:1789760627.485973:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777092864 00010000:00010000:1.0:1789760627.485983:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 14 pid: 6459 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.485993:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798148096 00000100:00100000:1.0:1789760627.485995:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798148096 00010000:00010000:1.0:1789760627.486004:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 24 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.486016:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1789760627.486022:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c9a29f0-58a4-4591-8db4-e258df357379+14:2403:x1876699777092736:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760627.486034:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760627.486038:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 14 pid: 6460 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.486050:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 14 pid: 6460 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.486075:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760627.486114:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c9a29f0-58a4-4591-8db4-e258df357379+14:2403:x1876699777092736:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 91us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760627.486120:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1789760627.486134:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1789760627.486139:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777092864:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760627.486146:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760627.486155:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 13 pid: 6459 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.486164:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 13 pid: 6459 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.486173:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760627.486187:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777092864:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 48us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760627.486194:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1789760627.486204:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789760627.486209:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798148096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760627.486215:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760627.486219:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 24 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.486228:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 24 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.486237:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760627.486840:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798148096:12345-0@lo:103:ldlm_bl.0 Request processed in 629us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760627.486848:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1789760627.487660:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.487673:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff97e441f8ec00/0xc2b9a3a739856cdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856ce3 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.487690:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760627.487692:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760627.487694:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760627.487712:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798147968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760627.487757:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760627.487823:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760627.487831:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798148352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760627.487842:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798147968 00000100:00100000:1.0:1789760627.487849:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798147968 00000100:00100000:3.0:1789760627.487854:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760627.487875:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 24 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760627.487885:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798148352 00000100:00100000:3.0:1789760627.487890:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798148352 00000100:00100000:1.0:1789760627.487904:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1789760627.487914:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 25 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.487916:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+25:3464:x1876699798147968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760627.487934:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760627.487942:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 25 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760627.487948:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789760627.487968:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 25 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760627.487974:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f923b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+25:3464:x1876699798148352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760627.487986:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e57fd8f600/0xc2b9a3a739856d14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117b9 expref: 12 pid: 6460 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.487987:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760627.487991:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760627.487996:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 25 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.488008:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 25 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760627.488027:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760627.488028:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+25:3464:x1876699798147968:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760627.488037:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789760627.488054:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147200:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760627.488060:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f923b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798148352:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760627.488068:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789760627.488078:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8e200/0xc2b9a3a739856cff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856cf8 expref: 24 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760627.488090:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147328:0@lo:104: 00000100:00100000:3.0:1789760627.488093:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798148224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760627.488116:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760627.488193:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798148224 00000100:00100000:1.0:1789760627.488197:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798148224 00010000:00010000:1.0:1789760627.488209:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 23 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.488226:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789760627.488230:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545673450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:3462:x1876699798148224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760627.488237:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760627.488241:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 23 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488251:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 23 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488264:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488272:0:6451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488295:0:6451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488303:0:6451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488310:0:6451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488316:0:6451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488322:0:6451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760627.488327:0:6451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488334:0:6451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488341:0:6451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.488350:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760627.488374:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545673450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:3462:x1876699798148224:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760627.488381:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789760627.488449:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798148352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760627.488457:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798147968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760627.488478:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798148224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789760627.488572:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798148096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760627.488750:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8fa00/0xc2b9a3a739856cf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856cea expref: 22 pid: 6460 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760627.488762:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147456:0@lo:104: 00010000:00010000:0.0:1789760627.488882:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e441f8e400/0xc2b9a3a739856ce3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856cdc expref: 21 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760627.488894:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147584:0@lo:104: 00010000:00010000:1.0:1789760627.488989:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e57fd8f400/0xc2b9a3a739856cd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856cce expref: 20 pid: 6457 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.489000:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147712:0@lo:104: 00010000:00010000:1.0:1789760627.489020:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e541482800/0xc2b9a3a739856cc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521177a expref: 11 pid: 6459 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760627.489030:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12967:1876699798147840:192.168.203.38@tcp:104: 00010000:00010000:1.0:1789760627.489052:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.489062:0:12967:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.489068:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760627.489074:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e57fd8e400/0xc2b9a3a739856d37 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760627.912457:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760627.912557:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798148480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760627.912725:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760627.924774:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798148480 00000100:00100000:2.0:1789760627.925492:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798148480 00000100:00100000:2.0:1789760627.925650:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789760627.925665:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798148480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760627.925726:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760627.926131:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798148480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760627.926545:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798148480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 882us (13818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760627.926555:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00010000:0.0:1789760628.231406:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760628.424041:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798148608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760628.424119:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760628.424272:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798148608 00000100:00100000:1.0:1789760628.424280:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798148608 00000100:00100000:1.0:1789760628.424327:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789760628.424336:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798148608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789760628.424373:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760628.425262:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798148608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 923us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760628.425272:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789760628.426731:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798148608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760628.935410:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760628.935431:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798148736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760628.935501:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760628.935561:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798148736 00000100:00100000:0.0:1789760628.935568:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798148736 00000100:00100000:0.0:1789760628.935608:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789760628.935617:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798148736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760628.935649:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760628.935693:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798148736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760628.935700:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1789760628.935748:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434b9f80 x1876699798148736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760628.935765:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798148736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760628.940280:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760628.948290:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798148864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760628.948361:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760628.956299:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798148864 00000100:00100000:1.0:1789760628.956316:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798148864 00000100:00100000:1.0:1789760628.956385:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789760628.956396:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798148864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760628.956433:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760628.957530:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798148864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1131us (9164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760628.957538:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789760628.960705:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a1f80 x1876699798148864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760628.960732:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798148864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760628.977759:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760628.978021:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777092992 00000100:00100000:3.0:1789760628.978040:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777092992 00000100:00100000:3.0:1789760628.978094:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 316 00000100:00100000:3.0:1789760628.978104:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+11:6392:x1876699777092992:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760628.978125:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760628.978144:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541483600/0xc2b9a3a739856d3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e652117ea expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760628.978182:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541483600/0xc2b9a3a739856d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117ea expref: 12 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760628.978195:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541483600/0xc2b9a3a739856d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117ea expref: 12 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760628.978205:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541483600, rc 0) 00000100:00100000:3.0:1789760628.978262:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+12:6392:x1876699777092992:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 159us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760628.978269:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 316 00000100:00100000:1.0:1789760628.981299:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760628.981543:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777093120 00000100:00100000:0.0:1789760628.981552:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777093120 00000100:00100000:0.0:1789760628.981600:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 317 00000100:00100000:0.0:1789760628.981610:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+12:6392:x1876699777093120:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760628.982139:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+12:6392:x1876699777093120:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 529us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760628.982148:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 317 00000100:00100000:1.0:1789760628.997546:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760628.997585:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777093248 00000100:00100000:1.0:1789760628.997604:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777093248 00000100:00100000:1.0:1789760628.997651:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:1.0:1789760628.997660:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+12:6392:x1876699777093248:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760628.997873:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+12:6392:x1876699777093248:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 213us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760628.997881:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:1.0:1789760629.006661:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760629.006927:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777093376 00000100:00100000:3.0:1789760629.006937:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777093376 00000100:00100000:3.0:1789760629.007002:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00100000:3.0:1789760629.007012:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+12:6392:x1876699777093376:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760629.007028:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760629.007046:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856d45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcddbef5e652117f1 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760629.007074:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117f1 expref: 13 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760629.007086:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e541483a00/0xc2b9a3a739856d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117f1 expref: 13 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760629.007115:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541483a00, rc 0) 00000100:00100000:3.0:1789760629.007175:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:6392:x1876699777093376:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 164us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760629.007182:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00100000:2.0:1789760629.013438:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760629.013502:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777093504 00000100:00100000:3.0:1789760629.013510:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777093504 00000100:00100000:3.0:1789760629.013562:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 320 00000100:00100000:3.0:1789760629.013572:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:6392:x1876699777093504:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760629.013878:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:6392:x1876699777093504:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 306us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760629.013887:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 320 00000100:00100000:2.0:1789760629.021530:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760629.021731:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777093632 00000100:00100000:0.0:1789760629.021743:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777093632 00000100:00100000:0.0:1789760629.021814:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 321 00000100:00100000:0.0:1789760629.021824:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:6392:x1876699777093632:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760629.022041:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:6392:x1876699777093632:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 218us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760629.022056:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 321 00010000:00010000:0.0:1789760629.261479:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789760629.511253:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789760629.511260:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e4489b2000 from 7 10000000:01000000:0.0:1789760629.511264:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789760629.511306:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856d4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760629.511317:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856d4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760629.511329:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856d4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760629.511351:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798148992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789760629.511426:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760629.511478:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760629.511743:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798148992 00000100:00100000:2.0:1789760629.511751:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798148992 00000100:00100000:2.0:1789760629.511816:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789760629.511825:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+20:6462:x1876699798148992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760629.511838:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760629.511851:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856d53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856d4c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.511875:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856d4c expref: 21 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.511886:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5413d2e00/0xc2b9a3a739856d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856d4c expref: 21 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.511895:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d2e00, rc 0) 00000100:00100000:2.0:1789760629.511952:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798148992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760629.511969:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789760629.512191:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798148992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760629.512206:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856d4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d53 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760629.512216:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856d4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856d53 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760629.512266:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760629.512293:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760629.512323:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760629.512509:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798149120 00000100:00100000:2.0:1789760629.512514:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798149120 00000100:00100000:2.0:1789760629.512551:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789760629.512559:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798149120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760629.512814:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798149120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760629.512822:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789760629.512955:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760629.512985:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760629.513022:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760629.513048:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760629.513455:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798149248 00000100:00100000:2.0:1789760629.513460:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798149248 00000100:00100000:2.0:1789760629.513492:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789760629.513499:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798149248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760629.513822:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798149248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760629.513829:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789760629.513911:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789760629.516251:0:13025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789760629.518457:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789760629.518485:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760629.518496:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856d4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d53 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760629.518508:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e4486ddc00/0xc2b9a3a739856d4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d53 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760629.518519:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760629.518521:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e44128d800 from 7 10000000:01000000:1.0:1789760629.518524:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760629.518584:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e57fd8fc00/0xc2b9a3a739856d5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760629.518745:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e57fd8fc00/0xc2b9a3a739856d5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760629.518757:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e57fd8fc00/0xc2b9a3a739856d5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760629.518780:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760629.518870:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760629.518902:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760629.518976:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798149376 00000100:00100000:2.0:1789760629.518983:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798149376 00000100:00100000:2.0:1789760629.519023:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789760629.519031:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+21:6462:x1876699798149376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760629.519044:0:6459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760629.519057:0:6459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5413d3000/0xc2b9a3a739856d61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856d5a expref: -99 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.519077:0:6459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d3000/0xc2b9a3a739856d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856d5a expref: 22 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.519087:0:6459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5413d3000/0xc2b9a3a739856d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856d5a expref: 22 pid: 6459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.519101:0:6459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d3000, rc 0) 00000100:00100000:2.0:1789760629.519141:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798149376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760629.519147:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789760629.519331:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760629.519343:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e57fd8fc00/0xc2b9a3a739856d5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d61 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760629.519352:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e57fd8fc00/0xc2b9a3a739856d5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856d61 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760629.519398:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760629.519487:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760629.519514:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789760629.519768:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798149504 00000100:00100000:3.0:1789760629.519772:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798149504 00000100:00100000:3.0:1789760629.519817:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789760629.519834:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798149504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760629.520076:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798149504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760629.520082:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789760629.520115:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760629.520142:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760629.520287:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760629.520306:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760629.520317:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798149632 00000100:00100000:3.0:1789760629.520320:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798149632 00000100:00100000:3.0:1789760629.520340:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789760629.520347:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798149632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760629.521343:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798149632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 994us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760629.521351:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789760629.521668:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789760629.525061:0:13026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789760629.525275:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789760629.525294:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760629.525305:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e57fd8fc00/0xc2b9a3a739856d5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d61 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.525316:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e57fd8fc00/0xc2b9a3a739856d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d61 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760629.525327:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789760629.525330:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e544828000 from 7 10000000:01000000:2.0:1789760629.525333:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760629.525372:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856d68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.525380:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856d68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.525391:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856d68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760629.525417:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760629.525493:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760629.525529:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e56c76fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789760629.525559:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798149760 00000100:00100000:2.0:1789760629.525577:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798149760 00000100:00100000:2.0:1789760629.525766:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789760629.525774:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+22:6462:x1876699798149760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760629.525805:0:6460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760629.525817:0:6460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856d6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856d68 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.525836:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856d6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856d68 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.527267:0:6460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5413d2000/0xc2b9a3a739856d6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856d68 expref: 23 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.527278:0:6460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d2000, rc 0) 00000100:00100000:2.0:1789760629.527341:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798149760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1566us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760629.527348:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789760629.527412:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760629.528521:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856d68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d6f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.528544:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856d68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856d6f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760629.529979:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760629.530033:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760629.530102:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e56c76fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789760629.543518:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798149888 00000100:00100000:3.0:1789760629.543532:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798149888 00000100:00100000:2.0:1789760629.543917:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789760629.543953:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798149888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760629.544250:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798149888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (14215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760629.544258:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789760629.544301:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798149888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760629.544350:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798150016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760629.544395:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760629.544434:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e56c76fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789760629.544448:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798150016 00000100:00100000:2.0:1789760629.544452:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798150016 00000100:00100000:2.0:1789760629.544471:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789760629.544477:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798150016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760629.545330:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798150016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 849us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760629.545338:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789760629.545387:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798150016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789760629.547104:0:13030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789760629.554781:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789760629.554849:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789760629.554859:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856d68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d6f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760629.554871:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e5413d3a00/0xc2b9a3a739856d68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d6f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760629.554882:0:6462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789760629.554892:0:6462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e546616000 from 7 10000000:01000000:3.0:1789760629.554895:0:6462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760629.554930:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a739856d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760629.554950:0:6462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a739856d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760629.554961:0:6462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a739856d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760629.554986:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798150144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760629.555049:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760629.555086:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760629.555365:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798150144 00000100:00100000:2.0:1789760629.555373:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798150144 00000100:00100000:2.0:1789760629.555525:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789760629.555535:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+23:6462:x1876699798150144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760629.555548:0:6457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760629.555560:0:6457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856d7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856d76 expref: -99 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.555655:0:6457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856d76 expref: 24 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.555667:0:6457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e5413d2200/0xc2b9a3a739856d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856d76 expref: 24 pid: 6457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760629.555675:0:6457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d2200, rc 0) 00000100:00100000:2.0:1789760629.555723:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798150144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760629.555730:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789760629.558043:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f923480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798150144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760629.558067:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a739856d76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d7d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760629.558078:0:6462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a739856d76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856d7d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760629.558174:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798150272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760629.558226:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760629.562060:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760629.567933:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798150272 00000100:00100000:0.0:1789760629.567957:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798150272 00000100:00100000:0.0:1789760629.568014:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789760629.568025:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798150272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760629.568357:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798150272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (10130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760629.568366:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789760629.570197:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798150272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760629.570253:0:6462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798150400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760629.570315:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760629.570345:0:6462:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760629.570824:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798150400 00000100:00100000:0.0:1789760629.570831:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798150400 00000100:00100000:0.0:1789760629.570865:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789760629.570874:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798150400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760629.571059:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:6462:x1876699798150400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760629.571066:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789760629.571191:0:6462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:6462:1876699798150400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789760629.617331:0:13031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789760629.629824:0:6462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789760629.629853:0:6462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760629.629864:0:6462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a739856d76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d7d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760629.629877:0:6462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff97e541482800/0xc2b9a3a739856d76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856d7d expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760630.288424:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760630.318278:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760630.318316:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760630.318336:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760630.318353:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760630.318373:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760630.318398:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777093760 00000100:00100000:0.0:1789760630.318406:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777093760 00000100:00100000:0.0:1789760630.318460:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 334 00000100:00100000:0.0:1789760630.318468:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777093760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760630.318530:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777093760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 63us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760630.318552:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 334 00000100:00100000:0.0:1789760630.318583:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777094016 00000100:00100000:0.0:1789760630.318587:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777094016 00000100:00100000:0.0:1789760630.318620:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777094272 00000100:00100000:0.0:1789760630.318624:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777094272 00000100:00100000:0.0:1789760630.318862:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777093888 00000100:00100000:0.0:1789760630.318867:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777093888 00000100:00100000:0.0:1789760630.318885:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777094144 00000100:00100000:0.0:1789760630.318887:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777094144 00000100:00100000:0.0:1789760630.318901:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:0.0:1789760630.318908:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777094016:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760630.318949:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777094016:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760630.318956:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:0.0:1789760630.318968:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:0.0:1789760630.318974:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777094272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760630.318998:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777094272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760630.319004:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:0.0:1789760630.319016:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:0.0:1789760630.319022:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777093888:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760630.319045:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777093888:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760630.319051:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:0.0:1789760630.319062:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:0.0:1789760630.319069:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777094144:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760630.319090:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777094144:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760630.319095:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00080000:0.0:1789760630.319276:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760630.319284:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789760631.303646:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760632.327105:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789760632.338487:0:13166:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789760632.519265:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760632.519286:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798150528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760632.519350:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760632.519420:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798150528 00000100:00100000:0.0:1789760632.519427:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798150528 00000100:00100000:0.0:1789760632.519475:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789760632.519485:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798150528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760632.519516:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760632.519557:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798150528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760632.519564:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789760632.519591:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789760632.519626:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5434bb100 x1876699798150528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760632.519643:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798150528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760632.530032:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798150656:0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.530099:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760632.530141:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798151168:0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.530167:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760632.530187:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798151680:0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.530208:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760632.530232:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789760632.530238:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798150784:0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.530260:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760632.530285:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798151296:0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.530306:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760632.530322:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798151808:0@lo:400:kworker.0 00000100:00100000:2.0:1789760632.530642:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798150656 00000100:00100000:2.0:1789760632.530651:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798150656 00000100:00100000:2.0:1789760632.530695:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789760632.530704:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798150656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.530754:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760632.530810:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798150656:12345-0@lo:400:kworker.0 Request processed in 106us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760632.530816:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789760632.531864:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798151680 00000100:00100000:1.0:1789760632.531871:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798151680 00000100:00100000:1.0:1789760632.531937:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789760632.531945:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798151680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.531993:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798151680:12345-0@lo:400:kworker.0 Request processed in 49us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760632.532000:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789760632.532023:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798151168 00000100:00100000:1.0:1789760632.532027:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798151168 00000100:00100000:1.0:1789760632.532069:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789760632.532074:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798151168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.532103:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798151168:12345-0@lo:400:kworker.0 Request processed in 30us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760632.532109:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789760632.532136:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798150912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.532164:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760632.532184:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798151424:0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.532207:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760632.532224:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798151936:0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.532244:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760632.532261:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789760632.532267:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798151040:0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.532287:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760632.532297:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798151552:0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.532314:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760632.532328:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798152064:0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.532347:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760632.532368:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798150912 00000100:00100000:1.0:1789760632.532372:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798150912 00000100:00100000:1.0:1789760632.532394:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789760632.532400:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798150912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760632.532434:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798150912:12345-0@lo:400:kworker.0 Request processed in 34us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760632.532440:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789760632.532484:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798150912:0@lo:400:kworker.0 00000100:00100000:2.0:1789760632.533702:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798151552 00000100:00100000:2.0:1789760632.533710:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798151552 00000100:00100000:2.0:1789760632.533746:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798152064 00000100:00100000:2.0:1789760632.533748:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798152064 00000100:00100000:2.0:1789760632.533768:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760632.533774:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798151552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760632.533841:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798151552:12345-0@lo:400:kworker.0 Request processed in 67us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760632.533856:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760632.533869:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760632.533875:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798152064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760632.533928:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798152064:12345-0@lo:400:kworker.0 Request processed in 54us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760632.533934:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1789760632.535590:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a1f80 x1876699798151552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760632.535605:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798151552:0@lo:400:kworker.0 00010000:00080000:2.0:1789760632.535617:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1dd180 x1876699798152064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760632.535625:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798152064:0@lo:400:kworker.0 00000100:00100000:3.0:1789760632.537310:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760632.537328:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798152192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760632.537832:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760632.537880:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798152192 00000100:00100000:3.0:1789760632.537886:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798152192 00000100:00100000:3.0:1789760632.538020:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789760632.538031:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798152192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760632.538052:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760632.538110:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798152192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760632.538116:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1789760632.538153:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57f921f80 x1876699798152192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760632.538185:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798152192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760632.538833:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798150656:0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.538849:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798151168:0@lo:400:kworker.0 00010000:00080000:0.0:1789760632.538863:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a2a00 x1876699798151680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760632.538873:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798151680:0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.538912:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798150784 00000100:00100000:0.0:1789760632.538925:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798150784 00000100:00100000:0.0:1789760632.538949:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798151296 00000100:00100000:0.0:1789760632.538952:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798151296 00000100:00100000:0.0:1789760632.538966:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798151808 00000100:00100000:0.0:1789760632.538969:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798151808 00000100:00100000:0.0:1789760632.538981:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798151424 00000100:00100000:0.0:1789760632.538983:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798151424 00000100:00100000:0.0:1789760632.538993:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798151936 00000100:00100000:0.0:1789760632.538996:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798151936 00000100:00100000:0.0:1789760632.539007:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798151040 00000100:00100000:0.0:1789760632.539009:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798151040 00000100:00100000:0.0:1789760632.539021:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789760632.539027:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798150784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.539075:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798150784:12345-0@lo:400:kworker.0 Request processed in 48us (8814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760632.539081:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789760632.539095:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789760632.539107:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798151296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.539137:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798151296:12345-0@lo:400:kworker.0 Request processed in 31us (8830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760632.539143:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789760632.539154:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789760632.539160:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798151808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.539186:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798151808:12345-0@lo:400:kworker.0 Request processed in 27us (8432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760632.539192:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789760632.539203:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789760632.539208:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798151424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.539240:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798151424:12345-0@lo:400:kworker.0 Request processed in 32us (7032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760632.539246:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789760632.539255:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789760632.539260:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798151936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.539288:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798151936:12345-0@lo:400:kworker.0 Request processed in 27us (7043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760632.539293:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789760632.539304:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789760632.539310:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798151040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760632.539335:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798151040:12345-0@lo:400:kworker.0 Request processed in 26us (7047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760632.539340:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:0.0:1789760632.539368:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760632.539377:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760632.539379:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760632.539381:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760632.541030:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798151040:0@lo:400:kworker.0 00010000:00080000:3.0:1789760632.541049:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b2a1880 x1876699798151424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760632.541058:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798151424:0@lo:400:kworker.0 00010000:00080000:3.0:1789760632.541070:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57b1ddc00 x1876699798151936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760632.541077:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798151936:0@lo:400:kworker.0 00000100:00100000:2.0:1789760632.541202:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798150784:0@lo:400:kworker.0 00000100:00100000:2.0:1789760632.541217:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798151296:0@lo:400:kworker.0 00000100:00100000:2.0:1789760632.541226:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798151808:0@lo:400:kworker.0 00000100:00100000:3.0:1789760633.031336:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798152320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760633.031409:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760633.031551:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798152320 00000100:00100000:1.0:1789760633.031559:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798152320 00000100:00100000:1.0:1789760633.031617:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789760633.031627:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798152320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760633.031665:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760633.031723:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798152320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760633.031731:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789760633.031948:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798152320:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789760633.351022:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760633.543712:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760633.543733:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798152448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760633.543829:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760633.543944:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798152448 00000100:00100000:3.0:1789760633.543952:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798152448 00000100:00100000:3.0:1789760633.544001:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760633.544011:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798152448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760633.544049:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760633.544099:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798152448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760633.544106:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760633.544162:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798152448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760634.055927:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760634.055950:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798152576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760634.056012:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760634.056048:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798152576 00000100:00100000:3.0:1789760634.056063:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798152576 00000100:00100000:3.0:1789760634.056130:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789760634.056143:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798152576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760634.056160:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798152704:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760634.056189:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760634.056194:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760634.056250:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798152576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760634.056259:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1789760634.056266:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57ab70a80 x1876699798152576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760634.056275:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798152704 00000100:00100000:3.0:1789760634.056280:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798152704 00000100:00100000:1.0:1789760634.056288:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798152576:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760634.056339:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760634.056520:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789760634.056529:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798152704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760634.056540:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760634.056577:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798152704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760634.056583:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1789760634.056712:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5449d6680 x1876699798152704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760634.056726:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798152704:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789760634.387867:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760635.399067:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760635.440547:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760635.440591:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760635.440698:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760635.440861:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777094400 00000100:00100000:1.0:1789760635.440870:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777094400 00000100:00100000:1.0:1789760635.440935:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 336 00000100:00100000:1.0:1789760635.440946:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777094400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760635.441027:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777094400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760635.441041:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 336 00000100:00100000:0.0:1789760635.441333:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777094528 00000100:00100000:0.0:1789760635.441338:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777094528 00000100:00100000:0.0:1789760635.441387:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777094784 00000100:00100000:0.0:1789760635.441390:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777094784 00000100:00100000:0.0:1789760635.441412:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:0.0:1789760635.441419:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777094528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760635.441457:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777094528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760635.441465:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:0.0:1789760635.441479:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:0.0:1789760635.441486:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777094784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760635.441510:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777094784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760635.441516:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00080000:1.0:1789760635.441805:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760635.443190:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760635.443391:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777094656 00000100:00100000:0.0:1789760635.443399:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777094656 00000100:00100000:0.0:1789760635.443462:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:0.0:1789760635.443472:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777094656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760635.443539:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777094656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760635.443555:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00080000:1.0:1789760635.443845:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760635.444024:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760635.444179:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777094912 00000100:00100000:1.0:1789760635.444185:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777094912 00000100:00100000:1.0:1789760635.444229:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:1.0:1789760635.444237:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777094912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760635.444275:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777094912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760635.444281:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 213 00000100:00080000:2.0:1789760635.444387:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1789760636.374598:0:13267:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: finish setup 15:43:54 (1789760634) === 00010000:00010000:3.0:1789760636.426151:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760636.654431:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760636.654485:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777095040 00000100:00100000:1.0:1789760636.654495:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777095040 00000100:00100000:1.0:1789760636.654551:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1789760636.654560:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:8468:x1876699777095040:12345-192.168.203.38@tcp:37:bash.0 00000100:00100000:1.0:1789760636.660217:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:8468:x1876699777095040:12345-192.168.203.38@tcp:37:bash.0 Request processed in 5644us (5782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760636.660229:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1789760636.687760:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760636.689227:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777095168 00000100:00100000:3.0:1789760636.689241:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777095168 00000100:00100000:3.0:1789760636.689351:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1789760636.689361:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10957:x1876699777095168:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760636.689380:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760636.689437:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856d84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652117f8 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689503:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689541:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689553:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689582:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689590:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689596:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689810:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689818:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689824:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.689830:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760636.689835:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690106:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690118:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:3.0:1789760636.690127:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760636.690181:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690188:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856d8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690203:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690209:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690214:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690219:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d2800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760636.690221:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690228:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690235:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xceb91eaa (ffff97e544c16d00) 00010000:00010000:3.0:1789760636.690238:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760636.690240:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690245:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856d92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690278:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856d84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117f8 expref: 7 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690293:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:3.0:1789760636.690294:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760636.690298:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856d84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117f8 expref: 7 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.690309:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541482600, rc 0) 00000100:00100000:3.0:1789760636.690372:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10957:x1876699777095168:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1012us (2622us total) trans 0 rc 301/301 00000100:00100000:3.0:1789760636.690379:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1789760636.700774:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760636.700900:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777095296 00000100:00100000:2.0:1789760636.700916:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777095296 00000100:00100000:2.0:1789760636.701002:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:2.0:1789760636.701014:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10957:x1876699777095296:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1789760636.701033:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760636.701056:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652117ff expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.701117:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.701131:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.701144:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.701715:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.701727:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.701735:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702150:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702170:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702176:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702183:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760636.702188:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702196:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702209:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:2.0:1789760636.702212:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760636.702217:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702223:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856da0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702236:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702243:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702249:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702254:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760636.702264:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702271:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702279:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x59b4378f (ffff97e5820ee600) 00010000:00010000:2.0:1789760636.702282:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760636.702285:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702290:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856da7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702331:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856d99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117ff expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702423:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:2.0:1789760636.702425:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760636.702430:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652117ff expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.702441:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01000, rc 0) 00000100:00100000:2.0:1789760636.702519:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10957:x1876699777095296:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1506us (1760us total) trans 0 rc 301/301 00000100:00100000:2.0:1789760636.702527:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1789760636.709276:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760636.709337:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777095424 00000100:00100000:3.0:1789760636.709347:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777095424 00000100:00100000:3.0:1789760636.709408:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1789760636.709418:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10957:x1876699777095424:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760636.709437:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760636.709457:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856dae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211806 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709523:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709538:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709550:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709620:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709629:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709636:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709897:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709906:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709913:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709919:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541482600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760636.709924:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709932:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709945:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:3.0:1789760636.709948:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760636.709952:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709959:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709982:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709988:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709994:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.709999:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760636.710002:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.710008:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.710016:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5948ff0e (ffff97e544c16d00) 00010000:00010000:3.0:1789760636.710018:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760636.710022:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.710027:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856dbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.710061:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856dae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211806 expref: 7 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.710071:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:3.0:1789760636.710074:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760636.710085:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856dae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211806 expref: 7 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.710096:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5413d2800, rc 0) 00000100:00100000:3.0:1789760636.710165:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10957:x1876699777095424:12345-192.168.203.38@tcp:101:rm.0 Request processed in 747us (897us total) trans 0 rc 301/301 00000100:00100000:3.0:1789760636.710173:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:1.0:1789760636.904116:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760636.904173:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760636.904271:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777095552 00000100:00100000:2.0:1789760636.904281:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777095680 00000100:00100000:3.0:1789760636.904289:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777095552 00000100:00100000:2.0:1789760636.904293:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777095680 00000100:00100000:2.0:1789760636.904377:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1789760636.904390:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:10969:x1876699777095680:12345-192.168.203.38@tcp:700:mkdir.0 00000100:00100000:3.0:1789760636.904400:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1789760636.904420:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777095552:12345-192.168.203.38@tcp:41:mkdir.0 00000004:00000024:3.0:1789760636.904478:0:12655:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760636.904505:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:10969:x1876699777095680:12345-192.168.203.38@tcp:700:mkdir.0 Request processed in 115us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760636.904517:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:3.0:1789760636.904588:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777095552:12345-192.168.203.38@tcp:41:mkdir.0 Request processed in 170us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760636.904598:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1789760636.908647:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760636.908733:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777095936 00000100:00100000:2.0:1789760636.908756:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777095936 00000100:00100000:2.0:1789760636.908960:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:2.0:1789760636.908973:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10969:x1876699777095936:12345-192.168.203.38@tcp:36:mkdir.0 00010000:00010000:2.0:1789760636.909044:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760636.909085:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856c26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211765 expref: 6 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.909107:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:2.0:1789760636.909119:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760636.909346:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.909361:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.909370:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.909407:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.909415:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.909422:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910609:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910621:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910629:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760636.910642:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000108083fa reply state 0000000031e23fc1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910652:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910659:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820eee00) 00010000:00010000:2.0:1789760636.910662:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760636.910665:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760636.910669:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789760636.910677:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910683:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910689:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910695:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760636.910699:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910718:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910728:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:2.0:1789760636.910731:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760636.910734:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910740:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dc3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760636.910757:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000108083fa reply state 0000000031e23fc1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910766:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.910772:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e5820ee200) 00010000:00010000:2.0:1789760636.910774:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760636.910776:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789760636.910921:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:10969:x1876699777095936:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 1948us (2287us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789760636.910930:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1789760636.923047:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760636.923231:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777096064 00000100:00100000:2.0:1789760636.923241:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777096064 00000100:00100000:2.0:1789760636.923301:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1789760636.923308:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:10970:x1876699777096064:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:2.0:1789760636.923328:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760636.923346:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521180d expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.923413:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856ddf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.923426:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.923435:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760636.923463:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760636.923465:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760636.923492:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.923509:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856dd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521180d expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.923523:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856ddf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521180d expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.923528:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:2.0:1789760636.923531:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760636.923533:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01400, rc 0) 00000100:00100000:2.0:1789760636.923580:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:10970:x1876699777096064:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 274us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760636.923585:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:1.0:1789760636.926631:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760636.926722:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777096320 00000100:00100000:0.0:1789760636.926871:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777096320 00000100:00100000:3.0:1789760636.927620:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:3.0:1789760636.927639:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:10970:x1876699777096320:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:3.0:1789760636.927718:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760636.927755:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856ddf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521180d expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.927782:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:3.0:1789760636.927823:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760636.927862:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.927878:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.927911:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760636.928556:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2d8aa56 reply state 00000000f2bd0f7e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.928573:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.928580:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:3.0:1789760636.928583:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789760636.928586:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760636.928597:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789760636.928718:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+9:10970:x1876699777096320:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 1083us (2099us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789760636.928728:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1789760636.956980:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760636.957091:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777096448 00000100:00100000:2.0:1789760636.957107:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777096448 00000100:00100000:2.0:1789760636.957266:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:2.0:1789760636.957287:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:10971:x1876699777096448:12345-192.168.203.38@tcp:101:chown.0 00010000:00010000:2.0:1789760636.957314:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760636.957335:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856ded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211814 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.957401:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739856df4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.957414:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739856df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.957426:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739856df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760636.957460:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760636.957464:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760636.957498:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739856df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.957523:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856ded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211814 expref: 11 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.957543:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739856df4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211814 expref: 10 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.957554:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:2.0:1789760636.957557:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760636.957560:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00c00, rc 0) 00000100:00100000:2.0:1789760636.957631:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:10971:x1876699777096448:12345-192.168.203.38@tcp:101:chown.0 Request processed in 355us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760636.957644:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:0.0:1789760636.962048:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760636.962163:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777096576 00000100:00100000:2.0:1789760636.962179:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777096576 00000100:00100000:2.0:1789760636.962328:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1789760636.962339:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:10971:x1876699777096576:12345-192.168.203.38@tcp:101:chown.0 00010000:00010000:2.0:1789760636.962360:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760636.962383:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856dfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521181b expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962440:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962451:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962459:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962467:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962471:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962475:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962543:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a739856e10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962563:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a739856e10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962567:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a739856e10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760636.962593:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760636.962605:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760636.962619:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a739856e10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962629:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962634:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962639:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962643:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760636.962646:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962653:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962665:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:2.0:1789760636.962668:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760636.962674:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962695:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962710:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962716:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962723:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962728:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760636.962731:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962736:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962744:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e5820ee200) 00010000:00010000:2.0:1789760636.962747:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760636.962749:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962755:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962781:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856dfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521181b expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962838:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a739856e10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521181b expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.962851:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820eee00) 00010000:00010000:2.0:1789760636.962854:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760636.962856:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01e00, rc 0) 00000100:00100000:2.0:1789760636.962947:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+11:10971:x1876699777096576:12345-192.168.203.38@tcp:101:chown.0 Request processed in 601us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760636.962954:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:1.0:1789760636.965588:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760636.965636:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777096704 00000100:00100000:3.0:1789760636.965644:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777096704 00000100:00100000:3.0:1789760636.965692:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1789760636.965699:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac82f857-edfe-4201-bbe8-4599ba569acb+11:10971:x1876699777096704:12345-192.168.203.38@tcp:900:chown.0 00000100:00100000:3.0:1789760636.965767:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac82f857-edfe-4201-bbe8-4599ba569acb+11:10971:x1876699777096704:12345-192.168.203.38@tcp:900:chown.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760636.965772:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1789760636.968567:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760636.968638:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777096960 00000100:00100000:0.0:1789760636.968648:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777096960 00000100:00100000:0.0:1789760636.968714:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:0.0:1789760636.968725:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+11:10971:x1876699777096960:12345-192.168.203.38@tcp:36:chown.0 00010000:00010000:0.0:1789760636.968777:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760636.968841:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a739856e10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521181b expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760636.968862:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820eee00) 00010000:00010000:0.0:1789760636.968867:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760636.968998:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760636.969013:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760636.969023:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760636.991662:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1789760636.991669:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbae4701 reply state 00000000fef1cff0 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.991690:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.991699:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820eee00) 00010000:00010000:2.0:1789760636.991702:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789760636.991706:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760636.991723:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789760636.991725:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991745:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991752:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991757:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760636.991761:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991768:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991778:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e5820ee200) 00010000:00010000:3.0:1789760636.991780:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760636.991783:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991816:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a739856dca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1789760636.991826:0:9081:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1789760636.991842:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760636.991845:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+9:10971:x1876699777096960:12345-192.168.203.38@tcp:36:chown.0 Request processed in 23118us (23282us total) trans 4294967301 rc 0/0 00010000:00010000:3.0:1789760636.991849:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760636.991855:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00010000:00010000:3.0:1789760636.991855:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991860:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760636.991869:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991876:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991894:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820eee00) 00010000:00010000:3.0:1789760636.991897:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760636.991900:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991906:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739856dd1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991918:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.991923:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991924:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.991930:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991931:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.991937:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991937:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760636.991939:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991945:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.991951:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dd000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760636.991952:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:2.0:1789760636.991954:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991954:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760636.991960:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991961:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760636.991967:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856de6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.991968:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820eee00) 00010000:00010000:2.0:1789760636.991970:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760636.991973:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760636.991978:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856e17 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760637.005102:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760637.005524:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777097088 00000100:00100000:2.0:1789760637.005533:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777097088 00000100:00100000:2.0:1789760637.006322:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1789760637.006335:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10972:x1876699777097088:12345-192.168.203.38@tcp:101:touch.500 00000100:00080000:1.0:1789760637.006706:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789760637.006753:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760637.007242:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211822 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789760637.008315:0:6466:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1018us 00010000:00010000:2.0:1789760637.020977:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021001:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021013:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021045:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021051:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021058:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021427:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021437:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021445:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760637.021466:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760637.021470:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760637.021505:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021516:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021523:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021530:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021545:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760637.021549:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021557:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021569:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:2.0:1789760637.021572:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760637.021576:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021582:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021594:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021600:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021607:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021612:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760637.021614:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021620:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021638:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e5820eee00) 00010000:00010000:2.0:1789760637.021641:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760637.021644:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.021650:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.027980:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211822 expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.028016:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211822 expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.028026:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:2.0:1789760637.028029:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789760637.028033:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01000, rc 0) 00000100:00100000:2.0:1789760637.028109:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:10972:x1876699777097088:12345-192.168.203.38@tcp:101:touch.500 Request processed in 21777us (23014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.028119:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:1.0:1789760637.034585:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760637.037261:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777097344 00000100:00100000:2.0:1789760637.037275:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777097344 00000100:00100000:2.0:1789760637.037339:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1789760637.037349:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:10972:x1876699777097344:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:2.0:1789760637.037369:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760637.037389:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856e3a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211829 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.038079:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.038098:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.038110:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.038127:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x81726315 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.038147:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.038154:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760637.039081:0:6467:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789760637.039343:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a739856e4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039355:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a739856e4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039364:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a739856e4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039396:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039413:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039419:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039425:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760637.039430:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039436:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039449:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:2.0:1789760637.039452:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760637.039456:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039461:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e41 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760637.039472:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f72c8ed2 reply state 0000000099c87da6 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039483:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039488:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x81726315 (ffff97e5820eee00) 00010000:00010000:2.0:1789760637.039490:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760637.039493:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789760637.039528:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856e3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211829 expref: 10 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039549:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a739856e4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211829 expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.039557:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee800) 00010000:00010000:2.0:1789760637.039560:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760637.039562:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00200, rc 0) 00000100:00100000:2.0:1789760637.039621:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:10972:x1876699777097344:12345-192.168.203.38@tcp:101:touch.500 Request processed in 2273us (5043us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789760637.039629:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1789760637.043090:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760637.043160:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777097600 00000100:00100000:2.0:1789760637.043173:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777097600 00000100:00100000:2.0:1789760637.043228:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1789760637.043238:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+10:10972:x1876699777097600:12345-192.168.203.38@tcp:36:touch.500 00010000:00010000:2.0:1789760637.043294:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760637.043321:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a739856e4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211829 expref: 10 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.043340:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee800) 00010000:00010000:2.0:1789760637.043350:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760637.043388:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.043401:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.043411:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760637.043563:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c6e2c69 reply state 000000000c52bc58 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.043575:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.043581:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee500) 00010000:00010000:2.0:1789760637.043583:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760637.043586:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760637.043681:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+11:10972:x1876699777097600:12345-192.168.203.38@tcp:36:touch.500 Request processed in 444us (599us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789760637.043688:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1789760637.046245:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760637.046349:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777097728 00000100:00100000:2.0:1789760637.046358:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777097728 00000100:00100000:2.0:1789760637.046418:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1789760637.046430:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:10972:x1876699777097728:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:2.0:1789760637.046452:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760637.046470:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856e64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211830 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.046527:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856e64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211830 expref: 12 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.046547:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856e64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211830 expref: 12 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.046564:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee500) 00010000:00010000:2.0:1789760637.046580:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789760637.046583:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01400, rc 0) 00000100:00100000:2.0:1789760637.046642:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:10972:x1876699777097728:12345-192.168.203.38@tcp:101:touch.500 Request processed in 214us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.046649:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:1.0:1789760637.050429:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760637.050510:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777097856 00000100:00100000:2.0:1789760637.050519:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777097856 00000100:00100000:2.0:1789760637.050565:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:2.0:1789760637.050573:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1876699777097856:12345-192.168.203.38@tcp:8:touch.500 00010000:00080000:2.0:1789760637.050609:0:8114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:2.0:1789760637.050640:0:8114:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739856e6b 00002000:00100000:2.0:1789760637.050652:0:8114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ac82f857-edfe-4201-bbe8-4599ba569acb/ffff97e543267000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760637.050673:0:8114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760637.050972:0:8114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789760637.051000:0:8114:0:(import.c:65:import_set_state_nolock()) ffff97e543261000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760637.051059:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777097856:12345-192.168.203.38@tcp:8:touch.500 Request processed in 485us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.051067:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:1.0:1789760637.056389:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760637.056477:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777097984 00000100:00100000:3.0:1789760637.056487:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777097984 00000100:00100000:3.0:1789760637.056605:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1789760637.056615:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:0:x1876699777097984:12345-192.168.203.38@tcp:2:touch.500 00000100:00080000:1.0:1789760637.059696:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789760637.112772:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000001:00080000:0.0:1789760637.112821:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1789760637.113030:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:0:x1876699777097984:12345-192.168.203.38@tcp:2:touch.500 Request processed in 56412us (56647us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789760637.113040:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:0.0:1789760637.120307:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760637.120516:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777098240 00000100:00100000:3.0:1789760637.120525:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777098240 00000100:00100000:3.0:1789760637.120598:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1789760637.120608:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:10972:x1876699777098240:12345-192.168.203.38@tcp:35:touch.500 00000100:00100000:3.0:1789760637.120989:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+13:10972:x1876699777098240:12345-192.168.203.38@tcp:35:touch.500 Request processed in 381us (692us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789760637.120998:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1789760637.137009:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760637.137127:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777098368 00000100:00100000:2.0:1789760637.137137:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777098368 00000100:00100000:2.0:1789760637.137199:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1789760637.137209:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+13:10973:x1876699777098368:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1789760637.137233:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760637.137256:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a739856e72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211837 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.137342:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.137355:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.137366:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760637.137398:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760637.137402:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760637.137439:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.137466:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a739856e72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211837 expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.137485:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211837 expref: 14 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760637.137493:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:2.0:1789760637.137496:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760637.137499:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00800, rc 0) 00000100:00100000:2.0:1789760637.137782:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+14:10973:x1876699777098368:12345-192.168.203.38@tcp:101:rm.0 Request processed in 574us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.137931:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:0.0:1789760637.155571:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760637.157008:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777098624 00000100:00100000:3.0:1789760637.157019:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777098624 00000100:00100000:3.0:1789760637.157096:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1789760637.157107:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+14:10973:x1876699777098624:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760637.157126:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760637.157146:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856e80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521183e expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760637.157730:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789760637.157945:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856e80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521183e expref: 16 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.157961:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:3.0:1789760637.157964:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789760637.157969:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856e80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521183e expref: 16 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.157987:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541483800, rc 0) 00000100:00100000:3.0:1789760637.158059:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+15:10973:x1876699777098624:12345-192.168.203.38@tcp:101:rm.0 Request processed in 943us (2486us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1789760637.158067:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:0.0:1789760637.162991:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760637.163063:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777098752 00000100:00100000:3.0:1789760637.163075:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777098752 00000100:00100000:3.0:1789760637.163121:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1789760637.163130:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565ddb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+15:10973:x1876699777098752:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:2.0:1789760637.171650:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565ddb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+15:10973:x1876699777098752:12345-192.168.203.38@tcp:37:rm.0 Request processed in 8510us (8658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.171680:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1789760637.180845:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760637.180937:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777099008 00000100:00100000:1.0:1789760637.180947:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777099008 00000100:00100000:1.0:1789760637.181055:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1789760637.181066:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+15:10973:x1876699777099008:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:1.0:1789760637.181311:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+16:10973:x1876699777099008:12345-192.168.203.38@tcp:35:rm.0 Request processed in 246us (473us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789760637.181318:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:0.0:1789760637.189751:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760637.191241:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777099264 00000100:00100000:3.0:1789760637.191254:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777099264 00000100:00100000:3.0:1789760637.191322:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1789760637.191333:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+16:10973:x1876699777099264:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760637.191356:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760637.191376:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211845 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.191486:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856e95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.191500:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856e95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.191512:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856e95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760637.191522:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789760637.191687:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211845 expref: 19 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.191709:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856e95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211845 expref: 18 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.191717:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:3.0:1789760637.191720:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789760637.191724:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e541482600, rc 0) 00000100:00100000:3.0:1789760637.191819:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+18:10973:x1876699777099264:12345-192.168.203.38@tcp:101:rm.0 Request processed in 488us (2077us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789760637.191826:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:0.0:1789760637.204466:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760637.204556:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777099392 00000100:00100000:3.0:1789760637.204566:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777099392 00000100:00100000:3.0:1789760637.204619:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:3.0:1789760637.204628:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:10973:x1876699777099392:12345-192.168.203.38@tcp:41:rm.0 00000004:00000024:3.0:1789760637.204693:0:6467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1789760637.204771:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:10973:x1876699777099392:12345-192.168.203.38@tcp:41:rm.0 Request processed in 143us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760637.204779:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1789760637.210930:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760637.211018:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777099520 00000100:00100000:3.0:1789760637.211029:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777099520 00000100:00100000:3.0:1789760637.211091:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:3.0:1789760637.211101:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:10973:x1876699777099520:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760637.211121:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760637.211140:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856ea3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521184c expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211202:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211217:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211228:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211240:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211248:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211254:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211350:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fa00/0xc2b9a3a739856eb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211374:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fa00/0xc2b9a3a739856eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211382:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fa00/0xc2b9a3a739856eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760637.211409:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789760637.211413:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789760637.211431:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fa00/0xc2b9a3a739856eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211442:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fa00/0xc2b9a3a739856eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211450:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211456:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211463:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211469:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5413d2800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760637.211473:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211480:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211490:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:3.0:1789760637.211493:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760637.211504:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211511:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5413d2800/0xc2b9a3a739856eaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211526:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211531:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211537:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211541:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8e400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760637.211544:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211731:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211741:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x81726315 (ffff97e5820eee00) 00010000:00010000:3.0:1789760637.211743:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760637.211746:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211752:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856eb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211779:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541483800/0xc2b9a3a739856ea3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521184c expref: 20 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211956:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fa00/0xc2b9a3a739856eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521184c expref: 19 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760637.211964:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee500) 00010000:00010000:3.0:1789760637.211966:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789760637.211968:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8fa00, rc 0) 00000100:00100000:3.0:1789760637.212920:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+19:10973:x1876699777099520:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1815us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760637.212930:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1789760637.219966:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760637.220061:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777099776 00000100:00100000:0.0:1789760637.220071:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777099776 00000100:00100000:0.0:1789760637.220128:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:0.0:1789760637.220138:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+19:10973:x1876699777099776:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1789760637.220189:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789760637.220216:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fa00/0xc2b9a3a739856eb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521184c expref: 19 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220240:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856e64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211830 expref: 18 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220253:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee500) 00010000:00010000:0.0:1789760637.220263:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739856e79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211837 expref: 17 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220273:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:0.0:1789760637.220276:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760637.220295:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220308:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220319:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220331:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x81726315 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220364:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220374:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220473:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220483:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.220490:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789760637.221373:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789760637.221385:0:9081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313405596312ns, next at 314405594137ns, rc = 0 00010000:00010000:0.0:1789760637.221446:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221458:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221465:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221472:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221478:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221495:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221513:0:9081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760637.221536:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221543:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221549:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221555:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dca00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760637.221560:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221567:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221578:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee500) 00010000:00010000:0.0:1789760637.221581:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760637.221585:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221591:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856ecd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221605:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221611:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221623:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221628:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760637.221632:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221637:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221645:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:0.0:1789760637.221647:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760637.221650:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221656:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856ebf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760637.221666:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007947b1a8 reply state 00000000f9f14d6a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221678:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.221684:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x81726315 (ffff97e5820eee00) 00010000:00010000:0.0:1789760637.221687:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760637.221689:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760637.221767:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+18:10973:x1876699777099776:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1628us (1808us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789760637.221776:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00010000:00010000:1.0:1789760637.222312:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760637.222321:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760637.222328:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dd000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760637.222332:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760637.222339:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760637.222350:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee500) 00010000:00010000:1.0:1789760637.222352:0:6454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789760637.222356:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760637.222362:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856ed4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760637.222385:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760637.222387:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760637.222389:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760637.234481:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760637.234746:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777100032 00000100:00100000:2.0:1789760637.234756:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777100032 00000100:00100000:2.0:1789760637.234856:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1789760637.234867:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:10973:x1876699777100032:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:2.0:1789760637.235105:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+19:10973:x1876699777100032:12345-192.168.203.38@tcp:35:rm.0 Request processed in 240us (634us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789760637.235114:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1789760637.237850:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760637.237938:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777100288 00000100:00100000:0.0:1789760637.237947:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777100288 00000100:00100000:0.0:1789760637.238005:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1789760637.238016:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:10973:x1876699777100288:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1789760637.238069:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789760637.238095:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e541482600/0xc2b9a3a739856e95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211845 expref: 19 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238121:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01000/0xc2b9a3a739856e33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211822 expref: 18 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238132:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5820ee600) 00010000:00010000:0.0:1789760637.238148:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739856df4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211814 expref: 17 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238156:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:0.0:1789760637.238162:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760637.238182:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238194:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238204:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238216:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238242:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238250:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238490:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238498:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.238504:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760637.241400:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789760637.241425:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241434:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241442:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241449:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760637.241453:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241461:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241487:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff97e5489b1500) 00010000:00010000:0.0:1789760637.241490:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760637.241496:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241502:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856ee9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241526:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241532:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241537:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.241542:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dca00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760637.241544:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.246819:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.246842:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1f00) 00010000:00010000:0.0:1789760637.246845:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760637.246851:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.246859:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856edb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760637.246919:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000722e7772 reply state 0000000016bbd01b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.246931:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760637.246939:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e5489b1d00) 00010000:00010000:0.0:1789760637.246942:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760637.246945:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760637.247041:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:10973:x1876699777100288:12345-192.168.203.38@tcp:36:rm.0 Request processed in 9023us (9195us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789760637.247051:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00010000:00010000:0.0:1789760637.449248:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760637.642805:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798152832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760637.642894:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760637.642994:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798152832 00000100:00100000:1.0:1789760637.643003:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798152832 00000100:00100000:1.0:1789760637.643053:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789760637.643063:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798152832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760637.643084:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760637.643127:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798152832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760637.643134:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1789760637.643360:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789760637.643392:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e57a223800 x1876699798152832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760637.643410:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798152832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760637.645442:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798153088:0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.645500:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760637.645545:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798153600:0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.645568:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760637.645584:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798154112:0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.645605:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760637.645634:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789760637.645640:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798152960:0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.645664:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760637.645686:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798153472:0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.645708:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760637.645722:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798153984:0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.645742:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760637.645769:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798152960 00000100:00100000:3.0:1789760637.645775:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798152960 00000100:00100000:3.0:1789760637.645850:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789760637.645869:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798152960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760637.646470:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798153472 00000100:00100000:2.0:1789760637.646475:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798153472 00000100:00100000:2.0:1789760637.646503:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789760637.646511:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798153472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760637.646564:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798153472:12345-0@lo:400:kworker.0 Request processed in 54us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.646571:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789760637.646591:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798153984 00000100:00100000:2.0:1789760637.646594:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798153984 00000100:00100000:2.0:1789760637.646622:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789760637.646627:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798153984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760637.646653:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798153984:12345-0@lo:400:kworker.0 Request processed in 26us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.646659:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789760637.646693:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798153472:0@lo:400:kworker.0 00010000:00080000:2.0:1789760637.646718:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a187800 x1876699798153984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760637.646728:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798153984:0@lo:400:kworker.0 00000100:00100000:2.0:1789760637.646743:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760637.646751:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798154496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760637.646779:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760637.646873:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798153088 00000100:00100000:2.0:1789760637.646885:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798153088 00000100:00100000:0.0:1789760637.647340:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798153600 00000100:00100000:0.0:1789760637.647345:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798153600 00000100:00100000:0.0:1789760637.647384:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798154112 00000100:00100000:0.0:1789760637.647387:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798154112 00000100:00100000:0.0:1789760637.647409:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789760637.647416:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798153600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760637.647460:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798153600:12345-0@lo:400:kworker.0 Request processed in 45us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760637.647466:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789760637.647478:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789760637.647484:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798154112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760637.647514:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798154112:12345-0@lo:400:kworker.0 Request processed in 30us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760637.647519:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789760637.647572:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798153600:0@lo:400:kworker.0 00000100:00100000:0.0:1789760637.647582:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798154112:0@lo:400:kworker.0 00000100:00100000:2.0:1789760637.649240:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789760637.649256:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798153088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760637.649345:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798153088:12345-0@lo:400:kworker.0 Request processed in 88us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760637.649759:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798152960:12345-0@lo:400:kworker.0 Request processed in 3901us (4092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760637.649769:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789760637.650172:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798153216:0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.650214:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760637.650241:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798153728:0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.650265:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760637.650283:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798154240:0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.650303:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760637.650335:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789760637.650649:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789760637.650667:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798153728 00000100:00100000:2.0:1789760637.650674:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798153728 00000100:00100000:2.0:1789760637.650701:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798154240 00000100:00100000:2.0:1789760637.650704:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798154240 00000100:00100000:2.0:1789760637.650727:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789760637.650734:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798153728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760637.650779:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798153728:12345-0@lo:400:kworker.0 Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.650784:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789760637.650811:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789760637.650817:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798154240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760637.650844:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798154240:12345-0@lo:400:kworker.0 Request processed in 27us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760637.650871:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:0.0:1789760637.651133:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760637.651137:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760637.651140:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760637.651235:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798153216 00000100:00100000:0.0:1789760637.651239:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798153216 00000100:00100000:0.0:1789760637.651271:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789760637.651278:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798153216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760637.651316:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798153216:12345-0@lo:400:kworker.0 Request processed in 39us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760637.651338:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789760637.651366:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798154496 00000100:00100000:0.0:1789760637.651369:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798154496 00000100:00100000:0.0:1789760637.651399:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789760637.651405:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798154496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760637.651420:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760637.651453:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798154496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (4673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760637.651458:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1789760637.651470:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760637.651637:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798152960:0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.651661:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798153088:0@lo:400:kworker.0 00010000:00080000:3.0:1789760637.651693:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44974aa00 x1876699798154496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760637.651709:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798154496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760637.653124:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798153344:0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.653180:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760637.653212:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798153856:0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.653237:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760637.653257:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798154368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.653277:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760637.653309:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798153216:0@lo:400:kworker.0 00010000:00080000:1.0:1789760637.653325:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a184000 x1876699798153728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760637.653335:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798153728:0@lo:400:kworker.0 00010000:00080000:1.0:1789760637.653357:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a184700 x1876699798154240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760637.653366:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798154240:0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.653406:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798153856 00000100:00100000:1.0:1789760637.653411:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798153856 00000100:00100000:1.0:1789760637.653453:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798154368 00000100:00100000:1.0:1789760637.653457:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798154368 00000100:00100000:1.0:1789760637.653476:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789760637.653484:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798153856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.653547:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798153856:12345-0@lo:400:kworker.0 Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760637.653555:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789760637.653569:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789760637.653575:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798154368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760637.653615:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798154368:12345-0@lo:400:kworker.0 Request processed in 41us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760637.653621:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789760637.653638:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760637.653659:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a187b80 x1876699798153856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760637.653668:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798153856:0@lo:400:kworker.0 00010000:00080000:1.0:1789760637.653676:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44a185c00 x1876699798154368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760637.653684:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798154368:0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.654649:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798153344 00000100:00100000:3.0:1789760637.654658:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798153344 00000100:00100000:3.0:1789760637.654700:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789760637.654709:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798153344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760637.654767:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798153344:12345-0@lo:400:kworker.0 Request processed in 60us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760637.654774:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789760637.655779:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798153344:0@lo:400:kworker.0 00000100:00100000:0.0:1789760638.151623:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760638.151647:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798154624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760638.151720:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760638.154973:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798154624 00000100:00100000:1.0:1789760638.154998:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798154624 00000100:00100000:1.0:1789760638.155073:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789760638.155086:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798154624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760638.155125:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760638.155213:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798154624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760638.155219:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789760638.155415:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798154624:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789760638.471733:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760638.663204:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760638.663238:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798154752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760638.663303:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760638.664232:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798154752 00000100:00100000:2.0:1789760638.664242:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798154752 00000100:00100000:2.0:1789760638.664301:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789760638.664311:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798154752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760638.664370:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760638.664438:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798154752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760638.664445:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789760638.664740:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798154752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760639.175051:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798155008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760639.175556:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760639.175664:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798155008 00000100:00100000:2.0:1789760639.175673:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798155008 00000100:00100000:2.0:1789760639.175736:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789760639.175747:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798155008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760639.175753:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798154880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760639.175781:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789760639.175783:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760639.175874:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798155008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760639.175881:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789760639.175898:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798154880 00000100:00100000:2.0:1789760639.175901:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798154880 00000100:00100000:2.0:1789760639.175929:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789760639.175936:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798154880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760639.175948:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760639.175981:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798154880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760639.175987:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1789760639.176044:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e5433dd880 x1876699798154880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760639.176077:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798154880:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789760639.176529:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97e44974aa00 x1876699798155008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760639.176543:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798155008:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760639.178735:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760639.495011:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760640.520216:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760640.557978:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760640.558089:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760640.558120:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760640.558147:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760640.558172:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760640.558200:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760640.558232:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777100672 00000100:00100000:3.0:1789760640.558262:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777100672 00000100:00100000:3.0:1789760640.558331:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777100928 00000100:00100000:3.0:1789760640.558334:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777100928 00000100:00100000:3.0:1789760640.558353:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777100544 00000100:00100000:3.0:1789760640.558356:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777100544 00000100:00100000:3.0:1789760640.558369:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777101056 00000100:00100000:3.0:1789760640.558372:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777101056 00000100:00100000:3.0:1789760640.558396:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:3.0:1789760640.558408:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777100672:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760640.558504:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777100672:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 98us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760640.558524:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:3.0:1789760640.558545:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:3.0:1789760640.558552:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777100928:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760640.558579:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777100928:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760640.558586:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:3.0:1789760640.558598:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:3.0:1789760640.558604:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2405:x1876699777100544:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760640.558633:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2405:x1876699777100544:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760640.558640:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:3.0:1789760640.558652:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 223 00000100:00100000:3.0:1789760640.558659:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777101056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760640.558683:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777101056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760640.558696:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 223 00000100:00100000:3.0:1789760640.558726:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777100800 00000100:00100000:3.0:1789760640.558729:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777100800 00000100:00100000:3.0:1789760640.558762:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:3.0:1789760640.558769:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777100800:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760640.558843:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777100800:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760640.558851:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00080000:3.0:1789760640.558886:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760640.558891:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760640.558894:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760640.561346:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777100416 00000100:00100000:2.0:1789760640.561366:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777100416 00000100:00100000:2.0:1789760640.561439:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 338 00000100:00100000:2.0:1789760640.561451:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777100416:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760640.561545:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777100416:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 97us (3584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760640.561554:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 338 00000001:02000400:2.0:1789760640.743181:0:13317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 15:43:58 (1789760638) 00010000:00010000:3.0:1789760641.548957:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760641.854862:0:13365:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e57f6bf500 rate 10000 gen 0 00000100:00100000:0.0:1789760641.854913:0:13365:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e57f6bfa00 rate 10000 gen 0 00000100:00100000:0.0:1789760641.856030:0:13365:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e57f6bf900 rate 5 gen 0 00000100:00100000:0.0:1789760641.856038:0:13365:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e57f6bf300 rate 5 gen 0 00000100:00100000:3.0:1789760641.884721:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760641.885038:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777101184 00000100:00100000:3.0:1789760641.885048:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777101184 00000100:00100000:3.0:1789760641.885100:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1789760641.885110:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11372:x1876699777101184:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:3.0:1789760641.885129:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760641.885163:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856ef0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211853 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.885223:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.885241:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.885254:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760641.885304:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789760641.885308:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789760641.885328:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.885351:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856ef0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 20 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.885367:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 19 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.885375:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16000) 00010000:00010000:3.0:1789760641.885378:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760641.885381:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e200, rc 0) 00000100:00100000:3.0:1789760641.885433:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11372:x1876699777101184:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 324us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760641.885440:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1789760641.898088:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760641.898129:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760641.898209:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777101440 00000100:00100000:2.0:1789760641.898219:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777101440 00000100:00100000:2.0:1789760641.898285:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:2.0:1789760641.898304:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11372:x1876699777101440:12345-192.168.203.38@tcp:700:mkdir.0 00000100:00100000:2.0:1789760641.898380:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11372:x1876699777101440:12345-192.168.203.38@tcp:700:mkdir.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760641.898387:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1789760641.898969:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777101312 00000100:00100000:3.0:1789760641.898975:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777101312 00000100:00100000:3.0:1789760641.899014:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1789760641.899022:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777101312:12345-192.168.203.38@tcp:41:mkdir.0 00000004:00000024:3.0:1789760641.899050:0:6466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760641.899105:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777101312:12345-192.168.203.38@tcp:41:mkdir.0 Request processed in 83us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760641.899111:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1789760641.901839:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760641.901897:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777101696 00000100:00100000:3.0:1789760641.901907:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777101696 00000100:00100000:3.0:1789760641.901969:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1789760641.901979:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11372:x1876699777101696:12345-192.168.203.38@tcp:36:mkdir.0 00000004:00080000:2.0:1789760641.904989:0:9081:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2953us 00000100:00100000:3.0:1789760641.936443:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:9081:1876699798155136:0@lo:900:mdt00_003.0 00000100:00100000:3.0:1789760641.936507:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760641.936564:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.936590:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798155136 00000100:00100000:1.0:1789760641.936598:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798155136 00000100:00100000:1.0:1789760641.936655:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789760641.936665:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9081:x1876699798155136:12345-0@lo:900:mdt00_003.0 00000100:00100000:1.0:1789760641.936720:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9081:x1876699798155136:12345-0@lo:900:mdt00_003.0 Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.936727:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760641.936957:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:9081:1876699798155136:0@lo:900:mdt00_003.0 00000100:00100000:3.0:1789760641.937039:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798155264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760641.937074:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760641.937105:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.937158:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798155264 00000100:00100000:1.0:1789760641.937163:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798155264 00000100:00100000:1.0:1789760641.937199:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789760641.937206:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:9081:x1876699798155264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.937266:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:9081:x1876699798155264:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.937285:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789760641.937416:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798155264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760641.937467:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798155392:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760641.937492:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760641.937657:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.937711:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798155392 00000100:00100000:1.0:1789760641.937715:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798155392 00000100:00100000:1.0:1789760641.937746:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789760641.937753:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:9081:x1876699798155392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.937970:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:9081:x1876699798155392:12345-0@lo:1000:mdt00_003.0 Request processed in 216us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.937977:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789760641.938135:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798155392:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760641.938176:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798155520:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760641.938579:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760641.938614:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059240 going to sleep for 11 seconds 00000100:00100000:0.0:1789760641.938953:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798155520 00000100:00100000:0.0:1789760641.938961:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798155520 00000100:00100000:0.0:1789760641.939000:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789760641.939008:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:9081:x1876699798155520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789760641.939114:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:9081:x1876699798155520:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (535us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760641.939120:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789760641.939153:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798155520:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789760641.939211:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760641.939223:0:9081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760641.939243:0:9081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760641.939258:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543284000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798155648:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1789760641.940398:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760641.940430:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448b03900 going to sleep for 11 seconds 00000100:00100000:3.0:1789760641.940488:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798155648 00000100:00100000:3.0:1789760641.940496:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798155648 00000100:00100000:3.0:1789760641.941012:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789760641.941022:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:9081:x1876699798155648:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1789760641.941037:0:7305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760641.941056:0:7305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f05 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856efe expref: -99 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.941093:0:7305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.941102:0:7305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f05 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856efe expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.941132:0:7305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.941145:0:7305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 18 pid: 6467 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760641.941158:0:7305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d7100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798155776:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760641.941226:0:7305:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760641.945861:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760641.945904:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777101824 00000100:00100000:3.0:1789760641.945912:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777101824 00010000:00010000:3.0:1789760641.945954:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 19 pid: 6467 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760641.945994:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:3.0:1789760641.946006:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:2403:x1876699777101824:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760641.946021:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760641.946029:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 19 pid: 6467 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.946052:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 19 pid: 6467 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.946074:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16000) 00010000:00010000:3.0:1789760641.946081:0:6451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f05 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856efe expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.946092:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f05 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xc2b9a3a739856efe expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.946100:0:6451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f05 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xc2b9a3a739856efe expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760641.946130:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f05 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856efe expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760641.946144:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6451:1876699798155904:0@lo:105: 00000100:00100000:3.0:1789760641.946191:0:6451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760641.946231:0:6451:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789760641.946431:0:6449:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789760641.946446:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798155904 00000100:00100000:2.0:1789760641.946450:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798155904 00000100:00100000:2.0:1789760641.946487:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789760641.946631:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e579c71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6451:x1876699798155904:12345-0@lo:105: 00010000:00010000:2.0:1789760641.946644:0:6449:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760641.946661:0:6449:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760641.946670:0:6449:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760641.946678:0:6449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760641.946685:0:6449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760641.946696:0:6449:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760641.946712:0:6449:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97e4486dce00) 00000100:00100000:2.0:1789760641.946758:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e579c71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6451:x1876699798155904:12345-0@lo:105: Request processed in 264us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760641.946766:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789760641.947200:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6451:1876699798155904:0@lo:105: 00010000:00010000:2.0:1789760641.947219:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760641.947264:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:2403:x1876699777101824:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1259us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760641.947272:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00010000:00010000:1.0:1789760641.953769:0:7305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e200/0xc2b9a3a739856ef7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211853 expref: 18 pid: 6467 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760641.953825:0:7305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d7100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798155776:192.168.203.38@tcp:104: 00010000:00010000:1.0:1789760641.953876:0:7305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f05 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856efe expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760641.953900:0:7305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16000) 00010000:00010000:1.0:1789760641.953905:0:7305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760641.953908:0:7305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e400, rc 0) 00000100:00100000:1.0:1789760641.953985:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798155648:12345-0@lo:101:mdt00_003.0 Request processed in 12963us (13588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.953995:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789760641.954066:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543284000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798155648:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789760641.954085:0:9081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760641.954107:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760641.954158:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760641.954166:0:9081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760641.954175:0:9081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760641.954193:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156032:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1789760641.954235:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760641.954259:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.954277:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798156032 00000100:00100000:1.0:1789760641.954282:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798156032 00000100:00100000:1.0:1789760641.954323:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789760641.954348:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798156032:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789760641.954375:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760641.954414:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f13 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856f0c expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760641.954440:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f13 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856f0c expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760641.954452:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f13 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856f0c expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760641.954461:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5461f2d00) 00010000:00010000:1.0:1789760641.954464:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760641.954466:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f000, rc 0) 00000100:00100000:1.0:1789760641.954497:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156032:12345-0@lo:101:mdt00_003.0 Request processed in 151us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.954503:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789760641.954530:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156032:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789760641.954541:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760641.954553:0:9081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760641.954567:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1789760641.954597:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156160:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.954644:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760641.954663:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.954682:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798156160 00000100:00100000:1.0:1789760641.954687:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798156160 00000100:00100000:1.0:1789760641.954710:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789760641.954717:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.954780:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156160:12345-0@lo:1000:mdt00_003.0 Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.954813:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789760641.954841:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156160:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.954892:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156288:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.954919:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760641.954933:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.954946:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798156288 00000100:00100000:1.0:1789760641.954950:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798156288 00000100:00100000:1.0:1789760641.954973:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789760641.954980:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955071:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156288:12345-0@lo:1000:mdt00_003.0 Request processed in 91us (152us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760641.955078:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789760641.955103:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156288:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955170:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156416:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955193:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760641.955206:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.955217:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798156416 00000100:00100000:1.0:1789760641.955220:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798156416 00000100:00100000:1.0:1789760641.955240:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789760641.955246:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955310:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156416:12345-0@lo:1000:mdt00_003.0 Request processed in 63us (115us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760641.955317:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789760641.955341:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156416:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955387:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156544:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955411:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760641.955424:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.955434:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798156544 00000100:00100000:1.0:1789760641.955438:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798156544 00000100:00100000:1.0:1789760641.955459:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789760641.955464:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955513:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156544:12345-0@lo:1000:mdt00_003.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.955519:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789760641.955545:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156544:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955581:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156672:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955605:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760641.955617:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.955627:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798156672 00000100:00100000:1.0:1789760641.955630:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798156672 00000100:00100000:1.0:1789760641.955649:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789760641.955655:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955695:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156672:12345-0@lo:1000:mdt00_003.0 Request processed in 39us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.955701:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789760641.955734:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156672:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955769:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156800:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955813:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760641.955826:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760641.955836:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798156800 00000100:00100000:1.0:1789760641.955839:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798156800 00000100:00100000:1.0:1789760641.955872:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789760641.955879:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760641.955923:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798156800:12345-0@lo:1000:mdt00_003.0 Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760641.955929:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789760641.955955:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798156800:0@lo:1000:mdt00_003.0 00000040:00080000:1.0:1789760641.956489:0:9081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760641.956534:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1789760641.957705:0:9081:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e441f86480 with version 2 00000040:00080000:1.0:1789760641.958138:0:9081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760641.958158:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].2, 64 off32896 00000004:00080000:1.0:1789760641.958163:0:9081:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e44113f0c0 with version 3 00000004:00080000:2.0:1789760641.958209:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 2 rpc_version 2 00000020:00100000:2.0:1789760641.958248:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760641.958267:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e44974aa00 x1876699798157056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760641.958290:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798157056:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789760641.962036:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760641.962091:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8300 going to sleep for 11 seconds 00000040:00080000:1.0:1789760641.963001:0:9081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760641.963144:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1789760641.963301:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].1, 984 off33752 00000040:00080000:1.0:1789760641.963676:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].1, 1136 off33904 00000004:00080000:1.0:1789760641.963684:0:9081:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e441f86180 with version 4 00000100:00100000:1.0:1789760641.963706:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798157056 00000100:00100000:1.0:1789760641.963715:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798157056 00000100:00100000:1.0:1789760641.963773:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789760641.963783:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7275:x1876699798157056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789760642.018077:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7275:x1876699798157056:12345-0@lo:1000:osp_up0-1.0 Request processed in 54287us (56037us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789760642.018091:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000001:00080000:3.0:1789760642.018141:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789760642.018151:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789760642.018163:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760642.018164:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00010000:00010000:2.0:1789760642.018174:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018182:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018188:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760642.018192:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018199:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018213:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x81726315 (ffff97e5820eee00) 00010000:00010000:2.0:1789760642.018216:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760642.018220:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018226:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856e48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760642.018235:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798157056:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1789760642.018241:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018246:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760642.018249:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 3 rpc_version 3 00010000:00010000:2.0:1789760642.018258:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018262:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760642.018265:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018271:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1789760642.018273:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1789760642.018279:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff97e5820ee500) 00000100:00100000:3.0:1789760642.018279:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e57f6d7800 x1876699798157312/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1789760642.018281:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760642.018284:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018290:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a739856e5d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760642.018297:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798157312:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789760642.018334:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760642.018357:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760642.018372:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798157312 00000100:00100000:3.0:1789760642.018378:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798157312 00000100:00100000:3.0:1789760642.018413:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789760642.018421:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7275:x1876699798157312:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1789760642.018441:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018448:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018453:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018458:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dcc00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760642.018461:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018475:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018483:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x81726315 (ffff97e5820eee00) 00010000:00010000:2.0:1789760642.018485:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760642.018488:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018493:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856ec6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x81726315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018507:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018513:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018518:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018523:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760642.018525:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018531:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018538:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e5489b1d00) 00010000:00010000:2.0:1789760642.018540:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760642.018543:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.018554:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856ee2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760642.018722:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798157440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789760642.018851:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760642.019516:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798157440 00000100:00100000:2.0:1789760642.019522:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798157440 00000100:00080000:0.0:1789760642.019578:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760642.019654:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789760642.019663:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798157440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789760642.019689:0:8114:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789760642.019719:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aad947c, atime: 0x6aad947c, ctime: 0x6aad947c, blocks: 0x1 00010000:00010000:2.0:1789760642.019725:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.019826:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1789760642.019832:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760642.019840:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.019865:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.019876:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.019883:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.019906:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789760642.020664:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3464:x1876699798157440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 999us (1817us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789760642.020673:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789760642.020699:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760642.020706:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.020716:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760642.020721:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.020731:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.020836:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.020855:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ea59fa5/0xc2b9a3a739856f1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.020873:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760642.020874:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760642.020876:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789760642.020910:0:3464:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e57fd12680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789760642.020917:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798157440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789760642.074173:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7275:x1876699798157312:12345-0@lo:1000:osp_up0-1.0 Request processed in 55743us (55829us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789760642.074187:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789760642.074269:0:7275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789760642.074275:0:7275:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1789760642.074320:0:7275:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97e57f6d7800 x1876699798157312/t4294967312(4294967312) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1789760658 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760642.074343:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798157312:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1789760642.074354:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 4 rpc_version 4 00000020:00100000:2.0:1789760642.074384:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760642.074390:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e44974aa00 x1876699798157696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760642.074408:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44974aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798157696:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789760642.074453:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760642.074493:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789760642.074599:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798157696 00000100:00100000:0.0:1789760642.074606:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798157696 00000100:00100000:0.0:1789760642.074651:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789760642.074658:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7275:x1876699798157696:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1789760642.075617:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000100:00100000:0.0:1789760642.075699:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7275:x1876699798157696:12345-0@lo:1000:osp_up0-1.0 Request processed in 1038us (1243us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789760642.075708:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789760642.075863:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44974aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798157696:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1789760642.076026:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.076042:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.076056:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760642.076074:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed3739a5 reply state 000000007fa7493d transno 4294967299 ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.076096:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.076104:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760642.076106:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760642.076110:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789760642.076116:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00000004:00080000:0.0:1789760642.076124:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789760642.076133:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.076142:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.076149:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.076171:0:9081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789760642.076175:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789760642.076180:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.076188:0:9081:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760642.076264:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11372:x1876699777101696:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 174285us (174433us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789760642.076271:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00010000:00010000:1.0:1789760642.076369:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760642.076376:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.076384:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dce00 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:1.0:1789760642.076391:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760642.076399:0:6453:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.076429:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.076436:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760642.076459:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.076466:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e4486dce00/0xc2b9a3a739856efe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739856f05 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.076482:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760642.076484:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760642.076485:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760642.076586:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798157824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760642.076627:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.077965:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798157824 00000100:00100000:1.0:1789760642.077974:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798157824 00000100:00100000:1.0:1789760642.078032:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760642.078040:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3461:x1876699798157824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760642.078052:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760642.078079:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f05 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739856efe expref: 8 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.078094:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16000) 00010000:00010000:1.0:1789760642.078102:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760642.078151:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3461:x1876699798157824:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.078158:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760642.078212:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798157824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760642.096457:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.096623:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777101952 00000100:00100000:0.0:1789760642.096633:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777101952 00000100:00100000:0.0:1789760642.096712:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1789760642.096724:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11373:x1876699777101952:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1789760642.096743:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760642.096765:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a739856f28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521185a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.096882:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856f2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.096896:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.096908:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760642.096944:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760642.096948:0:12655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760642.096987:0:12655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.097010:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a739856f28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521185a expref: 7 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.097029:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856f2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521185a expref: 6 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.097063:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1b00) 00010000:00010000:0.0:1789760642.097066:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760642.097069:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dc400, rc 0) 00000100:00100000:0.0:1789760642.097125:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11373:x1876699777101952:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 403us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760642.097132:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00080000:3.0:1789760642.097819:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760642.101223:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.101308:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777102208 00000100:00100000:3.0:1789760642.101319:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777102208 00000100:00100000:3.0:1789760642.101380:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1789760642.101390:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11373:x1876699777102208:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1789760642.101411:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760642.101415:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789760642.101440:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a739856f2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521185a expref: 6 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.101459:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1b00) 00010000:00010000:3.0:1789760642.101468:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760642.101483:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f36 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211861 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.101635:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.101647:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.101657:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.101670:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.101680:0:6465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f13 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856f0c expref: 6 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.101688:0:6465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.101723:0:6465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f13 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739856f0c expref: 6 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760642.101738:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6465:1876699798157952:0@lo:104: 00000100:00100000:3.0:1789760642.101981:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760642.102032:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760642.102299:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798157952 00000100:00100000:2.0:1789760642.102306:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798157952 00000100:00100000:2.0:1789760642.102385:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789760642.102394:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6465:x1876699798157952:12345-0@lo:104: 00010000:00010000:2.0:1789760642.102407:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.102476:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760642.102482:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6465:x1876699798157952:12345-0@lo:104: Request processed in 90us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.102488:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1789760642.102541:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760642.102548:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.102557:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8fe00 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:1.0:1789760642.102563:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760642.102572:0:7281:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.102598:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.102604:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760642.102625:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.102633:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8fe00/0xc2b9a3a739856f0c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739856f13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.102666:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760642.102668:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760642.102669:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760642.102678:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760642.102690:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798158080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760642.102722:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.102753:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798158080 00000100:00100000:1.0:1789760642.102758:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798158080 00010000:00010000:1.0:1789760642.102776:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f13 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc2b9a3a739856f0c expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760642.102823:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789760642.102830:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3461:x1876699798158080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760642.102839:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789760642.103986:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6465:1876699798157952:0@lo:104: 00010000:00010000:3.0:1789760642.104009:0:6465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760642.140661:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00010000:00010000:1.0:1789760642.145047:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f13 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739856f0c expref: 6 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.145070:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5461f2d00) 00010000:00010000:1.0:1789760642.145076:0:6452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.145085:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.145091:0:6452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.145125:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760642.145227:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798158080:12345-0@lo:103:ldlm_bl.0 Request processed in 42396us (42502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.145236:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789760642.145356:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798158080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760642.146980:0:6465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.147005:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760642.147277:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6465:1876699798158208:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789760642.147350:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760642.147387:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760642.147748:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798158208 00000100:00100000:0.0:1789760642.147756:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798158208 00000100:00100000:0.0:1789760642.147856:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789760642.147866:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6465:x1876699798158208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789760642.147944:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6465:x1876699798158208:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760642.147952:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789760642.148079:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6465:1876699798158208:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789760642.148130:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856f4b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148147:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856f4b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148158:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856f4b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148171:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148177:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148183:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148189:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fc00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760642.148193:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148201:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148224:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16500) 00010000:00010000:2.0:1789760642.148228:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760642.148232:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148238:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148251:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148257:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148263:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148268:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ee00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760642.148271:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148276:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148284:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5461f2d00) 00010000:00010000:2.0:1789760642.148286:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760642.148289:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148295:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148425:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211861 expref: 7 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148444:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856f4b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211861 expref: 6 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.148451:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:2.0:1789760642.148453:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760642.148456:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01600, rc 0) 00000100:00100000:2.0:1789760642.148576:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11373:x1876699777102208:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 47187us (47362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.148583:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:2.0:1789760642.151778:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.152044:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777102336 00000100:00100000:1.0:1789760642.152109:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777102336 00000100:00100000:1.0:1789760642.152201:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1789760642.152211:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11373:x1876699777102336:12345-192.168.203.38@tcp:900:lfs.0 00000100:00100000:1.0:1789760642.152294:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11373:x1876699777102336:12345-192.168.203.38@tcp:900:lfs.0 Request processed in 84us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.152300:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1789760642.154658:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.154732:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777102592 00000100:00100000:2.0:1789760642.154741:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777102592 00000100:00100000:2.0:1789760642.154827:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1789760642.154837:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11373:x1876699777102592:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760642.154868:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760642.154889:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00000/0xc2b9a3a739856f52 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211868 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760642.154978:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789760642.155006:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00000/0xc2b9a3a739856f52 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211868 expref: 8 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.155020:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:2.0:1789760642.155034:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760642.155041:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00000/0xc2b9a3a739856f52 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211868 expref: 8 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.155052:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00000, rc 0) 00000100:00100000:2.0:1789760642.155103:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11373:x1876699777102592:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 268us (454us total) trans 0 rc 301/301 00000100:00100000:2.0:1789760642.155109:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00080000:3.0:1789760642.156967:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760642.157955:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.158023:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777102720 00000100:00100000:1.0:1789760642.158033:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777102720 00000100:00100000:1.0:1789760642.158095:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:1.0:1789760642.158106:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11373:x1876699777102720:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1789760642.158124:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760642.158145:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521186f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.158209:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.158223:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.158236:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760642.158269:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789760642.158274:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789760642.158310:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.158332:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856f59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.158348:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.158357:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760642.158360:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789760642.158364:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8fe00, rc 0) 00000100:00100000:1.0:1789760642.158420:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11373:x1876699777102720:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 316us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.158428:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1789760642.161780:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.161936:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777102976 00000100:00100000:3.0:1789760642.161945:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777102976 00000100:00100000:3.0:1789760642.162000:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:3.0:1789760642.162009:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11373:x1876699777102976:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1789760642.162030:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760642.162049:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8f400/0xc2b9a3a739856f67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211876 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162126:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162140:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162152:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162167:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162173:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162179:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162576:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f7c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162587:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f7c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162607:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f7c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162620:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162627:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162634:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162641:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ec00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760642.162645:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162653:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162665:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760642.162668:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760642.162673:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162679:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ec00/0xc2b9a3a739856f6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162694:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162701:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162713:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162719:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ee00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760642.162722:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162729:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162737:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16700) 00010000:00010000:3.0:1789760642.162740:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760642.162743:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162749:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8ee00/0xc2b9a3a739856f75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.162986:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8f400/0xc2b9a3a739856f67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211876 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.163006:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f7c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211876 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.163014:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:3.0:1789760642.163016:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789760642.163019:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8fc00, rc 0) 00000100:00100000:2.0:1789760642.163672:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11373:x1876699777102976:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1660us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.163681:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:0.0:1789760642.167082:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.167168:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.167268:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777103360 00000100:00100000:1.0:1789760642.167278:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777103360 00000100:00100000:1.0:1789760642.167352:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1789760642.167362:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2404:x1876699777103360:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760642.167376:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760642.167401:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e441f8fc00/0xc2b9a3a739856f7c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211876 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.167421:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:1.0:1789760642.167425:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760642.167483:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777103360:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.167489:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1789760642.167649:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777103232 00000100:00100000:3.0:1789760642.167654:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777103232 00000100:00100000:3.0:1789760642.167709:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1789760642.167717:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11373:x1876699777103232:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1789760642.167733:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760642.167749:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f83 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521187d expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760642.167866:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789760642.168019:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f83 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521187d expref: 9 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.168030:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:3.0:1789760642.168033:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789760642.168037:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e400/0xc2b9a3a739856f83 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521187d expref: 9 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.168049:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e400, rc 0) 00000100:00100000:3.0:1789760642.168077:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11373:x1876699777103232:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 361us (1005us total) trans 4294967300 rc 301/301 00000100:00100000:3.0:1789760642.168083:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1789760642.171920:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.172019:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777103616 00000100:00100000:1.0:1789760642.172028:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777103616 00000100:00100000:1.0:1789760642.172092:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:1.0:1789760642.172102:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11373:x1876699777103616:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1789760642.172183:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.172199:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.172213:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760642.172922:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057d2c710 reply state 000000004c3ba645 transno 4294967301 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.172938:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.172947:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760642.172949:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1789760642.172953:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789760642.172962:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789760642.173035:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11373:x1876699777103616:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 932us (1124us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789760642.173043:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1789760642.175642:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.175935:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777103872 00000100:00100000:2.0:1789760642.175944:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777103872 00000100:00100000:2.0:1789760642.176029:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1789760642.176040:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11373:x1876699777103872:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1789760642.176302:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11373:x1876699777103872:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 262us (665us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789760642.176310:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1789760642.189224:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.189534:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777104000 00000100:00100000:2.0:1789760642.189544:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777104000 00000100:00100000:2.0:1789760642.189675:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1789760642.189686:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11374:x1876699777104000:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:2.0:1789760642.189711:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760642.189734:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00000/0xc2b9a3a739856f98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211884 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.190149:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dca00/0xc2b9a3a739856f9f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.190164:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dca00/0xc2b9a3a739856f9f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.190175:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dca00/0xc2b9a3a739856f9f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760642.190221:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760642.190225:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760642.190261:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dca00/0xc2b9a3a739856f9f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.190289:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00000/0xc2b9a3a739856f98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211884 expref: 13 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.190311:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dca00/0xc2b9a3a739856f9f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211884 expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.190319:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760642.190321:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760642.190392:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dca00, rc 0) 00000100:00100000:0.0:1789760642.190506:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11374:x1876699777104000:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 813us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760642.190514:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:3.0:1789760642.196995:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.197099:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777104256 00000100:00100000:1.0:1789760642.197109:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777104256 00000100:00100000:1.0:1789760642.197167:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:1.0:1789760642.197177:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11374:x1876699777104256:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:1.0:1789760642.197248:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760642.197276:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dca00/0xc2b9a3a739856f9f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211884 expref: 12 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.197293:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760642.197298:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760642.197322:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.197346:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.197356:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760642.197576:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079aa051f reply state 000000008051fca8 transno 4294967303 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.197589:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.197594:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760642.197597:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789760642.197600:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789760642.197607:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789760642.197694:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11374:x1876699777104256:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 517us (708us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789760642.197701:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:0.0:1789760642.257761:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.257820:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777104384 00000100:00100000:0.0:1789760642.257830:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777104384 00000100:00100000:0.0:1789760642.257888:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1789760642.257898:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11378:x1876699777104384:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:0.0:1789760642.257918:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760642.257937:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856fad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521188b expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.257996:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258021:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258033:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258050:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258068:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258075:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258245:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856fc2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258254:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856fc2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258260:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856fc2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760642.258295:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856fc2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258307:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258312:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258630:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258637:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dd000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760642.258642:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258650:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258661:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760642.258664:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760642.258668:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258674:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a739856fb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258687:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258693:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258699:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258703:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dca00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760642.258706:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258723:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258732:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5489b1600) 00010000:00010000:0.0:1789760642.258734:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760642.258737:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258743:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739856fbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258773:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc600/0xc2b9a3a739856fad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521188b expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258813:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856fc2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521188b expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.258821:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:0.0:1789760642.258822:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760642.258825:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dc800, rc 0) 00000100:00100000:0.0:1789760642.258892:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11378:x1876699777104384:12345-192.168.203.38@tcp:101:touch.0 Request processed in 994us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760642.258900:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:3.0:1789760642.261682:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.261722:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.261747:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777104640 00000100:00100000:3.0:1789760642.261756:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777104640 00000100:00100000:3.0:1789760642.261838:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1789760642.261861:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2406:x1876699777104640:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760642.261887:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760642.261912:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a739856fc2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521188b expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.261930:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:3.0:1789760642.261934:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760642.261984:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777104640:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 125us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760642.261991:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:0.0:1789760642.262736:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777104512 00000100:00100000:0.0:1789760642.262742:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777104512 00000100:00100000:0.0:1789760642.262777:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:0.0:1789760642.262804:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11378:x1876699777104512:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:0.0:1789760642.262834:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760642.262862:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856fc9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211892 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.262916:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dce00/0xc2b9a3a739856fd0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.262930:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dce00/0xc2b9a3a739856fd0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.262940:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dce00/0xc2b9a3a739856fd0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760642.262971:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760642.262975:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00010000:00010000:0.0:1789760642.263023:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dcc00/0xc2b9a3a739856fc9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211892 expref: 15 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.263039:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dce00/0xc2b9a3a739856fd0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211892 expref: 14 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.263048:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760642.263050:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1789760642.263068:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dce00, rc 0) 00000100:00100000:0.0:1789760642.263103:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11378:x1876699777104512:12345-192.168.203.38@tcp:101:touch.0 Request processed in 319us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760642.263109:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:2.0:1789760642.272997:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.275904:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777104896 00000100:00100000:0.0:1789760642.275918:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777104896 00000100:00100000:0.0:1789760642.275981:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1789760642.275991:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11378:x1876699777104896:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:0.0:1789760642.276010:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760642.276030:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc400/0xc2b9a3a739856fd7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211899 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.276150:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf5200/0xc2b9a3a739856fde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.276159:0:9081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf5200/0xc2b9a3a739856fde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.276169:0:9081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf5200/0xc2b9a3a739856fde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760642.276191:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f763b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798158336:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1789760642.276256:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760642.276306:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e550870300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760642.276646:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798158336 00000100:00100000:2.0:1789760642.276652:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798158336 00000100:00100000:2.0:1789760642.276688:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789760642.276696:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:9081:x1876699798158336:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789760642.276708:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760642.276720:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856fe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739856fde expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.276741:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739856fde expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.276755:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01400/0xc2b9a3a739856fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739856fde expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.276763:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760642.276766:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789760642.276770:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01400, rc 0) 00000100:00100000:2.0:1789760642.276831:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798158336:12345-0@lo:101:mdt00_003.0 Request processed in 135us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.276837:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789760642.278345:0:9081:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789760642.278355:0:9081:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:0.0:1789760642.278374:0:9081:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1789760642.278417:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f763b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798158336:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1789760642.278440:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf5200/0xc2b9a3a739856fde lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856fe5 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.278457:0:9081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf5200/0xc2b9a3a739856fde lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739856fe5 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789760642.278474:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789760642.278489:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf5200/0xc2b9a3a739856fde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856fe5 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.278507:0:9081:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf5200/0xc2b9a3a739856fde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739856fe5 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.278579:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.278590:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.278599:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.278661:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.278669:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.278676:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760642.278838:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f763b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798158464:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789760642.278901:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760642.278936:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e550870cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760642.279463:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798158464 00000100:00100000:1.0:1789760642.279469:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798158464 00000100:00100000:1.0:1789760642.279537:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789760642.279546:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798158464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760642.279625:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798158464:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.279633:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789760642.279675:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f763b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798158464:0@lo:1000:mdt00_003.0 00000004:00080000:1.0:1789760642.280247:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2:0x0], index 1: 0 00000004:00080000:1.0:1789760642.280258:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789760642.280433:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a739856ffa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280447:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a739856ffa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280457:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a739856ffa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280491:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280498:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280504:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280509:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280515:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.280520:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280535:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280548:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760642.280551:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760642.280556:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280563:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739856fec lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760642.280577:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082cf7178 reply state 00000000a0c17c02 transno 4294967304 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280588:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280594:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2ab29dc6 (ffff97e5489b1e00) 00010000:00010000:1.0:1789760642.280596:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760642.280599:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789760642.280632:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc400/0xc2b9a3a739856fd7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211899 expref: 17 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280647:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a739856ffa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211899 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.280653:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e5461f2300) 00010000:00010000:1.0:1789760642.280655:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760642.280657:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8ea00, rc 0) 00000100:00100000:1.0:1789760642.280748:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+17:11378:x1876699777104896:12345-192.168.203.38@tcp:101:touch.0 Request processed in 4758us (7759us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789760642.280763:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000001:00080000:0.0:1789760642.289319:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1789760642.289707:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.290060:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777105152 00000100:00100000:3.0:1789760642.290070:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777105152 00000100:00100000:3.0:1789760642.290116:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1789760642.290125:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+17:11378:x1876699777105152:12345-192.168.203.38@tcp:36:touch.0 00010000:00010000:3.0:1789760642.290174:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760642.290201:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a739856ffa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211899 expref: 17 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.290216:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e5461f2300) 00010000:00010000:3.0:1789760642.290226:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760642.290262:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.290276:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.290286:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760642.290577:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000352171a6 reply state 0000000071058884 transno 4294967305 ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.290591:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.290598:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:3.0:1789760642.290600:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789760642.290603:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760642.290713:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11378:x1876699777105152:12345-192.168.203.38@tcp:36:touch.0 Request processed in 588us (1009us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789760642.290720:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:0.0:1789760642.293727:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.293923:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777105280 00000100:00100000:1.0:1789760642.293932:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777105280 00000100:00100000:1.0:1789760642.294017:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:1.0:1789760642.294028:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11378:x1876699777105280:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:1.0:1789760642.294064:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760642.294085:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e200/0xc2b9a3a73985700f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118a0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.294140:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e200/0xc2b9a3a73985700f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118a0 expref: 19 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.294155:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e200/0xc2b9a3a73985700f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118a0 expref: 19 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.294174:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:1.0:1789760642.294178:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789760642.294181:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8e200, rc 0) 00000100:00100000:1.0:1789760642.294241:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11378:x1876699777105280:12345-192.168.203.38@tcp:101:touch.0 Request processed in 215us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.294248:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:0.0:1789760642.297178:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.297398:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777105408 00000100:00100000:3.0:1789760642.297408:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777105408 00000100:00100000:3.0:1789760642.297483:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:3.0:1789760642.297505:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e581c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777105408:12345-192.168.203.38@tcp:2:touch.0 00000100:00100000:3.0:1789760642.297888:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e581c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777105408:12345-192.168.203.38@tcp:2:touch.0 Request processed in 395us (717us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789760642.297896:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00080000:2.0:1789760642.298150:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760642.298332:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.298460:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777105536 00000100:00100000:2.0:1789760642.298466:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777105536 00000100:00100000:2.0:1789760642.298507:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:2.0:1789760642.298512:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1876699777105536:12345-192.168.203.38@tcp:8:touch.0 00010000:00080000:2.0:1789760642.298550:0:8112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1789760642.298582:0:8112:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739857016 00002000:00100000:2.0:1789760642.298593:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ac82f857-edfe-4201-bbe8-4599ba569acb/ffff97e543260800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760642.298616:0:8112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760642.298822:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789760642.298862:0:8112:0:(import.c:65:import_set_state_nolock()) ffff97e543262000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760642.298911:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777105536:12345-192.168.203.38@tcp:8:touch.0 Request processed in 397us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.298918:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1789760642.302173:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.302248:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777105664 00000100:00100000:3.0:1789760642.302257:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777105664 00000100:00100000:3.0:1789760642.302338:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1789760642.302349:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:0:x1876699777105664:12345-192.168.203.38@tcp:2:touch.0 00000100:00080000:2.0:1789760642.302653:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760642.321282:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:0:x1876699777105664:12345-192.168.203.38@tcp:2:touch.0 Request processed in 18925us (19108us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789760642.321295:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000001:00100000:2.0:1789760642.321480:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000001:00080000:2.0:1789760642.321494:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1789760642.324291:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.324422:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777105920 00000100:00100000:1.0:1789760642.324433:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777105920 00000100:00100000:1.0:1789760642.324537:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1789760642.324548:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11378:x1876699777105920:12345-192.168.203.38@tcp:35:touch.0 00000100:00100000:1.0:1789760642.324936:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11378:x1876699777105920:12345-192.168.203.38@tcp:35:touch.0 Request processed in 388us (651us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789760642.324944:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1789760642.383876:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.384009:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777106176 00000100:00100000:1.0:1789760642.384018:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777106176 00000100:00100000:1.0:1789760642.384086:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:1.0:1789760642.384097:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11382:x1876699777106176:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:1.0:1789760642.384123:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760642.384142:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985701d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118a7 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.384256:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.384270:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.384282:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.384296:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.384303:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.384310:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760642.384982:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3:0x0], index 0: 0 00000004:00080000:1.0:1789760642.385006:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789760642.385259:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a739857032 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.385270:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a739857032 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.385278:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a739857032 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.385311:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.385318:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386468:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386476:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386483:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.386487:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386549:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386564:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760642.386567:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760642.386572:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386594:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e400/0xc2b9a3a739857024 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760642.386610:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3facffe reply state 00000000cecb706e transno 4294967307 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386623:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386630:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x151ecd9f (ffff97e5461f2600) 00010000:00010000:1.0:1789760642.386632:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760642.386635:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789760642.386678:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985701d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118a7 expref: 23 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386692:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a739857032 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118a7 expref: 22 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.386700:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5461f2100) 00010000:00010000:1.0:1789760642.386702:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760642.386705:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f200, rc 0) 00000100:00100000:1.0:1789760642.386764:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11382:x1876699777106176:12345-192.168.203.38@tcp:101:touch.0 Request processed in 2669us (2896us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789760642.386772:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1789760642.391099:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.391190:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777106432 00000100:00100000:0.0:1789760642.391199:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777106432 00000100:00100000:0.0:1789760642.391249:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1789760642.391258:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11382:x1876699777106432:12345-192.168.203.38@tcp:36:touch.0 00010000:00010000:0.0:1789760642.391313:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760642.391337:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a739857032 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118a7 expref: 23 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.391355:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5461f2100) 00010000:00010000:0.0:1789760642.391366:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760642.391407:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.391420:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.391430:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760642.391572:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037f5d133 reply state 00000000e6a73bf3 transno 4294967308 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.391584:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.391590:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:0.0:1789760642.391592:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760642.391595:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760642.391695:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11382:x1876699777106432:12345-192.168.203.38@tcp:36:touch.0 Request processed in 436us (604us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789760642.391703:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1789760642.395009:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.395075:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777106560 00000100:00100000:1.0:1789760642.395085:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777106560 00000100:00100000:1.0:1789760642.395141:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:1.0:1789760642.395150:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11382:x1876699777106560:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:1.0:1789760642.395191:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760642.395211:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f600/0xc2b9a3a739857047 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118ae expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.395269:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f600/0xc2b9a3a739857047 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ae expref: 25 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.395284:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f600/0xc2b9a3a739857047 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ae expref: 25 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.395302:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:1.0:1789760642.395305:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789760642.395309:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f600, rc 0) 00000100:00100000:1.0:1789760642.395377:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11382:x1876699777106560:12345-192.168.203.38@tcp:101:touch.0 Request processed in 227us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.395384:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:1.0:1789760642.399457:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.399633:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777106688 00000100:00100000:2.0:1789760642.399642:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777106688 00000100:00100000:2.0:1789760642.399696:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1789760642.399706:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777106688:12345-192.168.203.38@tcp:2:touch.0 00000100:00100000:2.0:1789760642.400202:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777106688:12345-192.168.203.38@tcp:2:touch.0 Request processed in 496us (752us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789760642.400211:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:3.0:1789760642.402772:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.402940:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777106816 00000100:00100000:0.0:1789760642.402948:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777106816 00000100:00100000:0.0:1789760642.402997:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:0.0:1789760642.403006:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777106816:12345-192.168.203.38@tcp:2:touch.0 00000100:00100000:0.0:1789760642.403279:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777106816:12345-192.168.203.38@tcp:2:touch.0 Request processed in 273us (514us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789760642.403287:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:3.0:1789760642.406007:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.406104:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777107072 00000100:00100000:2.0:1789760642.406113:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777107072 00000100:00100000:2.0:1789760642.406164:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1789760642.406173:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11382:x1876699777107072:12345-192.168.203.38@tcp:35:touch.0 00000100:00100000:2.0:1789760642.406822:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+26:11382:x1876699777107072:12345-192.168.203.38@tcp:35:touch.0 Request processed in 648us (822us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789760642.406858:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:1.0:1789760642.453168:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.453277:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777107328 00000100:00100000:0.0:1789760642.453287:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777107328 00000100:00100000:0.0:1789760642.453360:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:0.0:1789760642.453371:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+26:11386:x1876699777107328:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1789760642.453394:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760642.453416:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4800/0xc2b9a3a73985704e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118b5 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760642.453518:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789760642.453657:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4800/0xc2b9a3a73985704e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118b5 expref: 28 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.453671:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1600) 00010000:00010000:0.0:1789760642.453675:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760642.453680:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4800/0xc2b9a3a73985704e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118b5 expref: 28 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.453718:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4800, rc 0) 00000100:00100000:0.0:1789760642.453834:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11386:x1876699777107328:12345-192.168.203.38@tcp:101:bash.0 Request processed in 416us (625us total) trans 4294967310 rc 301/301 00000100:00100000:0.0:1789760642.453853:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:3.0:1789760642.459025:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.459124:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777107456 00000100:00100000:2.0:1789760642.459134:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777107456 00000100:00100000:2.0:1789760642.459194:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1789760642.459204:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11386:x1876699777107456:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1789760642.459239:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760642.459262:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985705c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118bc expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.459333:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a739857063 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.459349:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a739857063 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.459363:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a739857063 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760642.459398:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760642.459402:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760642.459443:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a739857063 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.459469:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985705c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118bc expref: 29 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.459489:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a739857063 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118bc expref: 28 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.459520:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:2.0:1789760642.459523:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760642.459526:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00a00, rc 0) 00000100:00100000:2.0:1789760642.460454:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11386:x1876699777107456:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1247us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.460464:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:1.0:1789760642.475775:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.476019:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777107584 00000100:00100000:3.0:1789760642.476028:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777107584 00000100:00100000:3.0:1789760642.476139:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1789760642.476150:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565ddac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11386:x1876699777107584:12345-192.168.203.38@tcp:37:bash.0 00000100:00100000:3.0:1789760642.482191:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565ddac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11386:x1876699777107584:12345-192.168.203.38@tcp:37:bash.0 Request processed in 6034us (6416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760642.482204:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1789760642.487851:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.487992:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777107840 00000100:00100000:2.0:1789760642.488002:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777107840 00000100:00100000:2.0:1789760642.488064:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1789760642.488075:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11386:x1876699777107840:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:2.0:1789760642.488459:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11386:x1876699777107840:12345-192.168.203.38@tcp:35:bash.0 Request processed in 384us (624us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789760642.488467:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1789760642.510349:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.510447:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777107968 00000100:00100000:0.0:1789760642.510457:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777107968 00000100:00100000:0.0:1789760642.510527:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:0.0:1789760642.510538:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11386:x1876699777107968:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:0.0:1789760642.510560:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760642.510580:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a73985706a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118c3 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510651:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510665:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510675:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510685:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510691:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510697:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510818:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4c00/0xc2b9a3a73985707f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510828:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4c00/0xc2b9a3a73985707f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510835:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4c00/0xc2b9a3a73985707f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760642.510877:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789760642.510881:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760642.510898:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4c00/0xc2b9a3a73985707f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510910:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4c00/0xc2b9a3a73985707f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510917:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510923:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510929:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510935:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760642.510939:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510947:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510965:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760642.510968:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760642.510973:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510979:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857071 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510992:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.510997:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.511002:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.511007:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760642.511010:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.511015:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.511023:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2ab29dc6 (ffff97e5489b1e00) 00010000:00010000:0.0:1789760642.511025:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760642.511028:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.511033:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857078 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.511071:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a73985706a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118c3 expref: 31 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.511086:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4c00/0xc2b9a3a73985707f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118c3 expref: 30 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.511093:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:0.0:1789760642.511096:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760642.511098:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4c00, rc 0) 00000100:00100000:0.0:1789760642.511160:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11386:x1876699777107968:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 624us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760642.511168:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:0.0:1789760642.516381:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.516429:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.516506:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777108096 00000100:00100000:2.0:1789760642.516517:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777108096 00000100:00100000:2.0:1789760642.516569:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777108224 00000100:00100000:2.0:1789760642.516573:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777108224 00000100:00100000:2.0:1789760642.516614:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1789760642.516624:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777108096:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:2.0:1789760642.516641:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760642.516660:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118ca expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760642.516689:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aad9481, atime: 0x6aad9481, ctime: 0x6aad9481, blocks: 0x1 00010000:00010000:2.0:1789760642.516710:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=318s v=(0 0) 00000100:00100000:3.0:1789760642.516727:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00010000:00010000:2.0:1789760642.516730:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760642.516745:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 8 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760642.516755:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777108224:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:2.0:1789760642.516778:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 8 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.516823:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760642.516858:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118d1 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.516865:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00600, rc 0) 00002000:00010000:3.0:1789760642.516899:0:9533:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aad9481, atime: 0x6aad9481, ctime: 0x6aad9481, blocks: 0x1 00010000:00010000:3.0:1789760642.516920:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:3.0:1789760642.516925:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789760642.516932:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777108096:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 304us (555us total) trans 0 rc 0/0 00010000:00010000:3.0:1789760642.516942:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 7 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760642.516951:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00010000:00010000:3.0:1789760642.516981:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 7 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.517017:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e400, rc 0) 00000100:00100000:3.0:1789760642.517068:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777108224:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 326us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760642.517075:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1789760642.533784:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.534836:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777108480 00000100:00100000:0.0:1789760642.534855:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777108480 00000100:00100000:0.0:1789760642.534975:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1789760642.534987:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11386:x1876699777108480:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:0.0:1789760642.535041:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760642.535085:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4c00/0xc2b9a3a73985707f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118c3 expref: 30 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.535106:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:0.0:1789760642.535110:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760642.535137:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.535170:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.535181:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760642.535903:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c04b113e reply state 000000003eba1139 transno 4294967312 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.535918:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.535926:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:0.0:1789760642.535928:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789760642.535931:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760642.536022:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+31:11386:x1876699777108480:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 1035us (2245us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789760642.536029:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:2.0:1789760642.545099:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.545140:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.545205:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777108608 00000100:00100000:3.0:1789760642.545276:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777108608 00000100:00100000:3.0:1789760642.545434:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777108736 00000100:00100000:3.0:1789760642.545438:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777108736 00000100:00100000:2.0:1789760642.545996:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1789760642.546010:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2405:x1876699777108608:12345-192.168.203.38@tcp:2:chmod.0 00002000:00010000:2.0:1789760642.546279:0:8114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760642.546284:0:8114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 1789760641 -> 1789760641 00002000:00010000:2.0:1789760642.546287:0:8114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 1789760641 -> 1789760641 00002000:00010000:2.0:1789760642.546289:0:8114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 1789760641 -> 1789760642 00002000:00010000:2.0:1789760642.546291:0:8114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760642.546461:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2405:x1876699777108608:12345-192.168.203.38@tcp:2:chmod.0 Request processed in 453us (1370us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789760642.546469:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1789760642.546489:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1789760642.546570:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777108736:12345-192.168.203.38@tcp:2:chmod.0 00002000:00010000:2.0:1789760642.546784:0:8114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760642.546808:0:8114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 1789760641 -> 1789760641 00002000:00010000:2.0:1789760642.546810:0:8114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 1789760641 -> 1789760641 00002000:00010000:2.0:1789760642.546812:0:8114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 1789760641 -> 1789760642 00002000:00010000:2.0:1789760642.546815:0:8114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760642.546854:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2405:x1876699777108736:12345-192.168.203.38@tcp:2:chmod.0 Request processed in 344us (1698us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789760642.546861:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1789760642.550746:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.550879:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777108864 00000100:00100000:0.0:1789760642.550890:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777108864 00000100:00100000:0.0:1789760642.550944:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:0.0:1789760642.550955:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+31:11386:x1876699777108864:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:0.0:1789760642.550980:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760642.551000:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a73985709b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118d8 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551088:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551115:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551127:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551140:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551147:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551154:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551252:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a7398570b0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551260:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a7398570b0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551267:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a7398570b0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760642.551297:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 0 00000004:00200000:0.0:1789760642.551301:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760642.551319:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a7398570b0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551341:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a7398570b0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551358:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551363:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551370:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551375:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760642.551379:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551385:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551397:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760642.551400:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760642.551404:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551410:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a7398570a2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551424:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551430:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551435:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551449:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760642.551452:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551458:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551466:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x151ecd9f (ffff97e5461f2600) 00010000:00010000:0.0:1789760642.551469:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760642.551471:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551476:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4400/0xc2b9a3a7398570a9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551503:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5400/0xc2b9a3a73985709b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d8 expref: 33 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551517:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a7398570b0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d8 expref: 32 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.551524:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:0.0:1789760642.551526:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760642.551528:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5c00, rc 0) 00000100:00100000:0.0:1789760642.551590:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+32:11386:x1876699777108864:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 637us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760642.551606:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:2.0:1789760642.555541:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.555704:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777108992 00000100:00100000:3.0:1789760642.555714:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777108992 00000100:00100000:3.0:1789760642.555773:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1789760642.555782:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777108992:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:3.0:1789760642.555836:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760642.555865:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118df expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760642.555891:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x6aad9481, atime: 0x6aad9481, ctime: 0x6aad9481, blocks: 0x1 00010000:00010000:3.0:1789760642.555912:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:3.0:1789760642.555916:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760642.555924:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 9 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.555941:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 9 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.555972:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8f400, rc 0) 00000100:00100000:3.0:1789760642.556033:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777108992:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 252us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760642.556040:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1789760642.559468:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.559581:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777109120 00000100:00100000:1.0:1789760642.559591:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777109120 00000100:00100000:1.0:1789760642.559663:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1789760642.559674:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777109120:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:1.0:1789760642.559691:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760642.559712:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118e6 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760642.559755:0:8110:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3:0x0] initial LVB size: 0, mtime: 0x6aad9481, atime: 0x6aad9481, ctime: 0x6aad9481, blocks: 0x1 00010000:00010000:1.0:1789760642.559773:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1789760642.559777:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760642.559817:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 10 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.559848:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 10 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.559863:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8e400, rc 0) 00000100:00100000:1.0:1789760642.560951:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2404:x1876699777109120:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 1274us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.560960:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00010000:00010000:2.0:1789760642.567925:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760642.569044:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.569175:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777109376 00000100:00100000:1.0:1789760642.569185:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777109376 00000100:00100000:1.0:1789760642.569350:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1789760642.569362:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+32:11386:x1876699777109376:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:1.0:1789760642.569431:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760642.569456:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a7398570b0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d8 expref: 32 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.569474:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:1.0:1789760642.569479:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760642.569508:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.569525:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.569536:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760642.569743:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009db45f8d reply state 00000000eb560d45 transno 4294967313 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.569756:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.569763:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:1.0:1789760642.569766:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789760642.569768:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760642.569918:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+33:11386:x1876699777109376:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 558us (879us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789760642.569926:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1789760642.573470:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.573633:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.574032:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777109632 00000100:00100000:3.0:1789760642.574042:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777109632 00000100:00100000:1.0:1789760642.574173:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777109504 00000100:00100000:1.0:1789760642.574179:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777109504 00000100:00100000:1.0:1789760642.574270:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:1.0:1789760642.574281:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777109504:12345-192.168.203.38@tcp:2:chmod.0 00002000:00010000:1.0:1789760642.574488:0:9533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760642.574503:0:9533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789760641 -> 1789760641 00002000:00010000:1.0:1789760642.574507:0:9533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789760641 -> 1789760641 00002000:00010000:1.0:1789760642.574509:0:9533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789760641 -> 1789760642 00002000:00010000:1.0:1789760642.574511:0:9533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760642.574569:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2403:x1876699777109504:12345-192.168.203.38@tcp:2:chmod.0 Request processed in 289us (935us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789760642.574586:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1789760642.576766:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1789760642.576781:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2403:x1876699777109632:12345-192.168.203.38@tcp:2:chmod.0 00002000:00010000:2.0:1789760642.576982:0:8112:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760642.576986:0:8112:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime from disk: 1789760641 -> 1789760641 00002000:00010000:2.0:1789760642.576989:0:8112:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb atime from disk: 1789760641 -> 1789760641 00002000:00010000:2.0:1789760642.576991:0:8112:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime from disk: 1789760641 -> 1789760642 00002000:00010000:2.0:1789760642.576993:0:8112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760642.577135:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2403:x1876699777109632:12345-192.168.203.38@tcp:2:chmod.0 Request processed in 274us (3591us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789760642.577145:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:0.0:1789760642.635968:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.636061:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777109888 00000100:00100000:3.0:1789760642.636071:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777109888 00000100:00100000:3.0:1789760642.636142:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:3.0:1789760642.636153:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+33:11390:x1876699777109888:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:3.0:1789760642.636179:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760642.636182:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789760642.636209:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a739857063 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118bc expref: 33 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.636229:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:3.0:1789760642.636233:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760642.636247:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ee00/0xc2b9a3a7398570cc lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118ed expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760642.640529:0:12655:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 500, time 4228us 00010000:00010000:3.0:1789760642.690978:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691001:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691027:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691041:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691049:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691056:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691145:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fc00/0xc2b9a3a7398570e1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691154:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fc00/0xc2b9a3a7398570e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691160:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fc00/0xc2b9a3a7398570e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760642.691169:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789760642.691271:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691280:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691286:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691293:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ec00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760642.691305:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691313:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691325:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:3.0:1789760642.691329:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760642.691334:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691340:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ec00/0xc2b9a3a7398570d3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691365:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691371:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691377:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691383:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fa00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760642.691386:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691391:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691398:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2ab29dc6 (ffff97e5489b1e00) 00010000:00010000:3.0:1789760642.691401:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760642.691409:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691415:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fa00/0xc2b9a3a7398570da lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.691481:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8ee00/0xc2b9a3a7398570cc lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ed expref: 35 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.692101:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fc00/0xc2b9a3a7398570e1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ed expref: 34 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.692201:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:3.0:1789760642.692205:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789760642.692207:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8fc00, rc 0) 00000100:00100000:3.0:1789760642.692831:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+34:11390:x1876699777109888:12345-192.168.203.38@tcp:101:dd.500 Request processed in 56677us (56869us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789760642.692850:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:0.0:1789760642.707639:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.708367:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777110144 00000100:00100000:1.0:1789760642.708378:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777110144 00000100:00100000:1.0:1789760642.708440:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:1.0:1789760642.708451:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+34:11390:x1876699777110144:12345-192.168.203.38@tcp:36:dd.500 00010000:00010000:1.0:1789760642.708677:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760642.708706:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8fc00/0xc2b9a3a7398570e1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ed expref: 34 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.708726:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:1.0:1789760642.708730:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760642.708973:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.708988:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.708998:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760642.709054:0:6465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967315 00000004:00010000:1.0:1789760642.709081:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001022a6a6 reply state 00000000c59d0b5e transno 4294967316 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.709094:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.709101:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:1.0:1789760642.709103:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760642.709430:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760642.709637:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+36:11390:x1876699777110144:12345-192.168.203.38@tcp:36:dd.500 Request processed in 1186us (2005us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789760642.709645:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00000020:00080000:1.0:1789760642.709650:0:6465:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789760642.716450:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.716591:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777110272 00000100:00100000:3.0:1789760642.716601:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777110272 00000100:00100000:3.0:1789760642.716686:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:3.0:1789760642.716697:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11390:x1876699777110272:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:3.0:1789760642.716714:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760642.716743:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1751bca/0xc2b9a3a7398570f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118f4 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.716774:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 12 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.716832:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760642.716844:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760642.716850:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1751bca/0xc2b9a3a7398570f6 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118f4 expref: 12 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.716885:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 12 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.716899:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 12 pid: 8112 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760642.716912:0:8114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876699798158592:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760642.716993:0:8114:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760642.721319:0:8114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876699798158592:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760642.721365:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1751bca/0xc2b9a3a7398570f6 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118f4 expref: 12 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.721386:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8ee00, rc 0) 00000100:00100000:3.0:1789760642.721434:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11390:x1876699777110272:12345-192.168.203.38@tcp:101:dd.500 Request processed in 4739us (4994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760642.721443:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:0.0:1789760642.725014:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.725147:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777110400 00000100:00100000:1.0:1789760642.725155:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777110400 00010000:00010000:1.0:1789760642.725195:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 12 pid: 8112 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760642.725240:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1789760642.725251:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2404:x1876699777110400:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760642.725267:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760642.725273:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 12 pid: 8112 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.725286:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 12 pid: 8112 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.725310:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000905e6db1/0xc2b9a3a739857086 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ca expref: 12 pid: 8112 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.725338:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760642.725343:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760642.725349:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1751bca/0xc2b9a3a7398570f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118f4 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.725385:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1751bca/0xc2b9a3a7398570f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118f4 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.725423:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e1751bca/0xc2b9a3a7398570f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118f4 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760642.725438:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f031c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9898:1876699798158720:192.168.203.38@tcp:105: 00000100:00100000:1.0:1789760642.725520:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21780 going to sleep for 11 seconds 00000100:00100000:1.0:1789760642.730266:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f031c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9898:1876699798158720:192.168.203.38@tcp:105: 00010000:00010000:1.0:1789760642.730295:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760642.730359:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2404:x1876699777110400:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 5109us (5353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.730370:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1789760642.733582:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.733695:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777110528 00000100:00100000:0.0:1789760642.733705:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777110528 00000100:00100000:0.0:1789760642.733773:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:0.0:1789760642.733784:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11390:x1876699777110528:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760642.733849:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760642.733868:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398570fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652118fb expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.733900:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 11 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.733909:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760642.733914:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760642.733920:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398570fd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118fb expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.733955:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 11 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760642.733968:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 11 pid: 9533 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760642.733983:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8112:1876699798158848:192.168.203.38@tcp:104: 00000100:00100000:0.0:1789760642.734062:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760642.738187:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.738342:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777110656 00000100:00100000:3.0:1789760642.738352:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777110656 00010000:00010000:3.0:1789760642.738400:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 12 pid: 9533 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760642.738442:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:3.0:1789760642.738453:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2404:x1876699777110656:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760642.738467:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760642.738473:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 12 pid: 9533 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.738486:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 12 pid: 9533 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.738675:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760642.738681:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760642.738688:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398570fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118fb expref: 12 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.738698:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398570fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118fb expref: 12 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.738747:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398570fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118fb expref: 12 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760642.738762:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798158976:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760642.738881:0:6451:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f059e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789760642.739039:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a73985708d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118d1 expref: 12 pid: 9533 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760642.739057:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8112:1876699798158848:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760642.739081:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398570fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118fb expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760642.739092:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4a00, rc 0) 00000100:00100000:2.0:1789760642.739131:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11390:x1876699777110528:12345-192.168.203.38@tcp:101:dd.500 Request processed in 5349us (5558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.739138:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1789760642.742742:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798158976:192.168.203.38@tcp:105: 00010000:00010000:3.0:1789760642.742770:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760642.742858:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2404:x1876699777110656:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4407us (4679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760642.742868:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1789760642.745866:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760642.745912:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.746004:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777110784 00000100:00100000:1.0:1789760642.746013:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777110784 00002000:00010000:1.0:1789760642.746051:0:8119:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:1.0:1789760642.746056:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f761f80 with x1876699777110784 ext(0->18446744073709551615) 00002000:00010000:1.0:1789760642.746067:0:8119:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f761f80. 00000100:00100000:1.0:1789760642.746087:0:8119:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 3 deadline 0 time 318930293700 state 0x0 ref 1 00000100:00100000:1.0:1789760642.746098:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 3 deadline 319130293700 time 318930293700 state 0x1 ref 1 00000100:00100000:1.0:1789760642.746136:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777110912 00000100:00100000:1.0:1789760642.746141:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777110912 00002000:00010000:1.0:1789760642.746156:0:8119:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2 (0->18446744073709551615) 00002000:00100000:1.0:1789760642.746172:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f760700 with x1876699777110912 ext(0->18446744073709551615) 00002000:00010000:1.0:1789760642.746179:0:8119:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f760700. 00000100:00100000:1.0:1789760642.746187:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 3 deadline 319130293700 time 318930293700 state 0x1 ref 2 00000100:00100000:1.0:1789760642.746201:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 2 deadline 319130411177 time 318930411177 state 0x1 ref 2 00000100:00100000:1.0:1789760642.746213:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2404:x1876699777110784:12345-192.168.203.38@tcp:10:dd.500 00002000:00010000:1.0:1789760642.751897:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760642.751906:0:8119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 1789760641 -> 1789760642 00002000:00010000:1.0:1789760642.751909:0:8119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 1789760641 -> 1789760641 00002000:00010000:1.0:1789760642.751911:0:8119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 1789760642 -> 1789760642 00002000:00010000:1.0:1789760642.751914:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760642.752034:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2404:x1876699777110784:12345-192.168.203.38@tcp:10:dd.500 Request processed in 5818us (6188us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789760642.752044:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 0 00002000:00010000:1.0:1789760642.752050:0:8119:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:1.0:1789760642.752054:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f761f80 with x1876699777110784 ext(0->18446744073709551615) 00002000:00010000:1.0:1789760642.752061:0:8119:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f761f80. 00000100:00100000:1.0:1789760642.752095:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 1 deadline 319130411177 time 318936303080 state 0x0 ref 1 00000100:00100000:1.0:1789760642.752184:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2403:x1876699777110912:12345-192.168.203.38@tcp:10:dd.500 00002000:00010000:1.0:1789760642.753057:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760642.753061:0:8119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 1789760641 -> 1789760642 00002000:00010000:1.0:1789760642.753064:0:8119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 1789760641 -> 1789760641 00002000:00010000:1.0:1789760642.753065:0:8119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 1789760642 -> 1789760642 00002000:00010000:1.0:1789760642.753067:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760642.753313:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2403:x1876699777110912:12345-192.168.203.38@tcp:10:dd.500 Request processed in 1204us (7397us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789760642.753331:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1789760642.753336:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 1 deadline 319130411177 time 318936303080 state 0x2 ref 0 00002000:00010000:1.0:1789760642.753344:0:8119:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2 (0->18446744073709551615) 00002000:00100000:1.0:1789760642.753354:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f760700 with x1876699777110912 ext(0->18446744073709551615) 00002000:00010000:1.0:1789760642.753360:0:8119:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f760700. 00000100:00100000:2.0:1789760642.759893:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760642.759912:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798159104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760642.759977:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760642.760020:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798159104 00000100:00100000:2.0:1789760642.760028:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798159104 00000100:00100000:2.0:1789760642.760085:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789760642.760095:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798159104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760642.760135:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760642.760179:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798159104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.760186:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789760642.760222:0:3464:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789760642.760227:0:3464:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e57fd12680, transno 4294967301 00000100:00100000:2.0:1789760642.760241:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798159104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760642.770441:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798159360:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.770524:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.770554:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798159872:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.770581:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.770607:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789760642.770613:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798159488:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.770634:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.770652:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798160000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.770673:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.770701:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798159360 00000100:00100000:1.0:1789760642.770707:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798159360 00000100:00100000:1.0:1789760642.770757:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798159488 00000100:00100000:1.0:1789760642.770760:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798159488 00000100:00100000:1.0:1789760642.770814:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798160000 00000100:00100000:1.0:1789760642.770818:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798160000 00000100:00100000:1.0:1789760642.770850:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789760642.770859:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798159360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.770912:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798159360:12345-0@lo:400:kworker.0 Request processed in 55us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.770933:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789760642.770950:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789760642.770956:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798159488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.770985:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798159488:12345-0@lo:400:kworker.0 Request processed in 30us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.770990:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789760642.771001:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789760642.771006:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798160000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771030:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798160000:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.771035:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789760642.771053:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798159616:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771075:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.771091:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798160128:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771122:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.771137:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789760642.771143:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798159232:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771168:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.771194:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798159744:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771216:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.771230:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798160256:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771249:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.771273:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798159232 00000100:00100000:1.0:1789760642.771276:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798159232 00000100:00100000:1.0:1789760642.771311:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789760642.771317:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798159232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771351:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798159232:12345-0@lo:400:kworker.0 Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.771358:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789760642.771396:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798159232:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771425:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798159488:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771435:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798160000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771444:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798159360:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771462:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798159616 00000100:00100000:1.0:1789760642.771465:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798159616 00000100:00100000:1.0:1789760642.771483:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798160128 00000100:00100000:1.0:1789760642.771485:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798160128 00000100:00100000:1.0:1789760642.771498:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789760642.771503:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798159616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771536:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798159616:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.771542:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789760642.771553:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789760642.771558:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798160128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771584:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798160128:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.771589:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789760642.771611:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798159616:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771629:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798160128:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771646:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798159872 00000100:00100000:1.0:1789760642.771649:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798159872 00000100:00100000:1.0:1789760642.771674:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798159744 00000100:00100000:1.0:1789760642.771677:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798159744 00000100:00100000:1.0:1789760642.771689:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798160256 00000100:00100000:1.0:1789760642.771691:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798160256 00000100:00100000:1.0:1789760642.771705:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789760642.771711:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798159872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771748:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798159872:12345-0@lo:400:kworker.0 Request processed in 37us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.771754:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789760642.771766:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789760642.771772:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798159744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771830:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798159744:12345-0@lo:400:kworker.0 Request processed in 58us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.771835:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789760642.771859:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789760642.771865:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798160256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771889:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798160256:12345-0@lo:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.771894:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789760642.771920:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798159872:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771942:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798159744:0@lo:400:kworker.0 00000100:00100000:1.0:1789760642.771951:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798160256:0@lo:400:kworker.0 00000100:00080000:2.0:1789760642.779984:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760642.780000:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760642.780004:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760642.780006:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760642.780431:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798160384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760642.780565:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760642.780614:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798160384 00000100:00100000:2.0:1789760642.780621:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798160384 00000100:00100000:2.0:1789760642.780664:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789760642.780672:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798160384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760642.780695:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760642.781917:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798160384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1239us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760642.781928:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789760642.781996:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798160384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760642.822560:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760642.822637:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777111040 00000100:00100000:3.0:1789760642.822647:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777111040 00002000:00100000:3.0:1789760642.822691:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (0->1048575) req@ffff97e5433dd880 x1876699777111040/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:688/0 lens 488/0 e 0 to 0 dl 1789760653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760642.822702:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5433dd880 with x1876699777111040 ext(0->1048575) 00002000:00010000:3.0:1789760642.822710:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5433dd880 00000100:00100000:3.0:1789760642.822723:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 1 deadline 319130411177 time 318936303080 state 0x0 ref 1 00000100:00100000:3.0:1789760642.822734:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 1 deadline 319136303080 time 318936303080 state 0x1 ref 1 00000100:00100000:3.0:1789760642.822762:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319136303080 time 319006971397 state 0x0 ref 1 00000100:00100000:3.0:1789760642.822773:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2405:x1876699777111040:12345-192.168.203.38@tcp:4:dd.500 00000001:00080000:3.0:1789760642.857116:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967312 is committed 00000001:00080000:3.0:1789760642.857147:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967316 is committed 00000020:00080000:3.0:1789760642.857168:0:7272:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97e441f86e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789760642.857173:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e57f021b00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97e441f86180 00000020:00080000:3.0:1789760642.857176:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].1 00000020:00080000:3.0:1789760642.857179:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e57f021c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e57ac53c00 00000020:00080000:3.0:1789760642.857181:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].1 00010000:00010000:3.0:1789760642.857224:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857248:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857256:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857262:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ec00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760642.857266:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857273:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857291:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:3.0:1789760642.857293:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789760642.857298:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857304:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ec00/0xc2b9a3a7398570c5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857321:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857327:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857333:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857337:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760642.857346:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857352:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857361:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:3.0:1789760642.857363:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760642.857366:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760642.857372:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398570ef lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789760642.857388:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789760642.857506:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00010000:1.0:1789760642.858050:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858060:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858066:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858072:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dde00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.858075:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858082:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858093:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760642.858096:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760642.858099:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858105:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dde00/0xc2b9a3a739856f21 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858122:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858128:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858134:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858148:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.858151:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858158:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858166:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760642.858168:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789760642.858171:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858176:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a739856f91 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858187:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858192:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858197:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858202:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.858210:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858216:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858233:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760642.858235:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789760642.858238:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858244:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a739856fa6 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858254:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858259:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858264:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858269:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.858271:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858276:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858282:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2ab29dc6 (ffff97e5489b1e00) 00010000:00010000:1.0:1789760642.858284:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760642.858286:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858291:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4000/0xc2b9a3a739856ff3 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858320:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858327:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858332:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858336:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8e200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.858339:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858344:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858351:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:1.0:1789760642.858353:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760642.858356:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858362:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e441f8e200/0xc2b9a3a739857008 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858373:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858379:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858385:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858395:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.858399:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858406:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858414:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x151ecd9f (ffff97e5461f2600) 00010000:00010000:1.0:1789760642.858417:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760642.858420:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858426:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f400/0xc2b9a3a73985702b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858441:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858459:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858465:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858470:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.858473:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858479:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858498:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:1.0:1789760642.858500:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760642.858503:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858509:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5600/0xc2b9a3a739857040 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858520:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858526:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858531:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858535:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760642.858544:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858549:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858556:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:1.0:1789760642.858558:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789760642.858560:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760642.858566:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857094 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760642.871586:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.871857:0:8119:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789760642.871867:0:8119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789760642.872280:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777111168 00000100:00100000:1.0:1789760642.872289:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777111168 00002000:00100000:1.0:1789760642.872335:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x2:0x0] (1048576->2097151) req@ffff97e57f763480 x1876699777111168/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:688/0 lens 488/0 e 0 to 0 dl 1789760653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760642.872346:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f763480 with x1876699777111168 ext(1048576->2097151) 00002000:00010000:1.0:1789760642.872352:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f763480 00000100:00100000:1.0:1789760642.872369:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319206971397 time 319006971397 state 0x1 ref 2 00000100:00100000:0.0:1789760642.898860:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+15:2405:x1876699777111040:12345-192.168.203.38@tcp:4:dd.500 Request processed in 76065us (76285us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789760642.898880:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 2 00002000:00100000:0.0:1789760642.898893:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (0->1048575) req@ffff97e5433dd880 x1876699777111040/t4294967307(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:688/0 lens 488/448 e 0 to 0 dl 1789760653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760642.898904:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5433dd880 with x1876699777111040 ext(0->1048575) 00002000:00010000:0.0:1789760642.898916:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5433dd880 00000100:00100000:0.0:1789760642.914600:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760642.914709:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777111296 00000100:00100000:1.0:1789760642.914720:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777111296 00002000:00100000:1.0:1789760642.914773:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x2:0x0] (2097152->3145727) req@ffff97e57f763b80 x1876699777111296/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:688/0 lens 488/0 e 0 to 0 dl 1789760653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760642.914817:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f763b80 with x1876699777111296 ext(2097152->3145727) 00002000:00010000:1.0:1789760642.914825:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f763b80 00000100:00100000:1.0:1789760642.914849:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319206971397 time 319006971397 state 0x1 ref 2 00000100:00100000:3.0:1789760642.996415:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760642.996533:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777111424 00000100:00100000:2.0:1789760642.996543:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777111424 00002000:00100000:2.0:1789760642.996592:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x2:0x0] (3145728->4194303) req@ffff97e57f6d6680 x1876699777111424/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:688/0 lens 488/0 e 0 to 0 dl 1789760653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760642.996603:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f6d6680 with x1876699777111424 ext(3145728->4194303) 00002000:00010000:2.0:1789760642.996608:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f6d6680 00000100:00100000:2.0:1789760642.996624:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319206971397 time 319006971397 state 0x1 ref 3 00000100:00100000:1.0:1789760643.025206:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319409402896 time 319209402896 state 0x1 ref 3 00000100:00100000:1.0:1789760643.025244:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+16:2404:x1876699777111168:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:3.0:1789760643.046478:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760643.049830:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777111552 00000100:00100000:1.0:1789760643.049856:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777111552 00002000:00100000:1.0:1789760643.049911:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->1048575) req@ffff97e57f6d5180 x1876699777111552/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760643.049924:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f6d5180 with x1876699777111552 ext(0->1048575) 00002000:00010000:1.0:1789760643.049930:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f6d5180 00000100:00100000:1.0:1789760643.049959:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319409402896 time 319209402896 state 0x1 ref 4 00000100:00100000:1.0:1789760643.081427:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760643.081527:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777111680 00000100:00100000:0.0:1789760643.081557:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777111680 00002000:00100000:0.0:1789760643.081606:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (1048576->2097151) req@ffff97e5433dce00 x1876699777111680/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760643.081617:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5433dce00 with x1876699777111680 ext(1048576->2097151) 00002000:00010000:0.0:1789760643.081623:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5433dce00 00000100:00100000:0.0:1789760643.081638:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319409402896 time 319209402896 state 0x1 ref 5 00000100:00100000:2.0:1789760643.082532:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2404:x1876699777111168:12345-192.168.203.38@tcp:4:dd.500 Request processed in 57302us (210951us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789760643.082541:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 3 00002000:00100000:2.0:1789760643.082575:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x2:0x0] (1048576->2097151) req@ffff97e57f763480 x1876699777111168/t4294967308(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:688/0 lens 488/448 e 0 to 0 dl 1789760653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760643.082586:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f763480 with x1876699777111168 ext(1048576->2097151) 00002000:00010000:2.0:1789760643.082590:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f763480 00000100:00100000:2.0:1789760643.226158:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319610360082 time 319410360082 state 0x1 ref 4 00000100:00100000:2.0:1789760643.226185:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+17:2403:x1876699777111296:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760643.256027:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+19:2403:x1876699777111296:12345-192.168.203.38@tcp:4:dd.500 Request processed in 29838us (341422us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789760643.256044:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 4 00002000:00100000:2.0:1789760643.256060:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x2:0x0] (2097152->3145727) req@ffff97e57f763b80 x1876699777111296/t4294967309(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:688/0 lens 488/448 e 0 to 0 dl 1789760653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760643.256071:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f763b80 with x1876699777111296 ext(2097152->3145727) 00002000:00010000:2.0:1789760643.256079:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f763b80 00000100:00100000:3.0:1789760643.271161:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798160512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760643.271267:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760643.271463:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798160512 00000100:00100000:0.0:1789760643.271475:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798160512 00000100:00100000:0.0:1789760643.271558:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789760643.271570:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798160512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760643.271621:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760643.276633:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798160512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5048us (5349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760643.276653:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789760643.279048:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5433dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798160512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760643.426382:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 319810577156 time 319610577156 state 0x1 ref 3 00000100:00100000:0.0:1789760643.426428:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2406:x1876699777111424:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760643.447923:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+20:2406:x1876699777111424:12345-192.168.203.38@tcp:4:dd.500 Request processed in 21504us (451503us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789760643.447943:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 5 00002000:00100000:0.0:1789760643.447961:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (3145728->4194303) req@ffff97e57f6d6680 x1876699777111424/t4294967310(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:688/0 lens 488/448 e 0 to 0 dl 1789760653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760643.447974:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f6d6680 with x1876699777111424 ext(3145728->4194303) 00002000:00010000:0.0:1789760643.447981:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f6d6680 00010000:00010000:1.0:1789760643.591039:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760643.626579:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320010775136 time 319810775136 state 0x1 ref 2 00000100:00100000:1.0:1789760643.626626:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2405:x1876699777111552:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760643.673766:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2405:x1876699777111552:12345-192.168.203.38@tcp:4:dd.500 Request processed in 47150us (627283us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789760643.673800:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 6 00002000:00100000:2.0:1789760643.673819:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->1048575) req@ffff97e57f6d5180 x1876699777111552/t4294967305(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760643.673841:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f6d5180 with x1876699777111552 ext(0->1048575) 00002000:00010000:2.0:1789760643.673849:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f6d5180 00000100:00100000:0.0:1789760643.689990:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760643.691499:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777111808 00000100:00100000:2.0:1789760643.691516:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777111808 00002000:00100000:2.0:1789760643.691593:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (2097152->3145727) req@ffff97e44974aa00 x1876699777111808/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760643.691626:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44974aa00 with x1876699777111808 ext(2097152->3145727) 00002000:00010000:2.0:1789760643.691633:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44974aa00 00000100:00100000:2.0:1789760643.691655:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320010775136 time 319810775136 state 0x1 ref 2 00000100:00100000:1.0:1789760643.729494:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760643.729608:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777111936 00000100:00100000:0.0:1789760643.729618:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777111936 00002000:00100000:0.0:1789760643.729666:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (3145728->4194303) req@ffff97e5433dc380 x1876699777111936/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760643.729678:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5433dc380 with x1876699777111936 ext(3145728->4194303) 00002000:00010000:0.0:1789760643.729684:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5433dc380 00000100:00100000:0.0:1789760643.729700:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320010775136 time 319810775136 state 0x1 ref 3 00000100:00100000:3.0:1789760643.750537:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760643.750676:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777112064 00000100:00100000:2.0:1789760643.750685:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777112064 00002000:00100000:2.0:1789760643.750735:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x2:0x0] (4194304->5242879) req@ffff97e57f6d7800 x1876699777112064/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760643.750745:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f6d7800 with x1876699777112064 ext(4194304->5242879) 00002000:00010000:2.0:1789760643.750751:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f6d7800 00000100:00100000:2.0:1789760643.750767:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320010775136 time 319810775136 state 0x1 ref 4 00000100:00100000:0.0:1789760643.765194:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760643.765377:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777112192 00000100:00100000:3.0:1789760643.765387:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777112192 00002000:00100000:3.0:1789760643.765435:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (5242880->6291455) req@ffff97e57f877800 x1876699777112192/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760643.765446:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f877800 with x1876699777112192 ext(5242880->6291455) 00002000:00010000:3.0:1789760643.765453:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f877800 00000100:00100000:3.0:1789760643.765469:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320010775136 time 319810775136 state 0x1 ref 5 00000100:00100000:0.0:1789760643.786426:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760643.786451:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798160640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760643.786522:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760643.786817:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798160640 00000100:00100000:3.0:1789760643.786827:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798160640 00000100:00100000:3.0:1789760643.787089:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789760643.787101:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798160640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760643.787140:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760643.787264:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798160640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760643.787272:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789760643.787361:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798160640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760643.794158:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760643.801562:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777112320 00000100:00100000:2.0:1789760643.801692:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777112320 00002000:00100000:2.0:1789760643.801758:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x2:0x0] (6291456->7340031) req@ffff97e57f032680 x1876699777112320/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760643.801769:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f032680 with x1876699777112320 ext(6291456->7340031) 00002000:00010000:2.0:1789760643.801775:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f032680 00000100:00100000:2.0:1789760643.801947:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320010775136 time 319810775136 state 0x1 ref 6 00000100:00100000:3.0:1789760643.816211:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760643.816781:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777112448 00000100:00100000:0.0:1789760643.817613:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777112448 00002000:00100000:0.0:1789760643.817670:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (7340032->8388607) req@ffff97e57f6d6d80 x1876699777112448/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760643.817682:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f6d6d80 with x1876699777112448 ext(7340032->8388607) 00002000:00010000:0.0:1789760643.817688:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f6d6d80 00000100:00100000:0.0:1789760643.817703:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320010775136 time 319810775136 state 0x1 ref 7 00000100:00100000:0.0:1789760643.832383:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320216582248 time 320016582248 state 0x1 ref 7 00000100:00100000:0.0:1789760643.832417:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+15:2404:x1876699777111680:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760643.859814:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+17:2404:x1876699777111680:12345-192.168.203.38@tcp:4:dd.500 Request processed in 27384us (778368us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789760643.859845:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 7 00002000:00100000:0.0:1789760643.859866:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (1048576->2097151) req@ffff97e5433dce00 x1876699777111680/t4294967306(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760643.859879:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5433dce00 with x1876699777111680 ext(1048576->2097151) 00002000:00010000:0.0:1789760643.859887:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5433dce00 00000100:00100000:0.0:1789760643.872929:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760643.873453:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777112576 00000100:00100000:2.0:1789760643.873466:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777112576 00002000:00100000:2.0:1789760643.873550:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (4194304->5242879) req@ffff97e57f876a00 x1876699777112576/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760643.873564:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f876a00 with x1876699777112576 ext(4194304->5242879) 00002000:00010000:2.0:1789760643.873590:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f876a00 00000100:00100000:2.0:1789760643.873612:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320216582248 time 320016582248 state 0x1 ref 7 00000100:00100000:1.0:1789760643.919449:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760643.919622:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777112704 00000100:00100000:0.0:1789760643.919635:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777112704 00002000:00100000:0.0:1789760643.919703:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (5242880->6291455) req@ffff97e57f030000 x1876699777112704/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1789760654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760643.919718:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f030000 with x1876699777112704 ext(5242880->6291455) 00002000:00010000:0.0:1789760643.919744:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f030000 00000100:00100000:0.0:1789760643.919765:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320216582248 time 320016582248 state 0x1 ref 8 00000100:00100000:2.0:1789760644.032686:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320416878843 time 320216878843 state 0x1 ref 8 00000100:00100000:2.0:1789760644.032765:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44974aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2406:x1876699777111808:12345-192.168.203.38@tcp:4:dd.500 00000100:00080000:0.0:1789760644.033304:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760644.059729:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44974aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+20:2406:x1876699777111808:12345-192.168.203.38@tcp:4:dd.500 Request processed in 27008us (369739us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789760644.059745:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 8 00002000:00100000:2.0:1789760644.060296:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (2097152->3145727) req@ffff97e44974aa00 x1876699777111808/t4294967307(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760644.060317:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44974aa00 with x1876699777111808 ext(2097152->3145727) 00002000:00010000:2.0:1789760644.060325:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44974aa00 00000100:00100000:1.0:1789760644.072656:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.079436:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777112832 00000100:00100000:2.0:1789760644.079460:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777112832 00002000:00100000:2.0:1789760644.079556:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (6291456->7340031) req@ffff97e57f032300 x1876699777112832/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760644.079571:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f032300 with x1876699777112832 ext(6291456->7340031) 00002000:00010000:2.0:1789760644.079579:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f032300 00000100:00100000:2.0:1789760644.079601:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320416878843 time 320216878843 state 0x1 ref 8 00000100:00100000:1.0:1789760644.087348:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760644.087404:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.087511:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777113216 00000100:00100000:3.0:1789760644.087523:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777113216 00000100:00100000:3.0:1789760644.087619:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1789760644.087632:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11390:x1876699777113216:12345-192.168.203.38@tcp:35:dd.500 00000001:00080000:3.0:1789760644.088168:0:6469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000100:00100000:3.0:1789760644.088310:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11390:x1876699777113216:12345-192.168.203.38@tcp:35:dd.500 Request processed in 679us (902us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789760644.088319:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000020:00080000:3.0:1789760644.088325:0:6469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789760644.089291:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760644.089581:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777112960 00000100:00100000:2.0:1789760644.089593:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777112960 00002000:00100000:2.0:1789760644.089650:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (7340032->8388607) req@ffff97e57f030380 x1876699777112960/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760644.089664:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f030380 with x1876699777112960 ext(7340032->8388607) 00002000:00010000:2.0:1789760644.089689:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f030380 00000100:00100000:2.0:1789760644.089708:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320416878843 time 320216878843 state 0x1 ref 9 00000100:00100000:1.0:1789760644.183466:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.184686:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777113472 00000100:00100000:2.0:1789760644.184701:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777113472 00000100:00100000:2.0:1789760644.184823:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:2.0:1789760644.184845:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11402:x1876699777113472:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760644.184886:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760644.184912:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857104 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211902 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185330:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185346:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185361:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185378:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185385:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185391:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185569:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857119 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185589:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857119 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185598:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857119 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760644.185610:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 0 00010000:00010000:2.0:1789760644.185726:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185734:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185741:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185747:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760644.185752:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185761:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185775:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:2.0:1789760644.185779:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760644.185784:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185822:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a73985710b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185848:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185862:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185868:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185874:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760644.185877:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185883:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185892:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x151ecd9f (ffff97e5820eee00) 00010000:00010000:2.0:1789760644.185894:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760644.185897:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185902:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857112 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185976:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857104 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211902 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.185993:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857119 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211902 expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.186001:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:2.0:1789760644.186004:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760644.186020:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01a00, rc 0) 00000100:00100000:2.0:1789760644.186123:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11402:x1876699777113472:12345-192.168.203.38@tcp:101:dd.0 Request processed in 1280us (2672us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789760644.186132:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:3.0:1789760644.222739:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.222905:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.225832:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777113600 00000100:00100000:0.0:1789760644.225858:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777113600 00000100:00100000:0.0:1789760644.225946:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777113728 00000100:00100000:0.0:1789760644.225950:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777113728 00000100:00100000:0.0:1789760644.225992:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1789760644.226005:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11403:x1876699777113600:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760644.226033:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760644.226072:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211909 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.226115:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 24 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.226126:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789760644.226131:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760644.226137:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 24 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.226190:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 24 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.226206:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 24 pid: 8112 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760644.226246:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8110:1876699798160768:192.168.203.38@tcp:104: 00000100:00100000:0.0:1789760644.226382:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760644.226727:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1789760644.226740:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11410:x1876699777113728:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760644.226749:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760644.226760:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211910 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.226777:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760644.226781:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760644.226814:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 25 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.226839:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 25 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.226870:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f000, rc 0) 00000100:00100000:1.0:1789760644.226927:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11410:x1876699777113728:12345-192.168.203.38@tcp:101:dd.0 Request processed in 190us (4020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760644.226934:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1789760644.229554:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.229627:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.229664:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777113856 00000100:00100000:3.0:1789760644.229677:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777113856 00000100:00100000:3.0:1789760644.229743:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777113984 00000100:00100000:3.0:1789760644.229747:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777113984 00000100:00100000:3.0:1789760644.229769:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1789760644.229785:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11407:x1876699777113856:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760644.229863:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760644.229888:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb1bc04f/0xc2b9a3a739857135 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211917 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760644.229892:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789760644.229937:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 26 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.229949:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789760644.229954:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760644.229960:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1bc04f/0xc2b9a3a739857135 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211917 expref: 26 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.230010:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 26 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.230026:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 26 pid: 8110 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760644.230047:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543287800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8112:1876699798160896:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760644.230170:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f0599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760644.232871:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320617070864 time 320417070864 state 0x1 ref 9 00000100:00100000:2.0:1789760644.232905:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+24:2405:x1876699777111936:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:3.0:1789760644.237067:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.237126:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.237151:0:8114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789760644.237160:0:8114:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789760644.237281:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777114240 00000100:00100000:3.0:1789760644.237290:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777114240 00000100:00100000:3.0:1789760644.237416:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1789760644.237427:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+26:11405:x1876699777113984:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760644.237444:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760644.237462:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dbca594/0xc2b9a3a73985713c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521191e expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.237491:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760644.237495:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760644.237514:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dbca594/0xc2b9a3a73985713c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521191e expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.237528:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009dbca594/0xc2b9a3a73985713c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521191e expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.237541:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e200, rc 0) 00000100:00100000:3.0:1789760644.237599:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11405:x1876699777113984:12345-192.168.203.38@tcp:101:dd.0 Request processed in 173us (7971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.237606:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1789760644.238009:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:3.0:1789760644.238018:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11402:x1876699777114240:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760644.238027:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760644.238038:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a739857143 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211925 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.238055:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760644.238058:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760644.238070:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a739857143 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211925 expref: 26 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.238080:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a739857143 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211925 expref: 26 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.238091:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8e400, rc 0) 00000100:00100000:3.0:1789760644.238173:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+26:11402:x1876699777114240:12345-192.168.203.38@tcp:101:dd.0 Request processed in 156us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.238180:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1789760644.238299:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8110:1876699798160768:192.168.203.38@tcp:104: 00010000:00010000:0.0:1789760644.238324:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 25 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.238335:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5800, rc 0) 00000100:00100000:0.0:1789760644.238359:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11403:x1876699777113600:12345-192.168.203.38@tcp:101:dd.0 Request processed in 12357us (15637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760644.238365:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1789760644.238538:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777114112 00000100:00100000:2.0:1789760644.238544:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777114112 00010000:00010000:2.0:1789760644.238729:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 25 pid: 8112 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.238765:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1789760644.238773:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+25:2406:x1876699777114112:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760644.238783:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760644.238850:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 25 pid: 8112 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.238864:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 25 pid: 8112 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.238890:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64d5dcb/0xc2b9a3a7398570b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118df expref: 25 pid: 8112 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.238902:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.238906:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.238922:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 24 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.238932:0:6450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 24 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.238940:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.238943:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.238948:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.238957:0:6450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.238964:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.238967:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.238972:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a739857143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211925 expref: 24 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.238981:0:6450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a739857143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211925 expref: 24 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.239011:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a739857143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211925 expref: 24 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.239024:0:6450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798161024:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.239099:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 24 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.239122:0:6450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798161152:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.239151:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 24 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.239161:0:6450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798161280:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760644.239182:0:6450:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760644.246763:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.246836:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.246918:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543287800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8112:1876699798160896:192.168.203.38@tcp:104: 00010000:00010000:0.0:1789760644.246953:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb1bc04f/0xc2b9a3a739857135 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211917 expref: 26 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.246974:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8ec00, rc 0) 00000100:00100000:0.0:1789760644.247028:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+26:11407:x1876699777113856:12345-192.168.203.38@tcp:101:dd.0 Request processed in 17249us (17491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760644.247036:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:0.0:1789760644.247065:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777114368 00000100:00100000:0.0:1789760644.247072:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777114368 00000100:00100000:0.0:1789760644.247316:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777114624 00000100:00100000:0.0:1789760644.247321:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777114624 00000100:00100000:0.0:1789760644.247345:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1789760644.247354:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11404:x1876699777114368:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760644.247369:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760644.247387:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a73985714a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521192c expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.247413:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 26 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.247421:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760644.247426:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789760644.247430:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a73985714a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521192c expref: 26 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.247936:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1789760644.247948:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+26:11408:x1876699777114624:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760644.247957:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760644.247967:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082c154ac/0xc2b9a3a739857151 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521193a expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.247982:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.247986:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.247991:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082c154ac/0xc2b9a3a739857151 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521193a expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.248002:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082c154ac/0xc2b9a3a739857151 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521193a expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.248012:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01200, rc 0) 00000100:00100000:2.0:1789760644.248040:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11408:x1876699777114624:12345-192.168.203.38@tcp:101:dd.0 Request processed in 97us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760644.248056:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1789760644.248207:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.249025:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.249970:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777114496 00000100:00100000:3.0:1789760644.249980:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777114496 00000100:00100000:3.0:1789760644.250031:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:3.0:1789760644.250039:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11406:x1876699777114496:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760644.250055:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760644.250071:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ae81401/0xc2b9a3a739857158 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211933 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.250097:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760644.250102:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760644.250442:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ae81401/0xc2b9a3a739857158 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211933 expref: 28 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.250457:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ae81401/0xc2b9a3a739857158 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211933 expref: 28 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.250470:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e441f8fa00, rc 0) 00000100:00100000:2.0:1789760644.250889:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777114752 00000100:00100000:2.0:1789760644.250895:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777114752 00010000:00010000:2.0:1789760644.250919:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 29 pid: 8110 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.250946:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1789760644.250953:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2405:x1876699777114752:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760644.250963:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760644.250984:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 29 pid: 8110 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.250997:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 29 pid: 8110 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760644.251351:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11406:x1876699777114496:12345-192.168.203.38@tcp:101:dd.0 Request processed in 1311us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.251359:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00010000:00010000:0.0:1789760644.251737:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 26 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760644.251752:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 26 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760644.251767:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8112:1876699798161408:192.168.203.38@tcp:104: 00000100:00100000:0.0:1789760644.252421:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633180 going to sleep for 11 seconds 00010000:00010000:2.0:1789760644.252710:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cd0e154/0xc2b9a3a7398570be lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118e6 expref: 28 pid: 8110 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.252727:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.252732:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.252740:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb1bc04f/0xc2b9a3a739857135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211917 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.252762:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1bc04f/0xc2b9a3a739857135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211917 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.252772:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.252775:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.252781:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009dbca594/0xc2b9a3a73985713c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521191e expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.253299:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dbca594/0xc2b9a3a73985713c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521191e expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.253309:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.253312:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.253318:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082c154ac/0xc2b9a3a739857151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521193a expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.253325:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082c154ac/0xc2b9a3a739857151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521193a expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.253332:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.253335:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760644.253340:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ae81401/0xc2b9a3a739857158 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211933 expref: 27 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.253348:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ae81401/0xc2b9a3a739857158 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211933 expref: 27 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.253391:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ae81401/0xc2b9a3a739857158 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211933 expref: 27 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.253403:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac16a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798161536:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.253469:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000082c154ac/0xc2b9a3a739857151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521193a expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.253480:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798161664:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.253520:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009dbca594/0xc2b9a3a73985713c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521191e expref: 27 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.253531:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798161792:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.256733:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb1bc04f/0xc2b9a3a739857135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211917 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.256763:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798161920:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760644.257478:0:6452:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760644.257607:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760644.257732:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777114880 00000100:00100000:1.0:1789760644.257744:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777114880 00000100:00100000:2.0:1789760644.257935:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1789760644.257946:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11412:x1876699777114880:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760644.257963:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760644.257979:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985715f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211941 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.258028:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.258038:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789760644.258043:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789760644.258048:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985715f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211941 expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.258091:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.258103:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 29 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.258115:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8110:1876699798162048:192.168.203.38@tcp:104: 00000100:00100000:2.0:1789760644.258175:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760644.259345:0:6450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798161024:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760644.282392:0:6450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798161152:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760644.282407:0:6450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798161280:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.282433:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760644.282439:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8112:1876699798161408:192.168.203.38@tcp:104: 00010000:00010000:0.0:1789760644.282468:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a73985714a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521192c expref: 29 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.282493:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2406:x1876699777114112:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 43720us (45434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760644.282508:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00010000:00010000:0.0:1789760644.282519:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5a00, rc 0) 00000100:00100000:0.0:1789760644.282552:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11404:x1876699777114368:12345-192.168.203.38@tcp:101:dd.0 Request processed in 35198us (35797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.283057:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac16a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798161536:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760644.283069:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798161664:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760644.283077:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798161792:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760644.283156:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:2.0:1789760644.286079:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8110:1876699798162048:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760644.286125:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985715f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211941 expref: 27 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.286146:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01800, rc 0) 00000100:00100000:2.0:1789760644.286192:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11412:x1876699777114880:12345-192.168.203.38@tcp:101:dd.0 Request processed in 28248us (28585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760644.286201:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1789760644.286732:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2405:x1876699777111936:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53842us (557244us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789760644.286742:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 9 00002000:00100000:2.0:1789760644.286752:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (3145728->4194303) req@ffff97e5433dc380 x1876699777111936/t4294967308(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760644.286762:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5433dc380 with x1876699777111936 ext(3145728->4194303) 00002000:00010000:2.0:1789760644.286767:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5433dc380 00000100:00100000:1.0:1789760644.286908:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798161920:192.168.203.38@tcp:105: 00010000:00010000:1.0:1789760644.286924:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760644.286941:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2405:x1876699777114752:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 35990us (38736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760644.286948:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1789760644.295941:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760644.295961:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798162176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760644.295974:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798162304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760644.296069:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760644.296170:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798162304 00000100:00100000:0.0:1789760644.296187:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798162304 00000100:00100000:0.0:1789760644.296284:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789760644.296292:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798162304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789760644.296310:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 57737216 pending 6815744 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760644.296348:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798162304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760644.296354:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789760644.296515:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798162304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789760644.296554:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760644.296956:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760644.296987:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798162176 00000100:00100000:0.0:1789760644.296991:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798162176 00000100:00100000:0.0:1789760644.297048:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789760644.297053:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798162176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760644.297062:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 57737216 pending 6815744 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760644.297093:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798162176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760644.297097:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1789760644.297127:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760644.297191:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798162176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760644.329501:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.329541:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760644.329653:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777115008 00000100:00100000:1.0:1789760644.329663:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777115008 00000100:00100000:1.0:1789760644.329719:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777115136 00000100:00100000:1.0:1789760644.329723:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777115136 00000100:00100000:1.0:1789760644.329754:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:1.0:1789760644.329764:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11409:x1876699777115008:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760644.329782:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760644.329846:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857166 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211948 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.329880:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789760644.329886:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1789760644.329892:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857166 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211948 expref: 29 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.329917:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857166 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211948 expref: 29 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.329931:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f800, rc 0) 00000100:00100000:1.0:1789760644.329981:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11409:x1876699777115008:12345-192.168.203.38@tcp:101:dd.0 Request processed in 218us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760644.330166:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:1.0:1789760644.330186:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:1.0:1789760644.330193:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11411:x1876699777115136:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760644.330200:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760644.330208:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a73985716d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521194f expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.330221:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1789760644.330225:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1789760644.330230:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a73985716d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521194f expref: 29 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.330239:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a73985716d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521194f expref: 29 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.330248:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f200, rc 0) 00000100:00100000:1.0:1789760644.330270:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11411:x1876699777115136:12345-192.168.203.38@tcp:101:dd.0 Request processed in 77us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760644.330286:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:0.0:1789760644.341902:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.341942:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.342080:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777115264 00000100:00100000:3.0:1789760644.342090:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777115264 00002000:00100000:3.0:1789760644.342145:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (5242880->6291455) req@ffff97e57f05f480 x1876699777115264/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760644.342156:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f05f480 with x1876699777115264 ext(5242880->6291455) 00010000:00010000:3.0:1789760644.342165:0:8120:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 29 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.342180:0:8120:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 29 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760644.342188:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97e57f05f480 00000100:00100000:3.0:1789760644.342207:0:8120:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 320526415102 state 0x0 ref 1 00000100:00100000:3.0:1789760644.342218:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 3 deadline 320526515102 time 320526415102 state 0x1 ref 1 00000100:00100000:3.0:1789760644.342258:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777115392 00000100:00100000:3.0:1789760644.342262:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777115392 00002000:00100000:3.0:1789760644.342278:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (1048576->2097151) req@ffff97e57f05f100 x1876699777115392/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760644.342286:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f05f100 with x1876699777115392 ext(1048576->2097151) 00002000:00010000:3.0:1789760644.342291:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f05f100 00000100:00100000:3.0:1789760644.342302:0:8120:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 3 deadline 0 time 320526511978 state 0x0 ref 1 00000100:00100000:3.0:1789760644.342315:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 3 deadline 320526611978 time 320526511978 state 0x1 ref 1 00000100:00100000:3.0:1789760644.342340:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 2 deadline 320526515102 time 320526550005 state 0x0 ref 1 00000100:00100000:3.0:1789760644.342351:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2406:x1876699777115264:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:1.0:1789760644.343742:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320526611978 time 320527946543 state 0x0 ref 1 00000100:00100000:1.0:1789760644.343763:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+31:2406:x1876699777115392:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760644.345527:0:13385:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789760644.345541:0:13385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789760644.346431:0:8118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789760644.350144:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.350274:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777115520 00000100:00100000:0.0:1789760644.350283:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777115520 00002000:00100000:0.0:1789760644.350343:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x3:0x0] (0->1048575) req@ffff97e543574000 x1876699777115520/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.350355:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e543574000 with x1876699777115520 ext(0->1048575) 00002000:00010000:0.0:1789760644.350361:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e543574000 00000100:00100000:0.0:1789760644.350410:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320528046543 time 320527946543 state 0x1 ref 2 00000100:00100000:0.0:1789760644.350439:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320528046543 time 320534648393 state 0x0 ref 2 00000100:00100000:0.0:1789760644.350450:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2404:x1876699777115520:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760644.351208:0:13388:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789760644.351220:0:13388:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1789760644.351457:0:13385:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789760644.374195:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.374297:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777115648 00000100:00100000:2.0:1789760644.374329:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777115648 00000100:00100000:2.0:1789760644.374434:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1789760644.374445:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+33:11401:x1876699777115648:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760644.374464:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760644.374493:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857174 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211956 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.374520:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.374525:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.374534:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857174 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211956 expref: 34 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.374549:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857174 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211956 expref: 34 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.374572:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01000, rc 0) 00000100:00100000:2.0:1789760644.374638:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+34:11401:x1876699777115648:12345-192.168.203.38@tcp:101:dd.0 Request processed in 195us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760644.374645:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:1.0:1789760644.392323:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2406:x1876699777115264:12345-192.168.203.38@tcp:4:dd.0 Request processed in 49962us (50418us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789760644.392339:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1789760644.392347:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 2 deadline 320526515102 time 320526550005 state 0x2 ref 0 00002000:00100000:1.0:1789760644.392365:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (5242880->6291455) req@ffff97e57f05f480 x1876699777115264/t4294967309(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760644.392375:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f05f480 with x1876699777115264 ext(5242880->6291455) 00010000:00010000:1.0:1789760644.392387:0:8120:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 34 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760644.392401:0:8120:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 34 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760644.392408:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97e57f05f480 00000100:00100000:3.0:1789760644.400808:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.400852:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.400923:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.400975:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777115904 00000100:00100000:3.0:1789760644.400985:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777115904 00010000:00010000:3.0:1789760644.401021:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 34 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760644.401056:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1789760644.401066:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2406:x1876699777115904:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760644.401080:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789760644.401118:0:9898:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 6291456 00002000:00010000:3.0:1789760644.401121:0:9898:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789760641 -> 1789760643 00002000:00010000:3.0:1789760644.401124:0:9898:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789760642 -> 1789760643 00010000:00010000:3.0:1789760644.401131:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 10 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 34 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.401143:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 10 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 34 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.401166:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985712e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 10 type: EXT [5242880->18446744073709551615] (req 5242880->6291455) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211910 expref: 34 pid: 9533 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.401183:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760644.401235:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+33:2406:x1876699777115904:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 170us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.401243:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1789760644.401270:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777115776 00000100:00100000:3.0:1789760644.401274:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777115776 00002000:00100000:3.0:1789760644.401300:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x3:0x0] (3145728->4194303) req@ffff97e57f921180 x1876699777115776/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760644.401818:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f921180 with x1876699777115776 ext(3145728->4194303) 00002000:00010000:3.0:1789760644.401833:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f921180 00000100:00100000:3.0:1789760644.401870:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320534748393 time 320534648393 state 0x1 ref 3 00000100:00100000:3.0:1789760644.401886:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777116032 00000100:00100000:3.0:1789760644.401890:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777116032 00002000:00100000:3.0:1789760644.401909:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3:0x0] (2097152->3145727) req@ffff97e57f920700 x1876699777116032/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760644.401926:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f920700 with x1876699777116032 ext(2097152->3145727) 00010000:00010000:3.0:1789760644.401932:0:13388:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 33 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760644.401945:0:13388:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 33 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760644.401952:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97e57f920700 00000100:00100000:3.0:1789760644.401959:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 2 deadline 320526515102 time 320526550005 state 0x0 ref 1 00000100:00100000:3.0:1789760644.401967:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 2 deadline 320526650005 time 320526550005 state 0x1 ref 1 00000100:00100000:3.0:1789760644.401979:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 2 deadline 320526650005 time 320586189115 state 0x0 ref 1 00000100:00100000:3.0:1789760644.401989:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+33:2403:x1876699777116032:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760644.403055:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320534748393 time 320587260536 state 0x0 ref 3 00000100:00100000:3.0:1789760644.403078:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2404:x1876699777115776:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:1.0:1789760644.404221:0:13385:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1789760644.404235:0:13385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:1.0:1789760644.404376:0:8120:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:2.0:1789760644.418224:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+35:2406:x1876699777115392:12345-192.168.203.38@tcp:4:dd.0 Request processed in 74459us (76272us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789760644.418238:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 18 00002000:00100000:2.0:1789760644.418254:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (1048576->2097151) req@ffff97e57f05f100 x1876699777115392/t4294967310(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.418264:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f05f100 with x1876699777115392 ext(1048576->2097151) 00002000:00010000:2.0:1789760644.418269:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f05f100 00000100:00100000:2.0:1789760644.433929:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 320818129125 time 320618129125 state 0x1 ref 8 00000100:00100000:2.0:1789760644.433954:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2406:x1876699777112064:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:3.0:1789760644.445492:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.445654:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777116160 00000100:00100000:2.0:1789760644.445664:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777116160 00002000:00100000:2.0:1789760644.445707:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3:0x0] (0->1048575) req@ffff97e57f922680 x1876699777116160/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.445718:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f922680 with x1876699777116160 ext(0->1048575) 00002000:00010000:2.0:1789760644.445723:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f922680 00000100:00100000:2.0:1789760644.445741:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320587360536 time 320587260536 state 0x1 ref 3 00000100:00100000:2.0:1789760644.445773:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320587360536 time 320629982180 state 0x0 ref 3 00000100:00100000:2.0:1789760644.445806:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+35:2405:x1876699777116160:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760644.446998:0:13390:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:3.0:1789760644.447009:0:13390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_007' 00000100:00100000:2.0:1789760644.460534:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+37:2403:x1876699777116032:12345-192.168.203.38@tcp:4:dd.0 Request processed in 58535us (59600us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789760644.460555:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1789760644.460563:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 2 deadline 320526650005 time 320586189115 state 0x2 ref 0 00002000:00100000:2.0:1789760644.460578:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3:0x0] (2097152->3145727) req@ffff97e57f920700 x1876699777116032/t4294967311(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.460588:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f920700 with x1876699777116032 ext(2097152->3145727) 00010000:00010000:2.0:1789760644.460598:0:13388:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 37 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.460615:0:13388:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 37 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760644.462103:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+32:2404:x1876699777115520:12345-192.168.203.38@tcp:4:dd.0 Request processed in 111646us (111957us total) trans 4294967311 rc 0/0 00002000:00010000:2.0:1789760644.464436:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97e57f920700 00000100:00100000:1.0:1789760644.465052:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 19 00002000:00100000:1.0:1789760644.465068:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x3:0x0] (0->1048575) req@ffff97e543574000 x1876699777115520/t4294967311(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760644.465078:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e543574000 with x1876699777115520 ext(0->1048575) 00002000:00010000:1.0:1789760644.465085:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e543574000 00000100:00100000:3.0:1789760644.469125:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.470522:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777116288 00000100:00100000:2.0:1789760644.470534:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777116288 00010000:00010000:2.0:1789760644.470584:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 37 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.470640:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1789760644.470650:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+37:2406:x1876699777116288:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760644.470664:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760644.470685:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 37 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470699:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 37 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470722:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066df966c/0xc2b9a3a739857127 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 9 type: EXT [2097152->5242879] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211909 expref: 37 pid: 8110 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470750:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.470761:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.470770:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a73985714a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521192c expref: 36 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470781:0:6450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a73985714a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521192c expref: 36 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470859:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.470862:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.470868:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985715f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211941 expref: 36 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470876:0:6450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985715f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211941 expref: 36 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470882:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.470884:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.470889:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [4194304->6291455] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211948 expref: 36 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470896:0:6450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [4194304->6291455] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211948 expref: 36 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470902:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.470904:0:6450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760644.470908:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a73985716d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521194f expref: 36 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470915:0:6450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a73985716d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521194f expref: 36 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760644.470952:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a73985716d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521194f expref: 36 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.470972:0:6450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798162432:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.471075:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [4194304->6291455] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211948 expref: 36 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.471084:0:6450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798162560:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.471115:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985715f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211941 expref: 36 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.471123:0:6450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798162688:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.471148:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a73985714a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521192c expref: 36 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760644.471155:0:6450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798162816:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760644.471686:0:6450:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760644.479632:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+32:2404:x1876699777115776:12345-192.168.203.38@tcp:4:dd.0 Request processed in 76552us (78836us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789760644.479647:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 20 00002000:00100000:2.0:1789760644.479662:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x3:0x0] (3145728->4194303) req@ffff97e57f921180 x1876699777115776/t4294967312(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.479672:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f921180 with x1876699777115776 ext(3145728->4194303) 00002000:00010000:2.0:1789760644.479678:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f921180 00000100:00100000:0.0:1789760644.482077:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.482121:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.482146:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777116544 00000100:00100000:0.0:1789760644.482156:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777116544 00002000:00100000:0.0:1789760644.482213:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x3:0x0] (2097152->3145727) req@ffff97e57f05d180 x1876699777116544/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.482225:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f05d180 with x1876699777116544 ext(2097152->3145727) 00002000:00010000:0.0:1789760644.482230:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f05d180 00000100:00100000:0.0:1789760644.482265:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320630082180 time 320629982180 state 0x1 ref 2 00000100:00100000:0.0:1789760644.482282:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777116416 00000100:00100000:0.0:1789760644.482296:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777116416 00002000:00100000:0.0:1789760644.482313:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x3:0x0] (1048576->2097151) req@ffff97e57f05c000 x1876699777116416/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.482322:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f05c000 with x1876699777116416 ext(1048576->2097151) 00002000:00010000:0.0:1789760644.482326:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f05c000 00000100:00100000:0.0:1789760644.482331:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320630082180 time 320629982180 state 0x1 ref 3 00000100:00100000:0.0:1789760644.482366:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320666674653 time 320666574653 state 0x1 ref 3 00000100:00100000:0.0:1789760644.482379:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+33:2406:x1876699777116544:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760644.482464:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 1 deadline 320666674653 time 320666672841 state 0x0 ref 3 00000100:00100000:0.0:1789760644.482474:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+33:2406:x1876699777116416:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760644.514685:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2406:x1876699777112064:12345-192.168.203.38@tcp:4:dd.500 Request processed in 80522us (763940us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789760644.514702:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 10 00002000:00100000:3.0:1789760644.514733:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (4194304->5242879) req@ffff97e57f6d7800 x1876699777112064/t4294967313(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760644.514758:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f6d7800 with x1876699777112064 ext(4194304->5242879) 00002000:00010000:3.0:1789760644.514765:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f6d7800 00000100:00100000:2.0:1789760644.515014:0:6450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798162432:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760644.515041:0:6450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798162560:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760644.515051:0:6450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798162688:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760644.515060:0:6450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6450:1876699798162816:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760644.515088:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760644.515119:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2406:x1876699777116288:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 44471us (46003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760644.515126:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1789760644.515185:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.515261:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.515303:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777116672 00000100:00100000:2.0:1789760644.515317:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777116672 00002000:00100000:2.0:1789760644.515351:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x3:0x0] (7340032->8388607) req@ffff97e57ac15500 x1876699777116672/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.515361:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ac15500 with x1876699777116672 ext(7340032->8388607) 00002000:00010000:2.0:1789760644.515365:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ac15500 00000100:00100000:2.0:1789760644.515403:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 1 deadline 320666772841 time 320666672841 state 0x1 ref 4 00000100:00100000:2.0:1789760644.515418:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777116800 00000100:00100000:2.0:1789760644.515421:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777116800 00002000:00100000:2.0:1789760644.515437:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x3:0x0] (5242880->6291455) req@ffff97e57ac14380 x1876699777116800/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.515444:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ac14380 with x1876699777116800 ext(5242880->6291455) 00002000:00010000:2.0:1789760644.515447:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ac14380 00000100:00100000:2.0:1789760644.515453:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 1 deadline 320666772841 time 320666672841 state 0x1 ref 5 00000100:00100000:2.0:1789760644.515490:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320699786822 time 320699686822 state 0x1 ref 5 00000100:00100000:2.0:1789760644.515501:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+37:2404:x1876699777116672:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760644.515663:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320699786822 time 320699871115 state 0x0 ref 5 00000100:00100000:2.0:1789760644.515673:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+38:2404:x1876699777116800:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760644.527355:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2405:x1876699777116160:12345-192.168.203.38@tcp:4:dd.0 Request processed in 81561us (81866us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789760644.527369:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 21 00002000:00100000:3.0:1789760644.527384:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3:0x0] (0->1048575) req@ffff97e57f922680 x1876699777116160/t4294967312(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760644.527395:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f922680 with x1876699777116160 ext(0->1048575) 00002000:00010000:3.0:1789760644.527400:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f922680 00000100:00100000:0.0:1789760644.542117:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.542151:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.542183:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.543150:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777116928 00000100:00100000:3.0:1789760644.543162:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777116928 00002000:00100000:3.0:1789760644.543211:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3:0x0] (4194304->5242879) req@ffff97e57f88c700 x1876699777116928/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760644.543223:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f88c700 with x1876699777116928 ext(4194304->5242879) 00002000:00010000:3.0:1789760644.543229:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f88c700 00000100:00100000:1.0:1789760644.543683:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777117184 00000100:00100000:1.0:1789760644.543689:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777117184 00002000:00100000:1.0:1789760644.543713:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x3:0x0] (6291456->7340031) req@ffff97e57f88fb80 x1876699777117184/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760644.543722:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f88fb80 with x1876699777117184 ext(6291456->7340031) 00002000:00010000:1.0:1789760644.543725:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f88fb80 00000100:00100000:1.0:1789760644.543753:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320699971115 time 320699871115 state 0x1 ref 6 00000100:00100000:1.0:1789760644.543766:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777117056 00000100:00100000:1.0:1789760644.543769:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777117056 00002000:00100000:1.0:1789760644.543783:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x3:0x0] (4194304->5242879) req@ffff97e57b2a0000 x1876699777117056/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760644.543808:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57b2a0000 with x1876699777117056 ext(4194304->5242879) 00002000:00010000:1.0:1789760644.543811:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57b2a0000 00000100:00100000:1.0:1789760644.543817:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320699971115 time 320699871115 state 0x1 ref 7 00000100:00100000:1.0:1789760644.543839:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320728148681 time 320728048681 state 0x1 ref 7 00000100:00100000:1.0:1789760644.543850:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+41:2403:x1876699777117184:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760644.544049:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320728148681 time 320728257024 state 0x0 ref 7 00000100:00100000:2.0:1789760644.544061:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+42:2403:x1876699777117056:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:1.0:1789760644.549876:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760644.552207:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320728357024 time 320728257024 state 0x1 ref 7 00000100:00100000:3.0:1789760644.552237:0:13389:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1789760644.552245:0:13389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_008' 00000100:00100000:3.0:1789760644.552264:0:8120:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1789760644.552271:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777117312 00000100:00100000:3.0:1789760644.552280:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777117312 00002000:00100000:3.0:1789760644.552637:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (3145728->4194303) req@ffff97e546386300 x1876699777117312/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760644.552662:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546386300 with x1876699777117312 ext(3145728->4194303) 00002000:00010000:3.0:1789760644.552669:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e546386300 00000100:00100000:3.0:1789760644.558167:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320728357024 time 320728257024 state 0x1 ref 8 00000100:00100000:0.0:1789760644.558619:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760644.558642:0:8120:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:0.0:1789760644.558652:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777117440 00000100:00100000:0.0:1789760644.558660:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777117440 00002000:00100000:0.0:1789760644.558703:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (7340032->8388607) req@ffff97e57b2a1f80 x1876699777117440/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.558713:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57b2a1f80 with x1876699777117440 ext(7340032->8388607) 00002000:00010000:0.0:1789760644.558719:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57b2a1f80 00000100:00100000:0.0:1789760644.558732:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320728357024 time 320728257024 state 0x1 ref 9 00000100:00100000:0.0:1789760644.561554:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2406:x1876699777116416:12345-192.168.203.38@tcp:4:dd.0 Request processed in 79061us (79413us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789760644.561566:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 23 00002000:00100000:0.0:1789760644.561579:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x3:0x0] (1048576->2097151) req@ffff97e57f05c000 x1876699777116416/t4294967314(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.561590:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f05c000 with x1876699777116416 ext(1048576->2097151) 00002000:00010000:0.0:1789760644.561603:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f05c000 00000100:00100000:0.0:1789760644.561633:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320745940034 time 320745840034 state 0x1 ref 8 00000100:00100000:0.0:1789760644.561646:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+38:2405:x1876699777116928:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760644.566093:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320750391815 time 320750291815 state 0x1 ref 8 00000100:00100000:0.0:1789760644.566125:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2403:x1876699777117312:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760644.573223:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760644.584871:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777117696 00000100:00100000:2.0:1789760644.584885:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777117696 00000100:00100000:2.0:1789760644.584939:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1789760644.584948:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11411:x1876699777117696:12345-192.168.203.38@tcp:35:dd.0 00000001:00080000:2.0:1789760644.585209:0:6469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000100:00100000:2.0:1789760644.594554:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11411:x1876699777117696:12345-192.168.203.38@tcp:35:dd.0 Request processed in 9594us (21328us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789760644.594569:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000020:00080000:2.0:1789760644.594576:0:6469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789760644.603516:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760644.603627:0:8120:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 9 min 3 max 116 00000100:00100000:1.0:1789760644.603649:0:8120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_009' 00000100:00100000:0.0:1789760644.606486:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2406:x1876699777116544:12345-192.168.203.38@tcp:4:dd.0 Request processed in 124099us (124408us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789760644.606500:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 22 00002000:00100000:0.0:1789760644.606513:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x3:0x0] (2097152->3145727) req@ffff97e57f05d180 x1876699777116544/t4294967315(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.606524:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f05d180 with x1876699777116544 ext(2097152->3145727) 00002000:00010000:0.0:1789760644.606530:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f05d180 00000100:00100000:0.0:1789760644.607489:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777117824 00000100:00100000:0.0:1789760644.607498:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777117824 00002000:00100000:0.0:1789760644.607532:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3:0x0] (6291456->7340031) req@ffff97e57b2a3480 x1876699777117824/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/0 e 0 to 0 dl 1789760655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.610642:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57b2a3480 with x1876699777117824 ext(6291456->7340031) 00002000:00010000:0.0:1789760644.610651:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57b2a3480 00000100:00100000:0.0:1789760644.610671:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320750391815 time 320750291815 state 0x1 ref 8 00000100:00100000:0.0:1789760644.610702:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320795011229 time 320794911229 state 0x1 ref 8 00000100:00100000:0.0:1789760644.610735:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+41:2403:x1876699777117440:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760644.613001:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2404:x1876699777116672:12345-192.168.203.38@tcp:4:dd.0 Request processed in 97490us (97805us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789760644.613014:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 24 00002000:00100000:2.0:1789760644.613027:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x3:0x0] (7340032->8388607) req@ffff97e57ac15500 x1876699777116672/t4294967316(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.613036:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ac15500 with x1876699777116672 ext(7340032->8388607) 00002000:00010000:2.0:1789760644.613048:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ac15500 00000100:00100000:2.0:1789760644.613079:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320795011229 time 320797285182 state 0x0 ref 7 00000100:00100000:2.0:1789760644.613093:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+42:2406:x1876699777117824:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:0.0:1789760644.620481:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760644.620956:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2404:x1876699777116800:12345-192.168.203.38@tcp:4:dd.0 Request processed in 105276us (105688us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789760644.620967:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 25 00002000:00100000:2.0:1789760644.620980:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x3:0x0] (5242880->6291455) req@ffff97e57ac14380 x1876699777116800/t4294967317(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.620992:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ac14380 with x1876699777116800 ext(5242880->6291455) 00002000:00010000:2.0:1789760644.620998:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ac14380 00000100:00100000:1.0:1789760644.630933:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2403:x1876699777117184:12345-192.168.203.38@tcp:4:dd.0 Request processed in 87073us (88769us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789760644.630948:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 26 00002000:00100000:1.0:1789760644.630963:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x3:0x0] (6291456->7340031) req@ffff97e57f88fb80 x1876699777117184/t4294967318(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760644.630973:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f88fb80 with x1876699777117184 ext(6291456->7340031) 00002000:00010000:1.0:1789760644.630979:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f88fb80 00000100:00100000:1.0:1789760644.634955:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 321019157251 time 320819157251 state 0x1 ref 7 00000100:00100000:1.0:1789760644.634987:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2403:x1876699777112192:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760644.640108:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777117056:12345-192.168.203.38@tcp:4:dd.0 Request processed in 96039us (97914us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789760644.640121:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 27 00002000:00100000:2.0:1789760644.640135:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x3:0x0] (4194304->5242879) req@ffff97e57b2a0000 x1876699777117056/t4294967319(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.640145:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57b2a0000 with x1876699777117056 ext(4194304->5242879) 00002000:00010000:2.0:1789760644.640152:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57b2a0000 00000100:00100000:0.0:1789760644.650148:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2405:x1876699777116928:12345-192.168.203.38@tcp:4:dd.0 Request processed in 88494us (108033us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789760644.650162:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 28 00002000:00100000:0.0:1789760644.650175:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (4194304->5242879) req@ffff97e57f88c700 x1876699777116928/t4294967313(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.650186:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f88c700 with x1876699777116928 ext(4194304->5242879) 00002000:00010000:0.0:1789760644.650193:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f88c700 00000100:00100000:0.0:1789760644.657497:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2403:x1876699777117312:12345-192.168.203.38@tcp:4:dd.0 Request processed in 91376us (107620us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789760644.657512:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 29 00002000:00100000:0.0:1789760644.657525:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3:0x0] (3145728->4194303) req@ffff97e546386300 x1876699777117312/t4294967314(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.657537:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546386300 with x1876699777117312 ext(3145728->4194303) 00002000:00010000:0.0:1789760644.657543:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e546386300 00000100:00100000:2.0:1789760644.666424:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2403:x1876699777117440:12345-192.168.203.38@tcp:4:dd.0 Request processed in 55687us (107799us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789760644.666438:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 30 00002000:00100000:2.0:1789760644.666452:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3:0x0] (7340032->8388607) req@ffff97e57b2a1f80 x1876699777117440/t4294967315(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760644.666463:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57b2a1f80 with x1876699777117440 ext(7340032->8388607) 00002000:00010000:2.0:1789760644.666482:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57b2a1f80 00000100:00100000:0.0:1789760644.683324:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2406:x1876699777117824:12345-192.168.203.38@tcp:4:dd.0 Request processed in 70225us (79808us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789760644.683339:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:0.0:1789760644.683347:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320795011229 time 320797285182 state 0x2 ref 0 00002000:00100000:0.0:1789760644.683451:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3:0x0] (6291456->7340031) req@ffff97e57b2a3480 x1876699777117824/t4294967316(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760644.683477:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57b2a3480 with x1876699777117824 ext(6291456->7340031) 00002000:00010000:0.0:1789760644.683484:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57b2a3480 00000100:00100000:1.0:1789760644.684002:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777112192:12345-192.168.203.38@tcp:4:dd.500 Request processed in 49027us (918814us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789760644.684012:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 11 00002000:00100000:1.0:1789760644.684020:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x2:0x0] (5242880->6291455) req@ffff97e57f877800 x1876699777112192/t4294967320(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760644.684028:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f877800 with x1876699777112192 ext(5242880->6291455) 00002000:00010000:1.0:1789760644.684033:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f877800 00000100:00100000:0.0:1789760644.835170:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 321219369280 time 321019369280 state 0x1 ref 6 00000100:00100000:0.0:1789760644.835204:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2403:x1876699777112320:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760644.863100:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2403:x1876699777112320:12345-192.168.203.38@tcp:4:dd.500 Request processed in 27895us (1068932us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789760644.863119:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 12 00002000:00100000:0.0:1789760644.863138:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (6291456->7340031) req@ffff97e57f032680 x1876699777112320/t4294967321(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760644.863150:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f032680 with x1876699777112320 ext(6291456->7340031) 00002000:00010000:0.0:1789760644.863158:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f032680 00000100:00100000:1.0:1789760645.035641:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 321419840909 time 321219840909 state 0x1 ref 5 00000100:00100000:1.0:1789760645.035675:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2404:x1876699777112448:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:1.0:1789760645.063918:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2404:x1876699777112448:12345-192.168.203.38@tcp:4:dd.500 Request processed in 28245us (1247704us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789760645.063947:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 13 00002000:00100000:1.0:1789760645.063965:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x2:0x0] (7340032->8388607) req@ffff97e57f6d6d80 x1876699777112448/t4294967322(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760645.063975:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f6d6d80 with x1876699777112448 ext(7340032->8388607) 00002000:00010000:1.0:1789760645.063982:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f6d6d80 00000100:00100000:2.0:1789760645.237745:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 321621947356 time 321421947356 state 0x1 ref 4 00000100:00100000:2.0:1789760645.237775:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2403:x1876699777112576:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760645.262061:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777112576:12345-192.168.203.38@tcp:4:dd.500 Request processed in 24290us (1389138us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789760645.262077:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 14 00002000:00100000:2.0:1789760645.262091:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2:0x0] (4194304->5242879) req@ffff97e57f876a00 x1876699777112576/t4294967317(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760645.262102:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f876a00 with x1876699777112576 ext(4194304->5242879) 00002000:00010000:2.0:1789760645.262109:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f876a00 00000100:00100000:1.0:1789760645.438092:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 321822291357 time 321622291357 state 0x1 ref 3 00000100:00100000:1.0:1789760645.438125:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2405:x1876699777112704:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:3.0:1789760645.454188:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2405:x1876699777112704:12345-192.168.203.38@tcp:4:dd.500 Request processed in 16063us (1534739us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789760645.454205:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 15 00002000:00100000:3.0:1789760645.454226:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (5242880->6291455) req@ffff97e57f030000 x1876699777112704/t4294967318(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:689/0 lens 488/448 e 0 to 0 dl 1789760654 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760645.454238:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f030000 with x1876699777112704 ext(5242880->6291455) 00002000:00010000:3.0:1789760645.454247:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f030000 00000100:00100000:2.0:1789760645.638327:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 322022527203 time 321822527203 state 0x1 ref 2 00000100:00100000:2.0:1789760645.638360:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777112832:12345-192.168.203.38@tcp:4:dd.500 00010000:00010000:2.0:1789760645.639060:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760645.663572:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2403:x1876699777112832:12345-192.168.203.38@tcp:4:dd.500 Request processed in 25213us (1590919us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789760645.663587:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 16 00002000:00100000:2.0:1789760645.663604:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2:0x0] (6291456->7340031) req@ffff97e57f032300 x1876699777112832/t4294967319(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760645.663615:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f032300 with x1876699777112832 ext(6291456->7340031) 00002000:00010000:2.0:1789760645.663621:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f032300 00000100:00100000:0.0:1789760645.682665:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760645.682712:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760645.682751:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760645.682783:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760645.682857:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760645.682882:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760645.682915:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760645.682948:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777117952 00000100:00100000:0.0:1789760645.682958:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777117952 00000100:00100000:0.0:1789760645.683013:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 340 00000100:00100000:0.0:1789760645.683025:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777117952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760645.683095:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777117952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760645.683118:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 340 00000100:00100000:0.0:1789760645.683173:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777118080 00000100:00100000:0.0:1789760645.683177:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777118080 00000100:00100000:0.0:1789760645.683219:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777118592 00000100:00100000:0.0:1789760645.683448:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777118592 00000100:00100000:0.0:1789760645.683480:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777118208 00000100:00100000:0.0:1789760645.683483:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777118208 00000100:00100000:0.0:1789760645.683502:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777118720 00000100:00100000:0.0:1789760645.683505:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777118720 00000100:00100000:0.0:1789760645.683532:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:0.0:1789760645.683541:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777118080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760645.683577:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777118080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760645.683585:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:0.0:1789760645.683606:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:0.0:1789760645.683613:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777118592:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760645.683640:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777118592:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760645.683647:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:0.0:1789760645.683665:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:0.0:1789760645.683673:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2403:x1876699777118208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760645.683703:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2403:x1876699777118208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760645.683710:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:0.0:1789760645.683729:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:0.0:1789760645.683745:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777118720:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760645.683776:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777118720:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760645.683785:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 232 00000100:00080000:0.0:1789760645.684018:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760645.684024:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760645.684051:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777118336 00000100:00100000:0.0:1789760645.684057:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777118336 00000100:00100000:0.0:1789760645.684095:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777118464 00000100:00100000:0.0:1789760645.684099:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777118464 00000100:00100000:0.0:1789760645.684130:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:0.0:1789760645.684140:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2403:x1876699777118336:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760645.684179:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2403:x1876699777118336:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760645.684187:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:0.0:1789760645.684209:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:0.0:1789760645.684217:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2403:x1876699777118464:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760645.684446:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2403:x1876699777118464:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 228us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760645.684454:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:0.0:1789760645.838608:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 322022527203 time 322022808798 state 0x0 ref 1 00000100:00100000:0.0:1789760645.838643:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2404:x1876699777112960:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:1.0:1789760645.848687:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+48:2404:x1876699777112960:12345-192.168.203.38@tcp:4:dd.500 Request processed in 10050us (1761344us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789760645.848701:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1789760645.848710:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 322022527203 time 322022808798 state 0x2 ref 0 00002000:00100000:1.0:1789760645.848725:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (7340032->8388607) req@ffff97e57f030380 x1876699777112960/t4294967320(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:690/0 lens 488/448 e 0 to 0 dl 1789760655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760645.848736:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f030380 with x1876699777112960 ext(7340032->8388607) 00002000:00010000:1.0:1789760645.848742:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f030380 00000100:00100000:0.0:1789760645.905037:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760645.905109:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777118848 00000100:00100000:3.0:1789760645.905120:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777118848 00000100:00100000:3.0:1789760645.905186:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1789760645.905203:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+47:6389:x1876699777118848:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760645.905217:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00002000:00010000:3.0:1789760645.905235:0:9898:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789760645.905238:0:9898:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime from disk: 1789760641 -> 1789760644 00002000:00010000:3.0:1789760645.905241:0:9898:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime from disk: 1789760642 -> 1789760644 00010000:00010000:3.0:1789760645.905267:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082c154ac/0xc2b9a3a739857151 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521193a expref: 47 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760645.905290:0:9898:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789760645.905304:0:9898:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 1789760642 -> 1789760643 00002000:00010000:3.0:1789760645.905306:0:9898:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 1789760642 -> 1789760643 00010000:00010000:3.0:1789760645.905316:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1751bca/0xc2b9a3a7398570f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118f4 expref: 46 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760645.905339:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb1bc04f/0xc2b9a3a739857135 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211917 expref: 45 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760645.905351:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ae81401/0xc2b9a3a739857158 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211933 expref: 44 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760645.905363:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dbca594/0xc2b9a3a73985713c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521191e expref: 43 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760645.905374:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760645.905436:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+42:6389:x1876699777118848:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 241us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760645.905444:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:1.0:1789760645.906411:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760645.906483:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777118976 00000100:00100000:3.0:1789760645.906490:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777118976 00000100:00100000:2.0:1789760645.906669:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1789760645.906681:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+48:6390:x1876699777118976:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760645.906700:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 7 locks, starting at 0 00002000:00010000:2.0:1789760645.906714:0:6450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789760645.906717:0:6450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 1789760642 -> 1789760643 00002000:00010000:2.0:1789760645.906720:0:6450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 1789760642 -> 1789760643 00010000:00010000:2.0:1789760645.906740:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398570fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118fb expref: 48 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760645.906764:0:6450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 6291456 -> 8388608 00002000:00010000:2.0:1789760645.906767:0:6450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789760643 -> 1789760644 00002000:00010000:2.0:1789760645.906769:0:6450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789760643 -> 1789760644 00010000:00010000:2.0:1789760645.906776:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a73985716d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521194f expref: 47 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760645.906893:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985715f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 7 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211941 expref: 46 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760645.906906:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a73985714a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521192c expref: 45 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760645.906917:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857166 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [4194304->6291455] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211948 expref: 44 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760645.906928:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857174 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211956 expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760645.906954:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff6915f/0xc2b9a3a739857143 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211925 expref: 42 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760645.906968:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760645.907012:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+41:6390:x1876699777118976:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 333us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760645.907019:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1789760646.010434:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.012856:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777119232 00000100:00100000:0.0:1789760646.012956:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777119232 00000100:00100000:0.0:1789760646.013206:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:0.0:1789760646.013218:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11437:x1876699777119232:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760646.013240:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760646.013259:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4200/0xc2b9a3a73985717b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521195d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.013335:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.013350:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.013375:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.013391:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.013398:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.013405:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014179:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857190 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014192:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857190 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014200:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857190 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760646.014217:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 16777216 00010000:00010000:0.0:1789760646.014309:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014317:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014324:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014331:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014337:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760646.014341:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014348:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014359:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760646.014362:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760646.014613:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014620:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857182 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014635:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014640:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014652:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014658:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760646.014661:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014667:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014676:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2ab29dc6 (ffff97e5489b1a00) 00010000:00010000:0.0:1789760646.014678:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760646.014681:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014687:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857189 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014741:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4200/0xc2b9a3a73985717b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521195d expref: 17 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014755:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857190 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521195d expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.014763:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:0.0:1789760646.014765:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760646.014767:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4a00, rc 0) 00000100:00100000:0.0:1789760646.014901:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+16:11437:x1876699777119232:12345-192.168.203.38@tcp:101:dd.0 Request processed in 1677us (4467us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789760646.014917:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00080000:1.0:1789760646.015079:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760646.036306:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.036364:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.036467:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760646.036525:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777119488 00000100:00100000:1.0:1789760646.036546:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777119488 00000100:00100000:1.0:1789760646.036611:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1789760646.036622:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+16:11438:x1876699777119488:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760646.036648:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760646.036681:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a73985719e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211964 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.036765:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.036779:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.036834:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.036849:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.036856:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.036863:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037415:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398571b3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037426:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398571b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037434:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398571b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760646.037444:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 16777216 00010000:00010000:1.0:1789760646.037535:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037551:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037558:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037564:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760646.037568:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037576:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037587:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:1.0:1789760646.037590:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760646.037595:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037601:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398571a5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037614:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037620:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037628:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037631:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ea00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760646.037641:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037647:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037654:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2ab29dc6 (ffff97e5461f2600) 00010000:00010000:1.0:1789760646.037656:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760646.037659:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037664:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398571ac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037708:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f200/0xc2b9a3a73985719e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211964 expref: 19 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037722:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398571b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211964 expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.037730:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:1.0:1789760646.037732:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760646.037735:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8f000, rc 0) 00000100:00100000:1.0:1789760646.037850:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11438:x1876699777119488:12345-192.168.203.38@tcp:101:dd.0 Request processed in 1229us (1552us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789760646.037858:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:2.0:1789760646.045805:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777119616 00000100:00100000:2.0:1789760646.045830:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777119616 00000100:00080000:3.0:1789760646.045999:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760646.050305:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777119744 00000100:00100000:2.0:1789760646.050323:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777119744 00000100:00100000:2.0:1789760646.050398:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1789760646.050413:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+43:11444:x1876699777119616:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760646.050432:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789760646.050439:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00010000:00010000:2.0:1789760646.050457:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521196b expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760646.050462:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+43:11437:x1876699777119744:12345-192.168.203.38@tcp:101:dd.0 00002000:00010000:2.0:1789760646.050488:0:8110:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x2:0x0] initial LVB size: 8388608, mtime: 0x6aad9483, atime: 0x6aad9481, ctime: 0x6aad9483, blocks: 0x1 00010000:00010000:3.0:1789760646.050493:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760646.050513:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211972 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.050546:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1789760646.050554:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760646.050570:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 45 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.050711:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760646.050717:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760646.050727:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 45 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.050747:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 45 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.050763:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dde00, rc 0) 00000100:00100000:3.0:1789760646.050897:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+45:11437:x1876699777119744:12345-192.168.203.38@tcp:101:dd.0 Request processed in 445us (14429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760646.050906:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00010000:00010000:2.0:1789760646.062867:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 44 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.062926:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01000, rc 0) 00000100:00100000:2.0:1789760646.062999:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+44:11444:x1876699777119616:12345-192.168.203.38@tcp:101:dd.0 Request processed in 12590us (26632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.063007:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:0.0:1789760646.070460:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.070548:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.070587:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.070621:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777119872 00000100:00100000:0.0:1789760646.070630:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777119872 00000100:00100000:0.0:1789760646.070675:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777120000 00000100:00100000:0.0:1789760646.070679:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777120000 00000100:00100000:0.0:1789760646.070692:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777120128 00000100:00100000:0.0:1789760646.070694:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777120128 00000100:00100000:0.0:1789760646.070708:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:0.0:1789760646.070717:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+46:11442:x1876699777119872:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760646.070735:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760646.070754:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211979 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.070780:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.070800:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.070809:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 47 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.070837:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 47 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.070863:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4200, rc 0) 00000100:00100000:0.0:1789760646.070913:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+47:11442:x1876699777119872:12345-192.168.203.38@tcp:101:dd.0 Request processed in 194us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.070922:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:0.0:1789760646.070957:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1789760646.070976:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+46:11439:x1876699777120000:12345-192.168.203.38@tcp:101:dd.0 00000100:00100000:3.0:1789760646.070980:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1789760646.071004:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+46:11440:x1876699777120128:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760646.071022:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760646.071039:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211987 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.071065:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760646.071069:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760646.071077:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 47 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.071093:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 47 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.071121:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dcc00, rc 0) 00000100:00100000:3.0:1789760646.071171:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+47:11440:x1876699777120128:12345-192.168.203.38@tcp:101:dd.0 Request processed in 178us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760646.071178:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00010000:00010000:0.0:1789760646.071375:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760646.071390:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211980 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.071406:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.071410:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.071417:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 47 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.071430:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 47 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.071439:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5a00, rc 0) 00000100:00100000:0.0:1789760646.071468:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+47:11439:x1876699777120000:12345-192.168.203.38@tcp:101:dd.0 Request processed in 504us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.071475:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1789760646.071519:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.071652:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.084960:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760646.085365:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777120256 00000100:00100000:2.0:1789760646.085380:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777120256 00000100:00100000:2.0:1789760646.085442:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777120384 00000100:00100000:2.0:1789760646.085445:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777120384 00000100:00100000:2.0:1789760646.085476:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1789760646.085487:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+48:11441:x1876699777120256:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760646.085504:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760646.085523:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521198e expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.085563:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760646.085568:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760646.085577:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 49 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.085592:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 49 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.085603:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01800, rc 0) 00000100:00100000:2.0:1789760646.085663:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+49:11441:x1876699777120256:12345-192.168.203.38@tcp:101:dd.0 Request processed in 178us (14144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.085683:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1789760646.085702:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1789760646.085708:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+48:11443:x1876699777120384:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760646.085715:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760646.085721:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211995 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.085733:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760646.085736:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760646.085741:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 49 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.085751:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 49 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.085759:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00800, rc 0) 00000100:00100000:2.0:1789760646.085778:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+49:11443:x1876699777120384:12345-192.168.203.38@tcp:101:dd.0 Request processed in 71us (14128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.085784:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:0.0:1789760646.091862:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777120512 00000100:00100000:0.0:1789760646.091877:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777120512 00000100:00100000:3.0:1789760646.091919:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.091976:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.092607:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777120640 00000100:00100000:0.0:1789760646.092614:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777120640 00000100:00100000:0.0:1789760646.092653:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1789760646.092662:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+50:11450:x1876699777120512:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760646.092680:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760646.092697:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e6521199c expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.092744:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.092748:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.092758:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 51 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.092774:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 51 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.092822:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4e00, rc 0) 00000100:00100000:0.0:1789760646.092884:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+51:11450:x1876699777120512:12345-192.168.203.38@tcp:101:dd.0 Request processed in 223us (7938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.092891:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1789760646.092912:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:0.0:1789760646.092919:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+50:11447:x1876699777120640:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760646.092926:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760646.092933:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119a3 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.092958:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.092962:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.092967:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 51 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.092979:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 51 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.093002:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5e00, rc 0) 00000100:00100000:0.0:1789760646.093024:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+51:11447:x1876699777120640:12345-192.168.203.38@tcp:101:dd.0 Request processed in 105us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.093031:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1789760646.096839:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.096874:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.096914:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.096956:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777121280 00000100:00100000:3.0:1789760646.096968:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777121280 00000100:00100000:3.0:1789760646.097045:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:3.0:1789760646.097058:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545672850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2405:x1876699777121280:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760646.097079:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760646.097114:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398571b3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211964 expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.097139:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:3.0:1789760646.097145:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760646.097215:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545672850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+17:2405:x1876699777121280:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 160us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760646.097223:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1789760646.097810:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777120768 00000100:00100000:0.0:1789760646.097832:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777120768 00000100:00100000:0.0:1789760646.097884:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777120896 00000100:00100000:0.0:1789760646.097889:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777120896 00000100:00100000:0.0:1789760646.097912:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:0.0:1789760646.097921:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+52:11452:x1876699777120768:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760646.097939:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760646.097956:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119aa expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.097982:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.097998:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.098009:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 53 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.098042:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 53 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.098056:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5800, rc 0) 00000100:00100000:0.0:1789760646.098125:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+53:11452:x1876699777120768:12345-192.168.203.38@tcp:101:dd.0 Request processed in 204us (6148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.098132:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:0.0:1789760646.098149:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:0.0:1789760646.098155:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+52:11445:x1876699777120896:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760646.098162:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760646.098168:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119b1 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.098180:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.098184:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760646.098189:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 53 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.098200:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 53 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.098207:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4600, rc 0) 00000100:00100000:0.0:1789760646.098229:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+53:11445:x1876699777120896:12345-192.168.203.38@tcp:101:dd.0 Request processed in 74us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.098243:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:0.0:1789760646.098293:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777121152 00000100:00100000:0.0:1789760646.098298:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777121152 00000100:00100000:0.0:1789760646.098332:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1789760646.098339:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+17:11438:x1876699777121152:12345-192.168.203.38@tcp:35:dd.0 00000100:00100000:0.0:1789760646.098527:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11438:x1876699777121152:12345-192.168.203.38@tcp:35:dd.0 Request processed in 187us (1651us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789760646.098533:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:3.0:1789760646.098572:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.098604:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777121408 00000100:00100000:0.0:1789760646.098610:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777121408 00002000:00100000:0.0:1789760646.098645:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x2:0x0] (0->1048575) req@ffff97e449015180 x1876699777121408/t0(0) o3->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:692/0 lens 488/0 e 0 to 0 dl 1789760657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760646.098655:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e449015180 with x1876699777121408 ext(0->1048575) 00002000:00010000:0.0:1789760646.098661:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e449015180 00000100:00100000:0.0:1789760646.098675:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320795011229 time 320797285182 state 0x0 ref 1 00000100:00100000:0.0:1789760646.098684:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320797385182 time 320797285182 state 0x1 ref 1 00000100:00100000:0.0:1789760646.098707:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320797385182 time 322282916282 state 0x0 ref 1 00000100:00100000:0.0:1789760646.098718:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+53:2406:x1876699777121408:12345-192.168.203.38@tcp:3:dd.0 00000100:00100000:0.0:1789760646.146266:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+53:2406:x1876699777121408:12345-192.168.203.38@tcp:3:dd.0 Request processed in 47538us (47689us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760646.146280:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:0.0:1789760646.146288:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320797385182 time 322282916282 state 0x2 ref 0 00002000:00100000:0.0:1789760646.146319:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x2:0x0] (0->1048575) req@ffff97e449015180 x1876699777121408/t0(0) o3->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:692/0 lens 488/440 e 0 to 0 dl 1789760657 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760646.146328:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e449015180 with x1876699777121408 ext(0->1048575) 00002000:00010000:0.0:1789760646.146334:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e449015180 00000100:00100000:3.0:1789760646.221881:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760646.222185:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777121664 00000100:00100000:1.0:1789760646.222199:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777121664 00000100:00100000:1.0:1789760646.222273:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:1.0:1789760646.222285:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11449:x1876699777121664:12345-192.168.203.38@tcp:35:dd.0 00000100:00100000:1.0:1789760646.222639:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11449:x1876699777121664:12345-192.168.203.38@tcp:35:dd.0 Request processed in 355us (773us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789760646.222648:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:2.0:1789760646.253325:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.253559:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777121792 00000100:00100000:3.0:1789760646.253639:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777121792 00000100:00100000:3.0:1789760646.253714:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:3.0:1789760646.253728:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11454:x1876699777121792:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760646.253760:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760646.253919:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc400/0xc2b9a3a73985720e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119b8 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.254033:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc600/0xc2b9a3a739857215 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.254053:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc600/0xc2b9a3a739857215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.254071:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc600/0xc2b9a3a739857215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760646.255435:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760646.255445:0:12655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760646.255709:0:12655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc600/0xc2b9a3a739857215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.256016:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc400/0xc2b9a3a73985720e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b8 expref: 21 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.256086:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc600/0xc2b9a3a739857215 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b8 expref: 20 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.256099:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:2.0:1789760646.256111:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760646.256117:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dc600, rc 0) 00000100:00100000:2.0:1789760646.256248:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11454:x1876699777121792:12345-192.168.203.38@tcp:101:rm.0 Request processed in 2520us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.256258:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:0.0:1789760646.263020:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760646.263335:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777122048 00000100:00100000:1.0:1789760646.263350:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777122048 00000100:00100000:1.0:1789760646.263560:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:1.0:1789760646.263575:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11454:x1876699777122048:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:1.0:1789760646.263604:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760646.263710:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a73985721c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119bf expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760646.263874:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789760646.264045:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a73985721c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119bf expref: 22 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.264154:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2600) 00010000:00010000:1.0:1789760646.264161:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760646.264274:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a73985721c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119bf expref: 22 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.264298:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8ea00, rc 0) 00000100:00100000:1.0:1789760646.264384:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+21:11454:x1876699777122048:12345-192.168.203.38@tcp:101:rm.0 Request processed in 812us (1380us total) trans 4294967326 rc 301/301 00000100:00100000:1.0:1789760646.264393:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:1.0:1789760646.272513:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.272637:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777122176 00000100:00100000:0.0:1789760646.272652:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777122176 00000100:00100000:0.0:1789760646.272768:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1789760646.272822:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+21:11454:x1876699777122176:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:0.0:1789760646.278276:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+21:11454:x1876699777122176:12345-192.168.203.38@tcp:37:rm.0 Request processed in 5482us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.278292:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1789760646.287108:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.287588:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777122432 00000100:00100000:3.0:1789760646.287603:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777122432 00000100:00100000:3.0:1789760646.287683:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1789760646.287697:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+21:11454:x1876699777122432:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:3.0:1789760646.290240:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+22:11454:x1876699777122432:12345-192.168.203.38@tcp:35:rm.0 Request processed in 2533us (3133us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1789760646.290254:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1789760646.299154:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.299436:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777122688 00000100:00100000:3.0:1789760646.299448:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777122688 00000100:00100000:3.0:1789760646.299538:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1789760646.299551:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+22:11454:x1876699777122688:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760646.299607:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760646.299639:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dca00/0xc2b9a3a73985722a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.299770:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc800/0xc2b9a3a739857231 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.300004:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc800/0xc2b9a3a739857231 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.300022:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc800/0xc2b9a3a739857231 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760646.300037:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789760646.300218:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dca00/0xc2b9a3a73985722a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119c6 expref: 25 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.300246:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc800/0xc2b9a3a739857231 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119c6 expref: 24 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.300258:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:3.0:1789760646.300262:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789760646.300265:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dc800, rc 0) 00000100:00100000:0.0:1789760646.300531:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11454:x1876699777122688:12345-192.168.203.38@tcp:101:rm.0 Request processed in 979us (1388us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789760646.300541:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:2.0:1789760646.304443:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.304704:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777122816 00000100:00100000:0.0:1789760646.304717:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777122816 00000100:00100000:0.0:1789760646.304932:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:0.0:1789760646.304948:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11454:x1876699777122816:12345-192.168.203.38@tcp:41:rm.0 00000004:00000024:0.0:1789760646.305016:0:12655:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7704936448 00000100:00100000:0.0:1789760646.305384:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11454:x1876699777122816:12345-192.168.203.38@tcp:41:rm.0 Request processed in 438us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.305393:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:1.0:1789760646.309073:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.309256:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777123072 00000100:00100000:0.0:1789760646.309271:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777123072 00000100:00100000:0.0:1789760646.309370:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1789760646.309383:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11454:x1876699777123072:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1789760646.309460:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789760646.309566:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857190 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521195d expref: 24 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.309596:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8e200/0xc2b9a3a73985700f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118a0 expref: 23 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.309735:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e544c16700) 00010000:00010000:0.0:1789760646.309759:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc600/0xc2b9a3a739857215 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b8 expref: 22 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.309769:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760646.309772:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760646.310001:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.310018:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.310029:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.310045:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.310052:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.310075:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.310447:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.310457:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.311409:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789760646.313160:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789760646.313178:0:9081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 322497389549ns, next at 323497385518ns, rc = 0 00000040:00080000:0.0:1789760646.313338:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789760646.313347:0:9081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 322497559191ns, next at 323497557149ns, rc = 0 00010000:00010000:0.0:1789760646.313451:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313469:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313481:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313491:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313497:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313516:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313548:0:9081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760646.313576:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313582:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313589:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313596:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760646.313601:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313609:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313625:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e5489b1600) 00010000:00010000:0.0:1789760646.313628:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760646.313633:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313639:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687000/0xc2b9a3a73985724d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313666:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313673:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313686:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313692:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313697:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760646.313701:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313706:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313715:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760646.313718:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760646.313721:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313726:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c687600/0xc2b9a3a73985723f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760646.313737:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091ecc156 reply state 0000000007709529 transno 4294967329 ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313750:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.313756:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2ab29dc6 (ffff97e5489b1a00) 00010000:00010000:0.0:1789760646.313759:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760646.313763:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789760646.314176:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760646.314186:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.314193:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760646.314197:0:6453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.314203:0:6453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.314213:0:6453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff97e5489b1600) 00010000:00010000:1.0:1789760646.314216:0:6453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789760646.314219:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.314224:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686600/0xc2b9a3a739857254 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.314241:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760646.314243:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760646.314245:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760646.316053:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11454:x1876699777123072:12345-192.168.203.38@tcp:36:rm.0 Request processed in 6659us (6991us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789760646.316997:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:1.0:1789760646.322026:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760646.322341:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777123328 00000100:00100000:2.0:1789760646.322354:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777123328 00000100:00100000:2.0:1789760646.322449:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1789760646.322461:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11454:x1876699777123328:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1789760646.322540:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789760646.322573:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857119 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211902 expref: 23 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322598:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8f600/0xc2b9a3a739857047 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652118ae expref: 22 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322611:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5489b1400) 00010000:00010000:2.0:1789760646.322623:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760646.322650:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322686:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322698:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322715:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322722:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322729:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322894:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322902:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.322909:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789760646.324037:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000040:00080000:2.0:1789760646.324691:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00010000:00010000:2.0:1789760646.324825:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324843:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324870:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324879:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324886:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324892:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324908:0:6465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789760646.324932:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324938:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324945:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324951:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760646.324957:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324964:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324976:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5820ee800) 00010000:00010000:2.0:1789760646.324979:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789760646.324988:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.324995:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00400/0xc2b9a3a739857269 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325016:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325023:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325029:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325034:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760646.325037:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325042:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325049:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:2.0:1789760646.325051:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760646.325280:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760646.325289:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.325307:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760646.325311:0:7281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.325318:0:7281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.325328:0:7281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff97e5820ee800) 00010000:00010000:0.0:1789760646.325330:0:7281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789760646.325333:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.325339:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857270 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.325356:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760646.325357:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760646.325359:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760646.325429:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325437:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985725b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760646.325449:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000537c5742 reply state 0000000067a9ad6c transno 4294967330 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325639:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.325646:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x151ecd9f (ffff97e5820ee200) 00010000:00010000:2.0:1789760646.325649:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760646.325652:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760646.325766:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11454:x1876699777123328:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3301us (3749us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789760646.325869:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1789760646.330609:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.330713:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777123456 00000100:00100000:0.0:1789760646.330729:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777123456 00000100:00100000:0.0:1789760646.330861:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1789760646.330876:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777123456:12345-192.168.203.38@tcp:103:rm.0 00010000:00010000:0.0:1789760646.330899:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760646.330935:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739856f4b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211861 expref: 7 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.330975:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:0.0:1789760646.330992:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760646.331075:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777123456:12345-192.168.203.38@tcp:103:rm.0 Request processed in 202us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.331085:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:1.0:1789760646.336581:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.336665:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777123712 00000100:00100000:0.0:1789760646.336678:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777123712 00000100:00100000:0.0:1789760646.337413:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1789760646.337431:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11454:x1876699777123712:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:0.0:1789760646.338034:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11454:x1876699777123712:12345-192.168.203.38@tcp:35:rm.0 Request processed in 605us (1464us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789760646.338045:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:1.0:1789760646.343706:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760646.343920:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777123968 00000100:00100000:0.0:1789760646.343934:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777123968 00000100:00100000:0.0:1789760646.343998:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:0.0:1789760646.344008:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11454:x1876699777123968:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1789760646.344193:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789760646.344229:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dc800/0xc2b9a3a739857231 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119c6 expref: 24 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.344258:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e4486dce00/0xc2b9a3a739856fd0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211892 expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.344270:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5489b1300) 00010000:00010000:0.0:1789760646.344283:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760646.344394:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.344404:0:12655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.344418:0:12655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760646.344445:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44bc44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798162944:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1789760646.344638:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760646.344762:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633180 going to sleep for 11 seconds 00000100:00100000:3.0:1789760646.344980:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798162944 00000100:00100000:3.0:1789760646.344987:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798162944 00000100:00100000:3.0:1789760646.345078:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789760646.345087:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:12655:x1876699798162944:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1789760646.345101:0:7305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760646.345117:0:7305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739857277 expref: -99 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.345156:0:7305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 5 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.345167:0:7305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857277 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.345195:0:7305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 5 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.345211:0:7305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 5 pid: 6466 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760646.345224:0:7305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449015500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798163072:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760646.345302:0:7305:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86540 going to sleep for 11 seconds 00000100:00100000:0.0:1789760646.347497:0:7305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449015500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798163072:192.168.203.38@tcp:104: 00010000:00010000:0.0:1789760646.347547:0:7305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857277 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.347561:0:7305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760646.347564:0:7305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760646.347568:0:7305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857277 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.347577:0:7305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dca00, rc 0) 00000100:00100000:0.0:1789760646.347644:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:12655:x1876699798162944:12345-0@lo:101:mdt00_004.0 Request processed in 2557us (3005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.347652:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789760646.347736:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44bc44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798162944:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1789760646.347759:0:12655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.347771:0:12655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760646.349270:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760646.349385:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777124096 00000100:00100000:3.0:1789760646.349396:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777124096 00010000:00010000:3.0:1789760646.349442:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 6 pid: 6466 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760646.349524:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:3.0:1789760646.349536:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c683100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777124096:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760646.349553:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760646.349559:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 6 pid: 6466 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.349574:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 6 pid: 6466 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.349611:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8fe00/0xc2b9a3a739856f60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521186f expref: 6 pid: 6466 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.349630:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760646.349637:0:9898:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857277 expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.349648:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc2b9a3a739857277 expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.349659:0:9898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc2b9a3a739857277 expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.349700:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857277 expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760646.349720:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449017480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9898:1876699798163200:0@lo:105: 00000100:00100000:3.0:1789760646.349779:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760646.349854:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e441f86b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760646.349931:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798163200 00000100:00100000:2.0:1789760646.349935:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798163200 00000100:00100000:2.0:1789760646.349973:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789760646.349979:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449016a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9898:x1876699798163200:12345-0@lo:105: 00010000:00010000:2.0:1789760646.349989:0:6448:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350000:0:6448:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350019:0:6448:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350026:0:6448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350033:0:6448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350042:0:6448:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350065:0:6448:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97e44c687000) 00000100:00100000:2.0:1789760646.350106:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449016a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9898:x1876699798163200:12345-0@lo:105: Request processed in 127us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.350113:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1789760646.350175:0:12655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.350198:0:12655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760646.350229:0:12655:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760646.350281:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.350289:0:12655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.350300:0:12655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760646.350320:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163328:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1789760646.350352:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760646.350383:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760646.350436:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798163328 00000100:00100000:2.0:1789760646.350441:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798163328 00000100:00100000:2.0:1789760646.350505:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789760646.350514:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12655:x1876699798163328:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1789760646.350534:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760646.350553:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a73985728c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739857285 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350574:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a73985728c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857285 expref: 8 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350599:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a73985728c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857285 expref: 8 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.350608:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5820ee500) 00010000:00010000:2.0:1789760646.350611:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760646.350613:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00400, rc 0) 00000100:00100000:2.0:1789760646.350649:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798163328:12345-0@lo:101:mdt00_004.0 Request processed in 137us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.350655:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789760646.350725:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449017480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9898:1876699798163200:0@lo:105: 00010000:00010000:3.0:1789760646.350740:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760646.350808:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c683100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777124096:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1255us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760646.350825:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:1.0:1789760646.352742:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163328:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1789760646.352776:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.352804:0:12655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760646.352843:0:12655:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1789760646.352909:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163456:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760646.352977:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760646.353009:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760646.353047:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798163456 00000100:00100000:1.0:1789760646.353053:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798163456 00000100:00100000:1.0:1789760646.353103:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789760646.353114:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798163456:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760646.353202:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798163456:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760646.353211:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789760646.353249:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163456:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760646.353295:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163584:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760646.353318:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760646.353331:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760646.353342:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798163584 00000100:00100000:1.0:1789760646.353345:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798163584 00000100:00100000:1.0:1789760646.353364:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789760646.353370:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798163584:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760646.353640:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798163584:12345-0@lo:1000:mdt00_004.0 Request processed in 269us (320us total) trans 0 rc 1/1 00000100:00100000:1.0:1789760646.353647:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789760646.353676:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163584:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789760646.353735:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.353746:0:12655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.353756:0:12655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760646.353777:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163712:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1789760646.353834:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760646.353847:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760646.353859:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798163712 00000100:00100000:1.0:1789760646.353862:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798163712 00000100:00100000:1.0:1789760646.353879:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789760646.353884:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798163712:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1789760646.353894:0:7305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760646.353910:0:7305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e200/0xc2b9a3a73985729a lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739857293 expref: -99 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.353933:0:7305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e200/0xc2b9a3a73985729a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857293 expref: 9 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.353945:0:7305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e200/0xc2b9a3a73985729a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857293 expref: 9 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.353954:0:7305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:1.0:1789760646.353957:0:7305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760646.353961:0:7305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8e200, rc 0) 00000100:00100000:1.0:1789760646.353982:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:12655:x1876699798163712:12345-0@lo:101:mdt00_004.0 Request processed in 98us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760646.353987:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789760646.354007:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163712:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1789760646.354017:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.354037:0:12655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.354059:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.354068:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.354076:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789760646.354966:0:12655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].2, 424 off34176 00000100:00100000:1.0:1789760646.355059:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163840:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760646.355107:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760646.355137:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e44113f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760646.355161:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798163840 00000100:00100000:1.0:1789760646.355167:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798163840 00000100:00100000:1.0:1789760646.355198:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760646.355205:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:12655:x1876699798163840:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760646.355285:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:12655:x1876699798163840:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760646.355293:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760646.355331:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c682680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798163840:0@lo:1000:mdt00_004.0 00000040:00080000:1.0:1789760646.355364:0:12655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].2, 504 off34408 00000004:00080000:1.0:1789760646.355372:0:12655:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e542e21240 with version 5 00000004:00080000:2.0:1789760646.355635:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 5 rpc_version 5 00000020:00100000:2.0:1789760646.355660:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760646.355669:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e57fad0700 x1876699798164096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760646.355685:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798164096:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789760646.355721:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760646.355742:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789760646.356327:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798164096 00000100:00100000:1.0:1789760646.356345:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798164096 00000100:00100000:1.0:1789760646.356428:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760646.356437:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7275:x1876699798164096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789760646.360348:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7275:x1876699798164096:12345-0@lo:1000:osp_up0-1.0 Request processed in 3722us (4436us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789760646.360367:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789760646.360557:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798164096:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1789760646.360725:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789760646.360756:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360769:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360777:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360784:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ea00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760646.360830:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360840:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360858:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:1.0:1789760646.360862:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760646.360867:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360874:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398572a1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360901:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360918:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360925:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360944:0:12655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789760646.360962:0:12655:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760646.360970:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360977:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.360983:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.361001:0:12655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1789760646.361005:0:12655:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760646.361011:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.361020:0:12655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.361446:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789760646.361456:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.361465:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f600 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:2.0:1789760646.361470:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760646.361478:0:6454:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.361514:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760646.361521:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.361527:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687000 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:2.0:1789760646.361535:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.361537:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.361543:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00010000:0.0:1789760646.361545:0:6453:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.361564:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.361567:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.361571:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760646.361575:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f600/0xc2b9a3a739857293 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985729a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.361587:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.361595:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e44c687000/0xc2b9a3a739857277 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985727e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.361605:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760646.361605:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760646.361607:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760646.361609:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760646.361613:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760646.361615:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760646.361628:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44bc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798164352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760646.361701:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798164224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760646.361858:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11454:x1876699777123968:12345-192.168.203.38@tcp:36:rm.0 Request processed in 17845us (18160us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789760646.361877:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:0.0:1789760646.371052:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760646.371382:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798164352 00000100:00100000:1.0:1789760646.371395:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798164352 00000100:00100000:1.0:1789760646.371479:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789760646.371491:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3463:x1876699798164352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760646.371509:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760646.371541:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a73985727e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739857277 expref: 10 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760646.371564:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760646.371570:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760646.371642:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3463:x1876699798164352:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760646.371650:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760646.371933:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44bc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798164352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760646.372859:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760646.373405:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798164224 00000100:00100000:0.0:1789760646.373416:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798164224 00000100:00100000:0.0:1789760646.373585:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760646.373597:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3462:x1876699798164224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760646.373615:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760646.373646:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e200/0xc2b9a3a73985729a lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739857293 expref: 9 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760646.373691:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:0.0:1789760646.373710:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760646.373785:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3462:x1876699798164224:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.373823:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789760646.373918:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798164224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760646.664767:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760647.251425:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.251549:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777124224 00000100:00100000:0.0:1789760647.251559:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777124224 00000100:00100000:0.0:1789760647.251631:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:0.0:1789760647.251643:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11465:x1876699777124224:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:0.0:1789760647.251661:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760647.251683:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686a00/0xc2b9a3a7398572a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119cd expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.251742:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687000/0xc2b9a3a7398572af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760647.251859:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789760647.251989:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687000/0xc2b9a3a7398572af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.252007:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687000/0xc2b9a3a7398572af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760647.252042:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760647.252046:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760647.252066:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687000/0xc2b9a3a7398572af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.252096:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686a00/0xc2b9a3a7398572a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119cd expref: 7 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.252122:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687000/0xc2b9a3a7398572af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119cd expref: 6 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.252132:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760647.252135:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760647.252138:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e44c687000, rc 0) 00000100:00100000:0.0:1789760647.252229:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11465:x1876699777124224:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 588us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760647.252237:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1789760647.255012:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.255054:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777124480 00000100:00100000:0.0:1789760647.255065:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777124480 00000100:00100000:0.0:1789760647.255124:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:0.0:1789760647.255135:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11465:x1876699777124480:12345-192.168.203.38@tcp:36:mkdir.0 00010000:00010000:0.0:1789760647.255188:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760647.255214:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687000/0xc2b9a3a7398572af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119cd expref: 6 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.255232:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760647.255237:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760647.255305:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.255319:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.255329:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.255352:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.255362:0:6465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a73985728c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857285 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.255370:0:6465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.255401:0:6465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a73985728c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739857285 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760647.255417:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44bc45880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6465:1876699798164480:0@lo:104: 00000100:00100000:0.0:1789760647.255473:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760647.255523:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e581de5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760647.255528:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798164480 00000100:00100000:2.0:1789760647.255534:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798164480 00000100:00100000:2.0:1789760647.255572:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789760647.255590:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6465:x1876699798164480:12345-0@lo:104: 00010000:00010000:2.0:1789760647.255603:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.255666:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760647.255672:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6465:x1876699798164480:12345-0@lo:104: Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.255679:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789760647.255698:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760647.255704:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.255726:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:2.0:1789760647.255732:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760647.255741:0:6453:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.255768:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.255775:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760647.255837:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.255846:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fd8f400/0xc2b9a3a739857285 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a73985728c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.255863:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760647.255865:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760647.255867:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760647.255878:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798164608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789760647.255907:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760647.255941:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798164608 00000100:00100000:2.0:1789760647.255944:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798164608 00010000:00010000:2.0:1789760647.255960:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a73985728c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc2b9a3a739857285 expref: 8 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.255993:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789760647.256000:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3464:x1876699798164608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.256010:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789760647.256247:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44bc45880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6465:1876699798164480:0@lo:104: 00010000:00010000:1.0:1789760647.256267:0:6465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760647.304082:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00010000:00010000:2.0:1789760647.314677:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a73985728c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739857285 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.314698:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5820ee500) 00010000:00010000:2.0:1789760647.314703:0:6450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.314713:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.314721:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.314746:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.314848:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798164608:12345-0@lo:103:ldlm_bl.0 Request processed in 58846us (58938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.314857:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789760647.314913:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798164608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.316903:0:6465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.316919:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318055:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318077:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318089:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760647.318105:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c5fce31 reply state 000000006085e9bd transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318115:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318125:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:2.0:1789760647.318128:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760647.318132:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760647.318138:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00010000:00010000:2.0:1789760647.318146:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318152:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318158:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318164:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760647.318169:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318176:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318198:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760647.318200:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.318204:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318211:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687600/0xc2b9a3a7398572b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760647.318223:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c5fce31 reply state 000000006085e9bd transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318231:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.318236:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5820ee500) 00010000:00010000:2.0:1789760647.318238:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760647.318240:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789760647.318333:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11465:x1876699777124480:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 63196us (63325us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789760647.318341:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:3.0:1789760647.345094:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760647.345672:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777124608 00000100:00100000:1.0:1789760647.345682:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777124608 00000100:00100000:2.0:1789760647.348045:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:2.0:1789760647.348069:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11466:x1876699777124608:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760647.348095:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760647.348117:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a7398572cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119d4 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.348183:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a7398572d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.348214:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a7398572d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.348226:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a7398572d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760647.348261:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760647.348265:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760647.348288:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a7398572d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.348312:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a7398572cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119d4 expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.348329:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a7398572d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119d4 expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.348336:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760647.348339:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760647.348342:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00000, rc 0) 00000100:00100000:2.0:1789760647.348413:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11466:x1876699777124608:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 355us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.348421:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:0.0:1789760647.357733:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760647.357848:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777124864 00000100:00100000:1.0:1789760647.357859:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777124864 00000100:00100000:1.0:1789760647.357922:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:1.0:1789760647.357932:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11466:x1876699777124864:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1789760647.357968:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760647.357971:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789760647.357997:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a7398572d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119d4 expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.358016:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760647.358021:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760647.358034:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e400/0xc2b9a3a7398572d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119db expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.358167:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.358180:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.358191:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.358202:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.358209:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.358217:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359484:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359500:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359527:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760647.359658:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00010000:00010000:2.0:1789760647.359682:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359689:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359695:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359701:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760647.359706:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359713:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359724:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:2.0:1789760647.359727:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.359731:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359736:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398572ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359756:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359762:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359776:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359781:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359873:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760647.359877:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359883:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359891:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760647.359893:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.359896:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359902:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e600/0xc2b9a3a7398572e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359913:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359918:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359924:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359928:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760647.359938:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359944:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359952:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5820ee500) 00010000:00010000:2.0:1789760647.359954:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.359957:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359962:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f000/0xc2b9a3a7398572e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.359997:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e400/0xc2b9a3a7398572d9 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119db expref: 8 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.360007:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760647.360009:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.360013:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e400/0xc2b9a3a7398572d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119db expref: 8 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.360022:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8e400, rc 0) 00000100:00100000:2.0:1789760647.360249:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11466:x1876699777124864:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2316us (2524us total) trans 0 rc 301/301 00000100:00100000:2.0:1789760647.360258:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1789760647.364070:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.364160:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777124992 00000100:00100000:2.0:1789760647.364170:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777124992 00000100:00100000:2.0:1789760647.364231:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:2.0:1789760647.364241:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11466:x1876699777124992:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760647.364276:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760647.364305:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a7398572f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119e2 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.364371:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398572fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.364387:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398572fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.364397:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398572fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760647.364430:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760647.364435:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760647.364690:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398572fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.364722:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a7398572f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119e2 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.364854:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398572fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119e2 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.364866:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760647.364869:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760647.364872:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00e00, rc 0) 00000100:00100000:2.0:1789760647.364933:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11466:x1876699777124992:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 692us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.364941:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:2.0:1789760647.380010:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.380046:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777125248 00000100:00100000:2.0:1789760647.380055:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777125248 00000100:00100000:2.0:1789760647.380115:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:2.0:1789760647.380126:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11466:x1876699777125248:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760647.380145:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760647.380164:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857303 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119e9 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380234:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380247:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380258:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380268:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380275:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380282:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760647.380376:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00010000:00010000:2.0:1789760647.380457:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380839:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380859:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380866:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380872:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760647.380877:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380886:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380900:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760647.380903:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.380908:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380915:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a73985730a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380929:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380935:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380941:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380946:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760647.380955:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380962:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380971:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5820ee500) 00010000:00010000:2.0:1789760647.380974:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.380977:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.380983:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857311 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.381018:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857303 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119e9 expref: 10 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.381028:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760647.381031:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760647.381034:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857303 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119e9 expref: 10 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.381044:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00400, rc 0) 00000100:00100000:2.0:1789760647.381102:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+9:11466:x1876699777125248:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 977us (1100us total) trans 4294967316 rc 301/301 00000100:00100000:2.0:1789760647.381110:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:2.0:1789760647.401367:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.401398:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777125504 00000100:00100000:2.0:1789760647.401407:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777125504 00000100:00100000:2.0:1789760647.401452:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1789760647.401471:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+9:11466:x1876699777125504:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:2.0:1789760647.401555:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.401573:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.401586:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760647.401820:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f321277e reply state 000000006877c09f transno 4294967317 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.401834:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.401842:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:2.0:1789760647.401845:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1789760647.401848:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760647.401855:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00000100:00100000:2.0:1789760647.403753:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11466:x1876699777125504:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 2273us (2384us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789760647.403765:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1789760647.416429:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.416473:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777125760 00000100:00100000:2.0:1789760647.416483:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777125760 00000100:00100000:2.0:1789760647.416555:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1789760647.416565:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11466:x1876699777125760:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1789760647.424455:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11466:x1876699777125760:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 7884us (8029us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789760647.424478:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:1.0:1789760647.445910:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.445983:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777125888 00000100:00100000:0.0:1789760647.445992:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777125888 00000100:00100000:0.0:1789760647.446042:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:0.0:1789760647.446238:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11467:x1876699777125888:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:0.0:1789760647.446264:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760647.446286:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686e00/0xc2b9a3a739857326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119f0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.446346:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.446359:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.446383:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.446552:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.446561:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.446569:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447445:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687200/0xc2b9a3a73985733b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447457:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687200/0xc2b9a3a73985733b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447466:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687200/0xc2b9a3a73985733b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760647.447500:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00000004:00200000:0.0:1789760647.447504:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760647.447524:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687200/0xc2b9a3a73985733b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447537:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447543:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447561:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447568:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760647.447572:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447582:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447594:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760647.447771:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760647.447777:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447783:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985732d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447819:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447825:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447830:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447836:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760647.447839:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447854:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447863:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5820ee500) 00010000:00010000:0.0:1789760647.447866:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760647.447869:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447874:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857334 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447904:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686e00/0xc2b9a3a739857326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119f0 expref: 14 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447918:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687200/0xc2b9a3a73985733b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119f0 expref: 13 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.447924:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:0.0:1789760647.447926:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760647.447929:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e44c687200, rc 0) 00000100:00100000:0.0:1789760647.448037:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11467:x1876699777125888:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 1986us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760647.448044:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1789760647.455373:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.459343:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777126144 00000100:00100000:2.0:1789760647.459357:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777126144 00000100:00100000:2.0:1789760647.459426:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:2.0:1789760647.459437:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11467:x1876699777126144:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:2.0:1789760647.459486:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.459511:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687200/0xc2b9a3a73985733b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119f0 expref: 13 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.460259:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:2.0:1789760647.460266:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760647.460764:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.460781:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.461051:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760647.467195:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b110c789 reply state 0000000052d73e8c transno 4294967319 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.467221:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.467230:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:3.0:1789760647.467233:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789760647.467237:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760647.467249:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00000100:00100000:3.0:1789760647.467473:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11467:x1876699777126144:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 8034us (12104us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789760647.467483:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000001:00080000:2.0:1789760647.488967:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1789760647.488998:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1789760647.494717:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1789760647.494750:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1789760647.513657:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.514067:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777126272 00000100:00100000:2.0:1789760647.514077:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777126272 00000100:00100000:2.0:1789760647.514351:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:2.0:1789760647.514363:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11468:x1876699777126272:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:2.0:1789760647.514385:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760647.514404:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857349 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119f7 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514542:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514557:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514568:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514579:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514586:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514594:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514676:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985735e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514685:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985735e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514693:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985735e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760647.514718:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00000004:00200000:2.0:1789760647.514721:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760647.514740:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985735e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514762:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514769:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514777:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.514783:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760647.515713:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515728:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515743:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760647.515746:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.515750:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515758:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857350 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515774:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515780:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515833:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515851:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760647.515854:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515860:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515869:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5820ee500) 00010000:00010000:2.0:1789760647.515871:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760647.515874:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515879:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857357 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515922:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857349 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119f7 expref: 16 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515937:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985735e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119f7 expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.515943:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:2.0:1789760647.515946:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789760647.515948:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00a00, rc 0) 00000100:00100000:3.0:1789760647.516082:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11468:x1876699777126272:12345-192.168.203.38@tcp:101:touch.0 Request processed in 1718us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760647.516091:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:1.0:1789760647.536393:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.537879:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777126528 00000100:00100000:0.0:1789760647.537892:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777126528 00000100:00100000:0.0:1789760647.537962:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:0.0:1789760647.537986:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11468:x1876699777126528:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:0.0:1789760647.538007:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760647.538027:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857365 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e652119fe expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.538146:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.538160:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.538171:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.538185:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.538193:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.538199:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760647.542217:0:6465:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789760647.542429:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e400/0xc2b9a3a73985737a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542446:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e400/0xc2b9a3a73985737a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542521:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e400/0xc2b9a3a73985737a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542642:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542650:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542657:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542662:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760647.542667:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542779:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542940:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:1.0:1789760647.542943:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760647.542946:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542953:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686000/0xc2b9a3a73985736c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760647.542978:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009867b688 reply state 00000000b0a7b047 transno 4294967320 ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542990:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.542996:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x4009f790 (ffff97e5489b1100) 00010000:00010000:1.0:1789760647.542998:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760647.543001:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789760647.543035:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a739857365 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119fe expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.543048:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e400/0xc2b9a3a73985737a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119fe expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.543054:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e5461f2900) 00010000:00010000:1.0:1789760647.543057:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760647.543059:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8e400, rc 0) 00000100:00100000:1.0:1789760647.543218:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11468:x1876699777126528:12345-192.168.203.38@tcp:101:touch.0 Request processed in 5234us (6833us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789760647.543228:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:1.0:1789760647.551245:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760647.551383:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777126784 00000100:00100000:3.0:1789760647.551393:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777126784 00000100:00100000:3.0:1789760647.551483:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:3.0:1789760647.551494:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11468:x1876699777126784:12345-192.168.203.38@tcp:36:touch.0 00010000:00010000:3.0:1789760647.551563:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760647.551603:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8e400/0xc2b9a3a73985737a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119fe expref: 18 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.551623:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e5461f2900) 00010000:00010000:3.0:1789760647.551634:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760647.551690:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.551705:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.551714:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760647.551878:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009097d446 reply state 0000000035e2c556 transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.551890:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.551897:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:3.0:1789760647.551900:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789760647.551902:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760647.551998:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11468:x1876699777126784:12345-192.168.203.38@tcp:36:touch.0 Request processed in 505us (762us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789760647.552006:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:2.0:1789760647.554582:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760647.554663:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777126912 00000100:00100000:3.0:1789760647.554683:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777126912 00000100:00100000:3.0:1789760647.554740:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:3.0:1789760647.554749:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11468:x1876699777126912:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:3.0:1789760647.554821:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760647.554843:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a73985738f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a05 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.554896:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a73985738f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a05 expref: 20 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.554910:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a73985738f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a05 expref: 20 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.554929:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:3.0:1789760647.554932:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789760647.554935:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dd000, rc 0) 00000100:00100000:3.0:1789760647.554985:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11468:x1876699777126912:12345-192.168.203.38@tcp:101:touch.0 Request processed in 237us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760647.554992:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:2.0:1789760647.559091:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.559185:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777127040 00000100:00100000:0.0:1789760647.559194:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777127040 00000100:00100000:0.0:1789760647.559270:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:0.0:1789760647.559279:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777127040:12345-192.168.203.38@tcp:2:touch.0 00000100:00100000:0.0:1789760647.561782:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777127040:12345-192.168.203.38@tcp:2:touch.0 Request processed in 2495us (2690us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789760647.561819:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00080000:3.0:1789760647.561967:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760647.602165:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.602312:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777127296 00000100:00100000:0.0:1789760647.602322:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777127296 00000100:00100000:0.0:1789760647.602378:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1789760647.602389:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11468:x1876699777127296:12345-192.168.203.38@tcp:35:touch.0 00000100:00100000:0.0:1789760647.602725:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+21:11468:x1876699777127296:12345-192.168.203.38@tcp:35:touch.0 Request processed in 337us (568us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789760647.602732:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1789760647.617277:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760647.617378:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777127424 00000100:00100000:1.0:1789760647.617388:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777127424 00000100:00100000:1.0:1789760647.617446:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:1.0:1789760647.617456:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+21:11469:x1876699777127424:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:1.0:1789760647.617503:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760647.617523:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a739857396 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a0c expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617592:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617606:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617617:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617629:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617637:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617644:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617726:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398573ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617735:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398573ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617741:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398573ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760647.617772:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 0 00000004:00200000:1.0:1789760647.617781:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789760647.617850:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398573ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617862:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398573ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617869:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617874:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617881:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617888:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ec00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760647.617892:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617899:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617910:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:1.0:1789760647.617912:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760647.617916:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617923:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ec00/0xc2b9a3a73985739d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617935:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617951:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617957:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617963:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760647.617966:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617972:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617980:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x4009f790 (ffff97e5489b1100) 00010000:00010000:1.0:1789760647.617983:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760647.617985:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.617991:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f400/0xc2b9a3a7398573a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.618017:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a739857396 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a0c expref: 23 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.618029:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398573ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a0c expref: 22 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.618037:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:1.0:1789760647.618040:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760647.618048:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd8ea00, rc 0) 00000100:00100000:1.0:1789760647.618099:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+22:11469:x1876699777127424:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 644us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.618107:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:1.0:1789760647.627405:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.627457:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777127552 00000100:00100000:0.0:1789760647.627467:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777127552 00000100:00100000:0.0:1789760647.627524:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1789760647.627534:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777127552:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:0.0:1789760647.627551:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760647.627571:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a13 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760647.627594:0:8110:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aad9487, atime: 0x6aad9487, ctime: 0x6aad9487, blocks: 0x1 00010000:00010000:0.0:1789760647.627614:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1789760647.627620:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760647.627629:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 7 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.627649:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 7 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.627663:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e44c686c00, rc 0) 00000100:00100000:0.0:1789760647.627728:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777127552:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 195us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760647.627748:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1789760647.634914:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760647.635845:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777127808 00000100:00100000:3.0:1789760647.635856:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777127808 00000100:00100000:3.0:1789760647.635926:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:3.0:1789760647.635937:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+22:11469:x1876699777127808:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:3.0:1789760647.635989:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760647.636016:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8ea00/0xc2b9a3a7398573ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a0c expref: 22 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.636036:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:3.0:1789760647.636041:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760647.636093:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.636107:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.636117:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760647.636723:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8f4ff0d reply state 000000009a3b2b50 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.636739:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.636746:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:3.0:1789760647.636749:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789760647.636752:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760647.636917:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11469:x1876699777127808:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 980us (2009us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789760647.636924:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:2.0:1789760647.642149:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760647.642279:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777127936 00000100:00100000:1.0:1789760647.642290:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777127936 00000100:00100000:1.0:1789760647.642391:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:1.0:1789760647.642402:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e581c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777127936:12345-192.168.203.38@tcp:2:chmod.0 00002000:00010000:1.0:1789760647.642598:0:8112:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760647.642602:0:8112:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760647 -> 1789760647 00002000:00010000:1.0:1789760647.642605:0:8112:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 1789760647 -> 1789760647 00002000:00010000:1.0:1789760647.642607:0:8112:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760647 -> 1789760647 00002000:00010000:1.0:1789760647.642610:0:8112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760647.642672:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e581c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777127936:12345-192.168.203.38@tcp:2:chmod.0 Request processed in 271us (530us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789760647.642680:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00010000:00010000:2.0:1789760647.689411:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760647.720884:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.721682:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777128192 00000100:00100000:0.0:1789760647.721693:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777128192 00000100:00100000:0.0:1789760647.721762:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:0.0:1789760647.721773:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11475:x1876699777128192:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760647.722169:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760647.722192:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687400/0xc2b9a3a7398573c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a1a expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722380:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722396:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722409:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722421:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722428:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722435:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722495:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a7398573d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722513:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a7398573d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.722520:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a7398573d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760647.722996:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 0 00010000:00010000:0.0:1789760647.723090:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723098:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723105:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723112:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723117:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760647.723121:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723128:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723141:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:0.0:1789760647.723144:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760647.723148:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723154:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686200/0xc2b9a3a7398573c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723175:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723180:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723186:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723191:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760647.723194:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723200:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723207:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x4009f790 (ffff97e5489b1100) 00010000:00010000:0.0:1789760647.723209:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760647.723211:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723216:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686400/0xc2b9a3a7398573ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723268:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687400/0xc2b9a3a7398573c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a1a expref: 26 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723282:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a7398573d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a1a expref: 25 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.723300:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:0.0:1789760647.723302:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760647.723318:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e44c687a00, rc 0) 00000100:00100000:0.0:1789760647.723438:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11475:x1876699777128192:12345-192.168.203.38@tcp:101:dd.500 Request processed in 1667us (2561us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789760647.723446:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:2.0:1789760647.729903:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760647.730076:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777128448 00000100:00100000:1.0:1789760647.730087:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777128448 00000100:00100000:1.0:1789760647.730156:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:1.0:1789760647.730166:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11475:x1876699777128448:12345-192.168.203.38@tcp:36:dd.500 00010000:00010000:1.0:1789760647.730228:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760647.730255:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687a00/0xc2b9a3a7398573d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a1a expref: 25 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.730276:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:1.0:1789760647.730281:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760647.731207:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.731226:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.731237:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760647.731294:0:12655:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000004:00010000:1.0:1789760647.731401:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c22d096 reply state 00000000df123a87 transno 4294967326 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.731414:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.731422:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:1.0:1789760647.731425:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760647.731427:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760647.731776:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11475:x1876699777128448:12345-192.168.203.38@tcp:36:dd.500 Request processed in 1608us (1879us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789760647.731820:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000020:00080000:1.0:1789760647.731826:0:12655:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789760647.744485:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.744966:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777128576 00000100:00100000:0.0:1789760647.744977:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777128576 00000100:00100000:0.0:1789760647.745096:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1789760647.745107:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11475:x1876699777128576:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760647.745130:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760647.745149:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a21 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.745180:0:13387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 9 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.745200:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760647.745205:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760647.745210:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 9 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.745243:0:13387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 9 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.745275:0:13387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 9 pid: 8110 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760647.745289:0:13387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44bc47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13387:1876699798164736:192.168.203.38@tcp:104: 00000100:00100000:0.0:1789760647.745384:0:13387:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e581de5540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760647.753940:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.754025:0:13387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44bc47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13387:1876699798164736:192.168.203.38@tcp:104: 00010000:00010000:0.0:1789760647.754056:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 9 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.754078:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e44c687400, rc 0) 00000100:00100000:0.0:1789760647.754136:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+9:11475:x1876699777128576:12345-192.168.203.38@tcp:101:dd.500 Request processed in 9031us (9660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760647.754147:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:3.0:1789760647.754151:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777128704 00000100:00100000:3.0:1789760647.754159:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777128704 00010000:00010000:3.0:1789760647.754191:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 9 pid: 8110 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.754234:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1789760647.754243:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777128704:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760647.754256:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760647.754262:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 9 pid: 8110 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.755361:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 9 pid: 8110 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.755389:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398573b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a13 expref: 9 pid: 8110 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.755405:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760647.755410:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760647.755416:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 8 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.755427:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 8 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.755475:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 8 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.755492:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449016d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798164864:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760647.755567:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f87ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760647.760259:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449016d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798164864:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760647.760543:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:0.0:1789760647.760597:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760647.760652:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777128704:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 6409us (6719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760647.760662:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1789760647.760991:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777128832 00000100:00100000:3.0:1789760647.760998:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777128832 00002000:00010000:3.0:1789760647.761032:0:13388:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2 (0->18446744073709551615) 00002000:00100000:3.0:1789760647.761037:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44c6dc700 with x1876699777128832 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760647.761048:0:13388:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44c6dc700. 00000100:00100000:3.0:1789760647.761074:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 322022527203 time 322022808798 state 0x0 ref 1 00000100:00100000:3.0:1789760647.761085:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 322222808798 time 322022808798 state 0x1 ref 1 00000100:00100000:3.0:1789760647.761116:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 2 deadline 322222808798 time 323945325292 state 0x0 ref 1 00000100:00100000:3.0:1789760647.761128:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777128832:12345-192.168.203.38@tcp:10:dd.500 00002000:00010000:3.0:1789760647.761408:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789760647.761412:0:13388:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760647 -> 1789760647 00002000:00010000:3.0:1789760647.761414:0:13388:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 1789760647 -> 1789760647 00002000:00010000:3.0:1789760647.761417:0:13388:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760647 -> 1789760647 00002000:00010000:3.0:1789760647.761419:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789760647.761450:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777128832:12345-192.168.203.38@tcp:10:dd.500 Request processed in 324us (907us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789760647.761458:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1789760647.761463:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 2 deadline 322222808798 time 323945325292 state 0x2 ref 0 00002000:00010000:3.0:1789760647.761469:0:13388:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2 (0->18446744073709551615) 00002000:00100000:3.0:1789760647.761471:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44c6dc700 with x1876699777128832 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760647.761476:0:13388:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44c6dc700. 00000100:00100000:2.0:1789760647.772698:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760647.773451:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777128960 00000100:00100000:1.0:1789760647.773589:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777128960 00000100:00100000:1.0:1789760647.773657:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 2 deadline 322222808798 time 323945325292 state 0x0 ref 1 00000100:00100000:1.0:1789760647.773671:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 2 deadline 324145325292 time 323945325292 state 0x1 ref 1 00000100:00100000:1.0:1789760647.773704:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 1 deadline 324145325292 time 323957913229 state 0x0 ref 1 00000100:00100000:1.0:1789760647.773718:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2405:x1876699777128960:12345-192.168.203.38@tcp:4:dd.500 00010000:00010000:1.0:1789760647.773777:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.773828:0:8120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 9 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.773836:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760647.775259:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789760647.775266:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.775330:0:8120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 9 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.775345:0:8120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 9 pid: 13387 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760647.775359:0:8120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c681180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8120:1876699798164992:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760647.775445:0:8120:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760647.784027:0:8120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c681180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8120:1876699798164992:192.168.203.38@tcp:104: 00010000:00010000:1.0:1789760647.784056:0:8120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.784999:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.785305:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777129088 00000100:00100000:0.0:1789760647.785380:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777129088 00010000:00010000:0.0:1789760647.785418:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 10 pid: 13387 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760647.785567:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1789760647.785578:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545670050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2404:x1876699777129088:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760647.785592:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760647.785613:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 10 pid: 13387 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.785627:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 10 pid: 13387 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.785651:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398573ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a21 expref: 10 pid: 13387 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.785667:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789760647.785671:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789760647.785678:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.785687:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.785718:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760647.785776:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545670050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777129088:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 199us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760647.785784:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00010000:00010000:1.0:1789760647.785930:0:8120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.785950:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760647.871411:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1789760647.871429:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00002000:00010000:1.0:1789760647.871566:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1789760647.871571:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789760647.871584:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.871597:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.871605:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.871612:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760647.871617:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.871624:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.871645:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.871653:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a7398573f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760647.871770:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777128960:12345-192.168.203.38@tcp:4:dd.500 Request processed in 98052us (99078us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789760647.871780:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1789760647.871821:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 1 deadline 324145325292 time 323957913229 state 0x2 ref 0 00000100:00100000:2.0:1789760647.878924:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.878960:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777129216 00000100:00100000:2.0:1789760647.878970:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777129216 00000100:00100000:2.0:1789760647.879024:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 1 deadline 324145325292 time 323957913229 state 0x0 ref 1 00000100:00100000:2.0:1789760647.879037:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 1 deadline 324157913229 time 323957913229 state 0x1 ref 1 00000100:00100000:2.0:1789760647.879059:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324157913229 time 324063268725 state 0x0 ref 1 00000100:00100000:2.0:1789760647.879073:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777129216:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760647.879120:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 1048576, mtime: 0x6aad9487, atime: 0x6aad9487, ctime: 0x6aad9487, blocks: 0x803 00010000:00010000:2.0:1789760647.879129:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.879144:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1789760647.879149:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760647.879155:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.879169:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760647.879469:0:9532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 324063679655ns, next at 325063677458ns, rc = 0 00000100:00100000:3.0:1789760647.879499:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798165120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760647.880495:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760647.880585:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760647.880595:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44bc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798165248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760647.880637:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.880991:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798165376:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.881025:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.881053:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798165888:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.881077:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.881094:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798166400:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.881115:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.881132:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789760647.881137:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798165504:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.881159:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.881174:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798166016:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.881194:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.881209:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798166528:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.881228:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.881256:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798165376 00000100:00100000:1.0:1789760647.881263:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798165376 00000100:00100000:1.0:1789760647.881322:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789760647.881331:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798165376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.881379:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798165376:12345-0@lo:400:kworker.0 Request processed in 48us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.881396:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789760647.881428:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798165888 00000100:00100000:1.0:1789760647.881432:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798165888 00000100:00100000:1.0:1789760647.881900:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789760647.881911:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798165888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.881947:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798165888:12345-0@lo:400:kworker.0 Request processed in 39us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.881952:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789760647.881973:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798166400 00000100:00100000:1.0:1789760647.881977:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798166400 00000100:00100000:1.0:1789760647.882014:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789760647.882021:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798166400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882051:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798166400:12345-0@lo:400:kworker.0 Request processed in 31us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.882057:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789760647.882073:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798165504 00000100:00100000:1.0:1789760647.882077:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798165504 00000100:00100000:1.0:1789760647.882099:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798166016 00000100:00100000:1.0:1789760647.882102:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798166016 00000100:00100000:1.0:1789760647.882121:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798166528 00000100:00100000:1.0:1789760647.882124:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798166528 00000100:00100000:1.0:1789760647.882138:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789760647.882144:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798165504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882174:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798165504:12345-0@lo:400:kworker.0 Request processed in 31us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.882180:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789760647.882190:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789760647.882204:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798166016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882230:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798166016:12345-0@lo:400:kworker.0 Request processed in 27us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.882236:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789760647.882247:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789760647.882253:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798166528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882277:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798166528:12345-0@lo:400:kworker.0 Request processed in 26us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.882283:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789760647.882524:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798165760:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882559:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.882581:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798166272:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882604:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.882620:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798166784:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882641:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.882661:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789760647.882667:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798165632:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882688:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.882703:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798166144:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882721:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.882735:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798166656:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.882754:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760647.882921:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798166272 00000100:00100000:1.0:1789760647.882927:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798166272 00000100:00100000:1.0:1789760647.882956:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798166784 00000100:00100000:1.0:1789760647.882966:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798166784 00000100:00100000:1.0:1789760647.882989:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789760647.882996:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798166272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883032:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798166272:12345-0@lo:400:kworker.0 Request processed in 37us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.883038:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789760647.883050:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789760647.883055:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798166784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883078:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798166784:12345-0@lo:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.883084:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789760647.883103:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798165632 00000100:00100000:1.0:1789760647.883106:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798165632 00000100:00100000:1.0:1789760647.883127:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789760647.883132:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798165632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883163:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798165632:12345-0@lo:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.883168:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789760647.883186:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798165760 00000100:00100000:1.0:1789760647.883189:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798165760 00000100:00100000:1.0:1789760647.883202:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798166144 00000100:00100000:1.0:1789760647.883204:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798166144 00000100:00100000:1.0:1789760647.883214:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798166656 00000100:00100000:1.0:1789760647.883216:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798166656 00000100:00100000:1.0:1789760647.883229:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789760647.883234:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798165760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883263:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798165760:12345-0@lo:400:kworker.0 Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.883278:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789760647.883291:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789760647.883297:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798166144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883544:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798166144:12345-0@lo:400:kworker.0 Request processed in 246us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.883551:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789760647.883563:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789760647.883568:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798166656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883594:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798166656:12345-0@lo:400:kworker.0 Request processed in 26us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760647.883599:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:1.0:1789760647.883616:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760647.883621:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760647.883623:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760647.883625:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760647.883665:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798165504:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883677:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798166016:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883687:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798166528:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883697:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798165376:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883707:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798165888:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883716:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798166400:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.883755:0:3462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967314 gen 2 00000004:00080000:1.0:1789760647.883761:0:3462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967314 committed transno 4294967314 00000100:00100000:1.0:1789760647.883999:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798165632:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.884012:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798166144:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.884022:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798166656:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.884031:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798165760:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.884040:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798166272:0@lo:400:kworker.0 00000100:00100000:1.0:1789760647.884048:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798166784:0@lo:400:kworker.0 00000100:00100000:2.0:1789760647.884404:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798165120 00000100:00100000:2.0:1789760647.884411:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798165120 00000100:00080000:0.0:1789760647.884536:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760647.884562:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798165248 00000100:00100000:2.0:1789760647.884566:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798165248 00000100:00100000:2.0:1789760647.884585:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789760647.884592:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798165120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760647.884620:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3843031040 avail 3840933888 00000100:00100000:2.0:1789760647.884662:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798165120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.884669:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789760647.884681:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789760647.884687:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798165248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760647.884696:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3843031040 avail 3840933888 00000100:00100000:2.0:1789760647.884719:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798165248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.884724:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789760647.888209:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44bc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798165248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760647.888230:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798165120:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1789760647.957230:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967331 is committed 00000004:00080000:2.0:1789760647.957245:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000004:00080000:2.0:1789760647.957261:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000001:00080000:2.0:1789760647.957284:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967332 is committed 00000020:00080000:2.0:1789760647.957291:0:7272:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97e542e216c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789760647.957296:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e57aff3d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97e542e21240 00000020:00080000:2.0:1789760647.957307:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].2 00000020:00080000:2.0:1789760647.957309:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e57aff3100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e448def400 00000020:00080000:2.0:1789760647.957312:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].2 00000004:00080000:2.0:1789760647.957341:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000020:00080000:2.0:1789760647.957354:0:7272:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 1 batchid updated 00000020:00080000:2.0:1789760647.957481:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 2 committed batchid 1 00000100:00100000:0.0:1789760647.957642:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798166912:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1789760647.957718:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789760647.957738:0:7284:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e448b03d80 with version 6 00000020:00080000:2.0:1789760647.957752:0:7284:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 1 cancel update log [0x200000401:0x2:0x0].1: rc = 0 00000100:00100000:0.0:1789760647.957764:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760647.957773:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798167040:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1789760647.957831:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760647.958080:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958091:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958100:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958108:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760647.958113:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958121:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958141:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x2ab29dc6 (ffff97e5489b1a00) 00010000:00010000:1.0:1789760647.958145:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760647.958150:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958157:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e44c686800/0xc2b9a3a739857246 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958189:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958197:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958203:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789760647.958209:0:7284:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 1 cancel update log [0x240000400:0x2:0x0].1: rc = 0 00010000:00010000:1.0:1789760647.958210:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760647.958215:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789760647.958221:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 1 00010000:00010000:1.0:1789760647.958224:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958235:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x151ecd9f (ffff97e5820ee200) 00000100:00100000:2.0:1789760647.958239:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798167168:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1789760647.958240:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760647.958244:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.958253:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00600/0xc2b9a3a739857262 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.958448:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789760647.958485:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 6 rpc_version 6 00000020:00100000:2.0:1789760647.958520:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760647.958530:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e44c6dc000 x1876699798167424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760647.958545:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798167424:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789760647.958548:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798166912 00000100:00100000:3.0:1789760647.958556:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798166912 00000100:00100000:2.0:1789760647.958582:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760647.958602:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798167040 00000100:00100000:2.0:1789760647.958606:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448b03600 going to sleep for 11 seconds 00000100:00100000:3.0:1789760647.958607:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798167040 00000100:00100000:3.0:1789760647.958631:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798167168 00000100:00100000:3.0:1789760647.958634:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798167168 00000100:00100000:3.0:1789760647.958650:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789760647.958659:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798166912:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1789760647.958684:0:9533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2 count 1 00010000:00010000:3.0:1789760647.958704:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958725:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 15 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958735:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958743:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958750:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958758:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958780:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 15 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958818:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 15 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958827:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.958835:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 15 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760647.958955:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789760647.958965:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798167040:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1789760647.958979:0:8112:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:3 count 1 00002000:00010000:0.0:1789760647.959000:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad9484, atime: 0x6aad9481, ctime: 0x6aad9484, blocks: 0x4007 00010000:00010000:0.0:1789760647.959006:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.959015:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1789760647.959020:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760647.959026:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.959040:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.959048:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.959055:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.959083:0:8112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789760647.959433:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789760647.959442:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798167168:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1789760647.959527:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.959538:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 15 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.959545:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789760647.959548:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760647.959552:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 14/0,1 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.959581:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 15 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.959603:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 15 pid: 9533 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.959616:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798167552:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.959693:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.959703:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 15 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.959714:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449015c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798167680:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.959753:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 15 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.959763:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 15 pid: 8114 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.959771:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798167808:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.959830:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.959839:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 15 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789760647.959938:0:8114:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789760647.959961:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 8388608, mtime: 0x6aad9483, atime: 0x6aad9481, ctime: 0x6aad9483, blocks: 0x4007 00010000:00010000:1.0:1789760647.959968:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.959983:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1789760647.959986:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760647.959991:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.960003:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.960012:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.960019:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760647.960036:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789760647.960538:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789760647.960547:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960556:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760647.960560:0:6453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960583:0:6453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960602:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960610:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc38276/0xc2b9a3a739857406 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960633:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760647.960638:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960647:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760647.960651:0:6453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960659:0:6453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960671:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960679:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985740d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.960707:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760647.960708:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760647.960711:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760647.960774:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3463:x1876699798167040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1810us (2941us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789760647.960784:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789760647.961414:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798167936:192.168.203.38@tcp:104: 00000004:00080000:2.0:1789760647.961450:0:3463:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e44c6de300/2, rc 0, transno 4294967323 00000100:00100000:2.0:1789760647.961708:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798167040:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1789760647.961736:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 15 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.961748:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 15 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.961758:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449017480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168064:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.961818:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 15 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.961828:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 15 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.961837:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449016d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168192:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760647.962219:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798167168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2777us (3770us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789760647.962228:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789760647.962262:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798167424 00000100:00100000:1.0:1789760647.962269:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798167424 00010000:00010000:3.0:1789760647.962417:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.962427:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 15 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.962436:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449017b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168320:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.962487:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.962497:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 15 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.962507:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449015500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168448:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.962536:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.962545:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 15 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.962555:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449016300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168576:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.962581:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 15 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.962590:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 15 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.962598:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168704:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.962623:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 15 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760647.962644:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 15 pid: 8110 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.962653:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543284380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168832:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.962673:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f87e840 going to sleep for 11 seconds 00010000:00010000:0.0:1789760647.962938:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789760647.963047:0:3461:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e449015f80/2, rc 0, transno 4294967326 00000100:00100000:2.0:1789760647.963069:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798167168:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1789760647.963273:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789760647.963294:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7275:x1876699798167424:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789760647.963623:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7275:x1876699798167424:12345-0@lo:1000:osp_up0-1.0 Request processed in 332us (5041us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789760647.963631:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789760647.963715:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798167424:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789760647.970162:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.970192:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.970213:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.970229:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.970276:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.970309:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.970333:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760647.970350:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.970363:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777129344 00000100:00100000:2.0:1789760647.970374:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777129344 00000100:00100000:0.0:1789760647.970393:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777129600 00000100:00100000:0.0:1789760647.970399:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777129600 00010000:00010000:0.0:1789760647.970423:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 17 pid: 8114 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.970423:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 17 pid: 9533 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760647.970516:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798167552:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970530:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449015c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798167680:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970536:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798167808:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970543:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798167936:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970550:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449017480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168064:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970557:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449016d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168192:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970565:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449017b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168320:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970571:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449015500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168448:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970578:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449016300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168576:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970602:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168704:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760647.970611:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543284380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798168832:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760647.970657:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760647.971019:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777129472 00000100:00100000:0.0:1789760647.971023:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777129472 00010000:00010000:0.0:1789760647.971036:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 18 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760647.972035:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760647.972068:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760647.975171:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.976090:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777129728 00000100:00100000:2.0:1789760647.976100:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777129728 00010000:00010000:2.0:1789760647.976137:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 19 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.976157:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777129856 00000100:00100000:2.0:1789760647.976160:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777129856 00010000:00010000:2.0:1789760647.976171:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 20 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.976181:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777130112 00000100:00100000:2.0:1789760647.976183:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777130112 00010000:00010000:2.0:1789760647.976193:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 21 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.976213:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777129984 00000100:00100000:2.0:1789760647.976216:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777129984 00010000:00010000:2.0:1789760647.976228:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 22 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.976238:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777130240 00000100:00100000:2.0:1789760647.976240:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777130240 00010000:00010000:2.0:1789760647.976250:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 23 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.976260:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777130368 00000100:00100000:2.0:1789760647.976262:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777130368 00010000:00010000:2.0:1789760647.976273:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 24 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.976286:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777130496 00000100:00100000:2.0:1789760647.976289:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777130496 00010000:00010000:2.0:1789760647.976303:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 25 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.976318:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777130624 00000100:00100000:2.0:1789760647.976320:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777130624 00010000:00010000:2.0:1789760647.976333:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 26 pid: 8110 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760647.976348:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:2.0:1789760647.976357:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+26:2406:x1876699777129600:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.976377:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.976384:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 26 pid: 8114 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976395:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 26 pid: 8114 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976416:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b763a0/0xc2b9a3a7398571d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211987 expref: 26 pid: 8114 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976431:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.976500:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+25:2406:x1876699777129600:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 144us (6306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.976507:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:2.0:1789760647.976527:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1789760647.976536:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+24:2406:x1876699777129344:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.976545:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.976552:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 24 pid: 9533 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976564:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 24 pid: 9533 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976579:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000661947c8/0xc2b9a3a7398571c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211972 expref: 24 pid: 9533 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976607:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.976633:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+23:2406:x1876699777129344:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 97us (6479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.976641:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1789760647.976661:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1789760647.976672:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+22:2406:x1876699777129728:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.976682:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.976687:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 22 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976698:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 22 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976712:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452e397c/0xc2b9a3a7398571e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521198e expref: 22 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976725:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.976750:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+21:2406:x1876699777129728:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 82us (6520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.976758:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1789760647.976777:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:2.0:1789760647.976785:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+20:2404:x1876699777129856:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.976826:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.976837:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 20 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976847:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 20 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976860:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000786ed12b/0xc2b9a3a7398571eb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211995 expref: 20 pid: 8112 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976869:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.976895:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+19:2404:x1876699777129856:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 112us (6619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.976901:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:2.0:1789760647.976914:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:2.0:1789760647.976920:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2404:x1876699777130112:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.976928:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.976931:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 18 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976940:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 18 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976952:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000737325dc/0xc2b9a3a7398571f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119a3 expref: 18 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.976961:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.976986:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+17:2404:x1876699777130112:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 66us (6684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.976992:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:2.0:1789760647.977006:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1789760647.977012:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548b19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+16:2404:x1876699777129984:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.977020:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.977024:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 16 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977033:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 16 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977046:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e46e366b/0xc2b9a3a7398571f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521199c expref: 16 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977056:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.977073:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548b19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+15:2404:x1876699777129984:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 61us (6741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.977081:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1789760647.977097:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1789760647.977103:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2404:x1876699777130240:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.977110:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.977115:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 14 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977134:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 14 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977146:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066df966c/0xc2b9a3a739857200 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119aa expref: 14 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977155:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.977193:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+13:2404:x1876699777130240:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 90us (6842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.977199:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1789760647.977213:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1789760647.977219:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2406:x1876699777130368:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.977226:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.977231:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 12 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977240:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 12 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977253:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004571fc92/0xc2b9a3a7398571dd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211980 expref: 12 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977262:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.977286:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2406:x1876699777130368:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 67us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.977300:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1789760647.977314:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:2.0:1789760647.977321:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2403:x1876699777130496:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.977329:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.977333:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 10 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977344:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 10 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977355:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c39e81a7/0xc2b9a3a739857207 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119b1 expref: 10 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977363:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.977383:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777130496:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 64us (5316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.977388:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:2.0:1789760647.977402:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:2.0:1789760647.977408:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2404:x1876699777130624:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760647.977414:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760647.977418:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 8 pid: 8110 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977425:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 8 pid: 8110 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977444:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000096a6395/0xc2b9a3a7398571c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e6521196b expref: 8 pid: 8110 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.977452:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760647.977468:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777130624:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 61us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760647.977474:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:0.0:1789760647.977829:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1789760647.977839:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777129472:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760647.977859:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760647.977871:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 6 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.977886:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 6 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.977901:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001acb3a7f/0xc2b9a3a7398571cf lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211979 expref: 6 pid: 13387 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.977916:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760647.977921:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760647.977927:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.977937:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.977965:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760647.977988:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777129472:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 151us (7774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760647.977995:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00010000:00010000:2.0:1789760647.978005:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.978016:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.978027:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.978035:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760647.978065:0:9533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760647.978270:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760647.978278:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.978296:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760647.978301:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.978329:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.978342:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.978348:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b59641e/0xc2b9a3a7398573ff lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.978368:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760647.978371:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760647.978372:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760647.978682:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3463:x1876699798166912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 20022us (20963us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789760647.978690:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:0.0:1789760647.979552:0:3463:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e44c6dfb80/2, rc 0, transno 4294967324 00000100:00100000:0.0:1789760647.979561:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798166912:0@lo:6:osp-syn-1-1.0 00002000:00010000:0.0:1789760647.985093:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1789760647.985103:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1789760647.985116:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.985130:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.985140:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.985164:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760647.985169:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.985177:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.985197:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760647.985205:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398573f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760647.985403:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:0.0:1789760647.986201:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777129216:12345-192.168.203.38@tcp:4:dd.500 Request processed in 106232us (106388us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789760647.986213:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:0.0:1789760647.986221:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324157913229 time 324063268725 state 0x2 ref 0 00000100:00100000:1.0:1789760647.993057:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760647.993147:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777130752 00000100:00100000:2.0:1789760647.993169:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777130752 00000100:00100000:2.0:1789760647.993217:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324157913229 time 324063268725 state 0x0 ref 1 00000100:00100000:2.0:1789760647.993231:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324263268725 time 324063268725 state 0x1 ref 1 00000100:00100000:2.0:1789760648.079151:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324263268725 time 324263350614 state 0x0 ref 1 00000100:00100000:2.0:1789760648.079186:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777130752:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760648.079246:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 2097152, mtime: 0x6aad9487, atime: 0x6aad9487, ctime: 0x6aad9487, blocks: 0x1007 00010000:00010000:2.0:1789760648.079255:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.079272:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1789760648.079277:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760648.079283:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.079297:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760648.141160:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00000001:00080000:0.0:1789760648.141687:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00002000:00010000:2.0:1789760648.141839:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789760648.141845:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789760648.141860:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.141873:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.141901:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.141908:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760648.141913:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.141923:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.141942:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.141950:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760648.142635:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777130752:12345-192.168.203.38@tcp:4:dd.500 Request processed in 63458us (149581us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789760648.142646:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1789760648.142654:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324263268725 time 324263350614 state 0x2 ref 0 00000100:00100000:0.0:1789760648.147560:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760648.147691:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777130880 00000100:00100000:2.0:1789760648.147701:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777130880 00000100:00100000:2.0:1789760648.147765:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324263268725 time 324263350614 state 0x0 ref 1 00000100:00100000:2.0:1789760648.147778:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324463350614 time 324263350614 state 0x1 ref 1 00000100:00100000:3.0:1789760648.279825:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324463350614 time 324463990569 state 0x0 ref 1 00000100:00100000:3.0:1789760648.279861:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777130880:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760648.279917:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 3145728, mtime: 0x6aad9487, atime: 0x6aad9487, ctime: 0x6aad9487, blocks: 0x1807 00010000:00010000:3.0:1789760648.279926:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.279942:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1789760648.279947:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760648.279954:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.279968:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760648.403110:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760648.403133:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798168960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760648.403198:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760648.403407:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798168960 00000100:00100000:1.0:1789760648.403416:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798168960 00000100:00100000:1.0:1789760648.403465:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789760648.403474:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3461:x1876699798168960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760648.403511:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760648.403566:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3461:x1876699798168960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760648.403573:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789760648.404740:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798168960:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1789760648.421403:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00002000:00010000:3.0:1789760648.421525:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1789760648.421531:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789760648.421546:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.421559:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.421567:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.421589:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760648.421595:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.421604:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.421623:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.421633:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985741b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760648.421731:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777130880:12345-192.168.203.38@tcp:4:dd.500 Request processed in 141881us (274175us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789760648.421741:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1789760648.421750:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324463350614 time 324463990569 state 0x2 ref 0 00000100:00100000:1.0:1789760648.444182:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760648.444298:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777131008 00000100:00100000:2.0:1789760648.444310:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777131008 00000100:00100000:2.0:1789760648.444365:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324463350614 time 324463990569 state 0x0 ref 1 00000100:00100000:2.0:1789760648.444379:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324663990569 time 324463990569 state 0x1 ref 1 00000100:00100000:3.0:1789760648.480308:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324663990569 time 324664508054 state 0x0 ref 1 00000100:00100000:3.0:1789760648.480342:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777131008:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760648.480400:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 4194304, mtime: 0x6aad9487, atime: 0x6aad9487, ctime: 0x6aad9487, blocks: 0x2007 00010000:00010000:3.0:1789760648.480410:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.480445:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1789760648.480457:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760648.480473:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.480488:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760648.607154:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00002000:00010000:3.0:1789760648.607505:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1789760648.607510:0:8118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760647 -> 1789760648 00002000:00010000:3.0:1789760648.607513:0:8118:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760647 -> 1789760648 00002000:00010000:3.0:1789760648.607515:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1789760648.607529:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.607542:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.607552:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.607559:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760648.607565:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.607574:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.607606:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.607614:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857422 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760648.607709:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777131008:12345-192.168.203.38@tcp:4:dd.500 Request processed in 127377us (163531us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789760648.607719:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1789760648.607727:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324663990569 time 324664508054 state 0x2 ref 0 00000100:00100000:2.0:1789760648.617896:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760648.618140:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777131136 00000100:00100000:0.0:1789760648.618149:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777131136 00000100:00100000:0.0:1789760648.618201:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324663990569 time 324664508054 state 0x0 ref 1 00000100:00100000:0.0:1789760648.618228:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324864508054 time 324664508054 state 0x1 ref 1 00000100:00100000:2.0:1789760648.681885:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324864508054 time 324866075915 state 0x0 ref 1 00000100:00100000:2.0:1789760648.681918:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777131136:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760648.681972:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 5242880, mtime: 0x6aad9488, atime: 0x6aad9487, ctime: 0x6aad9488, blocks: 0x2807 00010000:00010000:2.0:1789760648.681981:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.681996:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1789760648.682000:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760648.682005:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760648.682018:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760648.716165:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760648.758200:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00002000:00010000:0.0:1789760648.758312:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789760648.758318:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1789760648.758331:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.758344:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.758353:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.758360:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760648.758365:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.758374:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.758394:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.758402:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857429 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760648.758510:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777131136:12345-192.168.203.38@tcp:4:dd.500 Request processed in 76603us (140618us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789760648.758534:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:0.0:1789760648.758542:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324864508054 time 324866075915 state 0x2 ref 0 00000100:00100000:2.0:1789760648.770417:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760648.771399:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777131264 00000100:00100000:1.0:1789760648.772605:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777131264 00000100:00100000:0.0:1789760648.772751:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 324864508054 time 324866075915 state 0x0 ref 1 00000100:00100000:0.0:1789760648.772766:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325066075915 time 324866075915 state 0x1 ref 1 00000100:00100000:1.0:1789760648.891672:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325066075915 time 325075870749 state 0x0 ref 1 00000100:00100000:1.0:1789760648.891707:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777131264:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760648.891772:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 6291456, mtime: 0x6aad9488, atime: 0x6aad9487, ctime: 0x6aad9488, blocks: 0x3007 00010000:00010000:1.0:1789760648.891782:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760648.891825:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1789760648.891829:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760648.891847:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760648.891865:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760648.908309:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798169088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760648.908378:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760648.908545:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798169088 00000100:00100000:2.0:1789760648.908554:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798169088 00000100:00100000:2.0:1789760648.908607:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789760648.908617:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798169088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760648.908665:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760648.908719:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798169088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760648.908726:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789760648.908843:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798169088:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1789760648.983655:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00002000:00010000:0.0:1789760648.983889:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789760648.983894:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789760648.983909:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.983922:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.983930:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.983938:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760648.983943:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.983951:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.983997:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760648.984007:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857430 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760648.984107:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777131264:12345-192.168.203.38@tcp:4:dd.500 Request processed in 92411us (213693us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789760648.984117:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:0.0:1789760648.984126:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325066075915 time 325075870749 state 0x2 ref 0 00000100:00100000:2.0:1789760648.994465:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760648.994552:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777131392 00000100:00100000:3.0:1789760648.994561:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777131392 00000100:00100000:3.0:1789760648.994614:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325066075915 time 325075870749 state 0x0 ref 1 00000100:00100000:3.0:1789760648.994635:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325275870749 time 325075870749 state 0x1 ref 1 00000100:00100000:1.0:1789760649.091986:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325275870749 time 325276186243 state 0x0 ref 1 00000100:00100000:1.0:1789760649.092035:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777131392:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760649.092091:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 7340032, mtime: 0x6aad9488, atime: 0x6aad9487, ctime: 0x6aad9488, blocks: 0x3807 00010000:00010000:1.0:1789760649.092100:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.092123:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1789760649.092128:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760649.092134:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.092148:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760649.092396:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789760649.144499:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:1.0:1789760649.144508:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789760649.144523:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.144536:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.144546:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.144567:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760649.144572:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.144582:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.144604:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.144612:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857437 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760649.144713:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777131392:12345-192.168.203.38@tcp:4:dd.500 Request processed in 52704us (150264us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789760649.144723:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1789760649.144731:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325275870749 time 325276186243 state 0x2 ref 0 00000001:00080000:1.0:1789760649.144782:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967332 is committed 00000100:00100000:1.0:1789760649.160670:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760649.160774:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777131520 00000100:00100000:3.0:1789760649.160839:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777131520 00000100:00100000:3.0:1789760649.160919:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325275870749 time 325276186243 state 0x0 ref 1 00000100:00100000:3.0:1789760649.160935:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325476186243 time 325276186243 state 0x1 ref 1 00000100:00100000:1.0:1789760649.292159:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325476186243 time 325476360334 state 0x0 ref 1 00000100:00100000:1.0:1789760649.292194:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777131520:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760649.292251:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 8388608, mtime: 0x6aad9488, atime: 0x6aad9487, ctime: 0x6aad9488, blocks: 0x4007 00010000:00010000:1.0:1789760649.292324:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.292354:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1789760649.292359:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760649.292365:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.292379:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760649.416334:0:8431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 325600543595ns, next at 326600540545ns, rc = 0 00000100:00100000:3.0:1789760649.418311:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798169216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760649.418388:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1789760649.419595:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00000100:00100000:2.0:1789760649.420162:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798169216 00000100:00100000:2.0:1789760649.420170:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798169216 00000100:00100000:2.0:1789760649.420229:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789760649.420239:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798169216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760649.420260:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3841982464 avail 3831496704 00000100:00100000:2.0:1789760649.420332:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798169216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760649.420338:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1789760649.420358:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760649.420393:0:3464:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1789760649.420398:0:3464:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e449015f80, transno 4294967326 00000100:00100000:2.0:1789760649.420416:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798169216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760649.420642:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57d2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798169344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760649.420688:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760649.421228:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798169344 00000100:00100000:3.0:1789760649.421234:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798169344 00000100:00100000:3.0:1789760649.421277:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789760649.421285:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798169344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760649.421299:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3841982464 avail 3831496704 00000100:00100000:3.0:1789760649.421338:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798169344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760649.421345:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789760649.421378:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57d2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798169344:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760649.421748:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789760649.422008:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:0.0:1789760649.422013:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:0.0:1789760649.422026:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.422039:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.422047:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.422055:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760649.422060:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.422085:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.422106:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.422124:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985743e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760649.422208:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777131520:12345-192.168.203.38@tcp:4:dd.500 Request processed in 130029us (261545us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789760649.422217:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1789760649.422225:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325476186243 time 325476360334 state 0x2 ref 0 00000100:00100000:1.0:1789760649.431684:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760649.431823:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777131648 00000100:00100000:0.0:1789760649.431833:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777131648 00000100:00100000:0.0:1789760649.431896:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325476186243 time 325476360334 state 0x0 ref 1 00000100:00100000:0.0:1789760649.431909:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325676360334 time 325476360334 state 0x1 ref 1 00000100:00100000:2.0:1789760649.493130:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325676360334 time 325677328640 state 0x0 ref 1 00000100:00100000:2.0:1789760649.493163:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777131648:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760649.493220:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 9437184, mtime: 0x6aad9488, atime: 0x6aad9487, ctime: 0x6aad9488, blocks: 0x4807 00010000:00010000:2.0:1789760649.493229:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760649.493262:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1789760649.493266:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760649.493273:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760649.493288:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760649.563172:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00002000:00010000:0.0:1789760649.563275:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:0.0:1789760649.563280:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:0.0:1789760649.563294:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.563307:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.563334:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.563342:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760649.563346:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.563355:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.563374:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.563382:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857445 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760649.563946:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777131648:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70353us (131825us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789760649.563960:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:0.0:1789760649.563970:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325676360334 time 325677328640 state 0x2 ref 0 00000100:00100000:1.0:1789760649.570755:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760649.570887:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777131776 00000100:00100000:0.0:1789760649.570898:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777131776 00000100:00100000:0.0:1789760649.570952:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325676360334 time 325677328640 state 0x0 ref 1 00000100:00100000:0.0:1789760649.570964:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325877328640 time 325677328640 state 0x1 ref 1 00000100:00100000:2.0:1789760649.693296:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325877328640 time 325877495556 state 0x0 ref 1 00000100:00100000:2.0:1789760649.693330:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777131776:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760649.693392:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 10485760, mtime: 0x6aad9488, atime: 0x6aad9487, ctime: 0x6aad9488, blocks: 0x5007 00010000:00010000:2.0:1789760649.693401:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760649.693417:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1789760649.693422:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760649.693428:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760649.693442:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760649.739814:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789760649.779408:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1789760649.779416:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760648 -> 1789760649 00002000:00010000:1.0:1789760649.779419:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760648 -> 1789760649 00002000:00010000:1.0:1789760649.779421:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:1.0:1789760649.779661:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.779677:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.779687:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.779714:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760649.779719:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.779728:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.779748:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760649.779756:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985744c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760649.779910:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777131776:12345-192.168.203.38@tcp:4:dd.500 Request processed in 86592us (209158us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789760649.779921:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:1.0:1789760649.779928:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325877328640 time 325877495556 state 0x2 ref 0 00000001:00080000:1.0:1789760649.779969:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00000100:00100000:0.0:1789760649.783887:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760649.783984:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777131904 00000100:00100000:1.0:1789760649.783993:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777131904 00000100:00100000:1.0:1789760649.784043:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 325877328640 time 325877495556 state 0x0 ref 1 00000100:00100000:1.0:1789760649.784073:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326077495556 time 325877495556 state 0x1 ref 1 00000100:00100000:2.0:1789760649.893521:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326077495556 time 326077719689 state 0x0 ref 1 00000100:00100000:2.0:1789760649.893555:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777131904:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760649.893640:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 11534336, mtime: 0x6aad9489, atime: 0x6aad9487, ctime: 0x6aad9489, blocks: 0x5807 00010000:00010000:2.0:1789760649.893649:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760649.893667:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1789760649.893672:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760649.893691:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760649.893709:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760650.065266:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:1.0:1789760650.065277:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:1.0:1789760650.065305:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760650.065318:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760650.065328:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760650.065336:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760650.065340:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760650.065348:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760650.065369:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760650.065377:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857453 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760650.065483:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777131904:12345-192.168.203.38@tcp:4:dd.500 Request processed in 171940us (281599us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789760650.065495:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:1.0:1789760650.065505:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326077495556 time 326077719689 state 0x2 ref 0 00000001:00080000:1.0:1789760650.065544:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00000100:00100000:2.0:1789760650.083317:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760650.083400:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777132032 00000100:00100000:0.0:1789760650.083411:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777132032 00000100:00100000:0.0:1789760650.083479:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326077495556 time 326077719689 state 0x0 ref 1 00000100:00100000:0.0:1789760650.083492:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326277719689 time 326077719689 state 0x1 ref 1 00000100:00100000:2.0:1789760650.094600:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326277719689 time 326278798676 state 0x0 ref 1 00000100:00100000:2.0:1789760650.094636:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777132032:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760650.094695:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 12582912, mtime: 0x6aad9489, atime: 0x6aad9487, ctime: 0x6aad9489, blocks: 0x6007 00010000:00010000:2.0:1789760650.094706:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760650.094722:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1789760650.094727:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760650.094733:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760650.094749:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760650.215319:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00002000:00010000:3.0:1789760650.215390:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:3.0:1789760650.215396:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:3.0:1789760650.215411:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.215425:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.215434:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.215441:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760650.215446:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.215455:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.215490:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.215499:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985745a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760650.215601:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777132032:12345-192.168.203.38@tcp:4:dd.500 Request processed in 120979us (132290us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789760650.215611:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:3.0:1789760650.215620:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326277719689 time 326278798676 state 0x2 ref 0 00000100:00100000:3.0:1789760650.229735:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760650.230946:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777132160 00000100:00100000:0.0:1789760650.230971:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777132160 00000100:00100000:0.0:1789760650.231031:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326277719689 time 326278798676 state 0x0 ref 1 00000100:00100000:0.0:1789760650.231044:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326478798676 time 326278798676 state 0x1 ref 1 00000100:00100000:3.0:1789760650.294761:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326478798676 time 326478954309 state 0x0 ref 1 00000100:00100000:3.0:1789760650.294855:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777132160:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760650.294913:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13631488, mtime: 0x6aad9489, atime: 0x6aad9487, ctime: 0x6aad9489, blocks: 0x6807 00010000:00010000:3.0:1789760650.294922:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.294937:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1789760650.294941:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760650.294947:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.294973:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760650.372397:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00002000:00010000:0.0:1789760650.372593:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789760650.372598:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789760650.372611:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.372623:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.372632:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.372639:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760650.372644:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.372669:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.372687:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.372694:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857461 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760650.372927:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777132160:12345-192.168.203.38@tcp:4:dd.500 Request processed in 78085us (143197us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789760650.372938:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1789760650.372946:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326478798676 time 326478954309 state 0x2 ref 0 00000100:00100000:3.0:1789760650.382409:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760650.382590:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777132288 00000100:00100000:1.0:1789760650.382600:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777132288 00000100:00100000:1.0:1789760650.382651:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326478798676 time 326478954309 state 0x0 ref 1 00000100:00100000:1.0:1789760650.382662:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326678954309 time 326478954309 state 0x1 ref 1 00000100:00100000:0.0:1789760650.494991:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326678954309 time 326679190795 state 0x0 ref 1 00000100:00100000:0.0:1789760650.495026:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777132288:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760650.495103:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 14680064, mtime: 0x6aad9489, atime: 0x6aad9487, ctime: 0x6aad9489, blocks: 0x7007 00010000:00010000:0.0:1789760650.495111:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.495127:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1789760650.495132:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760650.495139:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.495172:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760650.659050:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00002000:00010000:0.0:1789760650.659410:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:0.0:1789760650.659416:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:0.0:1789760650.659429:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.659450:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.659459:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.659466:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760650.659471:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.659480:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.659499:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.659571:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b72976b3/0xc2b9a3a739857468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760650.659772:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777132288:12345-192.168.203.38@tcp:4:dd.500 Request processed in 164758us (277365us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789760650.659830:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:0.0:1789760650.659839:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326678954309 time 326679190795 state 0x2 ref 0 00000100:00100000:2.0:1789760650.674888:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760650.675063:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777132416 00000100:00100000:1.0:1789760650.675074:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777132416 00000100:00100000:1.0:1789760650.675135:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326678954309 time 326679190795 state 0x0 ref 1 00000100:00100000:1.0:1789760650.675150:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326879190795 time 326679190795 state 0x1 ref 1 00000100:00100000:3.0:1789760650.696078:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326879190795 time 326880278856 state 0x0 ref 1 00000100:00100000:3.0:1789760650.696110:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777132416:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760650.696169:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 15728640, mtime: 0x6aad9489, atime: 0x6aad9487, ctime: 0x6aad9489, blocks: 0x7807 00010000:00010000:3.0:1789760650.696179:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.696197:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1789760650.696201:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760650.696207:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760650.696221:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760650.729760:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00002000:00010000:0.0:1789760650.729862:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:0.0:1789760650.729866:0:13385:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760649 -> 1789760650 00002000:00010000:0.0:1789760650.729869:0:13385:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760649 -> 1789760650 00002000:00010000:0.0:1789760650.729872:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:0.0:1789760650.729948:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.729961:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.729971:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.729978:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760650.729983:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.729993:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.730029:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760650.730037:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a73985746f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760650.730130:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777132416:12345-192.168.203.38@tcp:4:dd.500 Request processed in 34030us (55249us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789760650.730140:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1789760650.730148:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326879190795 time 326880278856 state 0x2 ref 0 00000100:00100000:1.0:1789760650.736459:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760650.736612:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777132544 00000100:00100000:3.0:1789760650.736622:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777132544 00000100:00100000:3.0:1789760650.736672:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 326879190795 time 326880278856 state 0x0 ref 1 00000100:00100000:3.0:1789760650.736684:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327080278856 time 326880278856 state 0x1 ref 1 00010000:00010000:0.0:1789760650.759003:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760650.797727:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760650.797831:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777132800 00000100:00100000:1.0:1789760650.797841:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777132800 00000100:00100000:0.0:1789760650.797842:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760650.797871:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760650.797906:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00080000:3.0:1789760650.797913:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760650.797914:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777133312 00000100:00100000:1.0:1789760650.797921:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777133312 00000100:00100000:0.0:1789760650.797936:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00080000:3.0:1789760650.797946:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760650.797978:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760650.798630:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777133056 00000100:00100000:2.0:1789760650.798636:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777133056 00000100:00100000:2.0:1789760650.798680:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00080000:3.0:1789760650.798682:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760650.798691:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777133056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760650.798757:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777133056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760650.798765:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:3.0:1789760650.800098:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777132928 00000100:00100000:0.0:1789760650.800100:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777132672 00000100:00100000:0.0:1789760650.800110:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777132672 00000100:00100000:3.0:1789760650.800117:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777132928 00000100:00100000:3.0:1789760650.800153:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777133184 00000100:00100000:3.0:1789760650.800155:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777133184 00000100:00100000:3.0:1789760650.800175:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 239 00000100:00100000:3.0:1789760650.800184:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2403:x1876699777132800:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760650.800209:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:0.0:1789760650.800220:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777132672:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760650.800246:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2403:x1876699777132800:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 62us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760650.800256:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777132672:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760650.800257:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 239 00000100:00100000:0.0:1789760650.800267:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:3.0:1789760650.800289:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:3.0:1789760650.800300:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777133312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760650.800326:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777133312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760650.800331:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:0.0:1789760650.800702:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00100000:0.0:1789760650.800712:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777132928:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760650.800749:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777132928:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (2813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760650.800756:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00100000:0.0:1789760650.800771:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:0.0:1789760650.800816:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777133184:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760650.800842:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777133184:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760650.800848:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00080000:0.0:1789760650.800865:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760650.800870:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760650.896211:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327080278856 time 327080411692 state 0x0 ref 1 00000100:00100000:1.0:1789760650.896244:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777132544:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760650.896302:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 16777216, mtime: 0x6aad948a, atime: 0x6aad9487, ctime: 0x6aad948a, blocks: 0x8007 00010000:00010000:1.0:1789760650.896311:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760650.896326:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1789760650.896331:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760650.896337:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760650.896355:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760651.033071:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00002000:00010000:2.0:1789760651.033219:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:2.0:1789760651.033225:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:2.0:1789760651.033239:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.033253:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.033262:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.033270:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760651.033275:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.033299:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.033318:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.033327:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739857476 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760651.033520:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777132544:12345-192.168.203.38@tcp:4:dd.500 Request processed in 137287us (297065us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789760651.033531:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1789760651.033538:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327080278856 time 327080411692 state 0x2 ref 0 00000100:00100000:2.0:1789760651.039361:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760651.039598:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777133440 00000100:00100000:0.0:1789760651.039607:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777133440 00000100:00100000:0.0:1789760651.039716:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327080278856 time 327080411692 state 0x0 ref 1 00000100:00100000:0.0:1789760651.039729:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327280411692 time 327080411692 state 0x1 ref 1 00000100:00080000:3.0:1789760651.039936:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760651.097357:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327280411692 time 327281555164 state 0x0 ref 1 00000100:00100000:1.0:1789760651.097392:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777133440:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760651.097451:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 17825792, mtime: 0x6aad948a, atime: 0x6aad9487, ctime: 0x6aad948a, blocks: 0x8807 00010000:00010000:1.0:1789760651.097460:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.097476:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1789760651.097481:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760651.097487:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.097501:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760651.206701:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00002000:00010000:1.0:1789760651.208080:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:1.0:1789760651.208096:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:1.0:1789760651.208109:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.208122:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.208131:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.208159:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760651.208163:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.208172:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.208190:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.208197:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a73985747d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760651.208306:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777133440:12345-192.168.203.38@tcp:4:dd.500 Request processed in 110926us (168949us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789760651.208316:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:1.0:1789760651.208324:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327280411692 time 327281555164 state 0x2 ref 0 00000100:00100000:2.0:1789760651.218311:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760651.218401:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777133568 00000100:00100000:3.0:1789760651.218410:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777133568 00000100:00100000:3.0:1789760651.218475:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327280411692 time 327281555164 state 0x0 ref 1 00000100:00100000:3.0:1789760651.218488:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327481555164 time 327281555164 state 0x1 ref 1 00000100:00100000:0.0:1789760651.299204:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327481555164 time 327483403429 state 0x0 ref 1 00000100:00100000:0.0:1789760651.299240:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777133568:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760651.299309:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 18874368, mtime: 0x6aad948a, atime: 0x6aad9487, ctime: 0x6aad948a, blocks: 0x9007 00010000:00010000:0.0:1789760651.299318:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760651.299342:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:0.0:1789760651.299363:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760651.299371:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760651.299385:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760651.355378:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00002000:00010000:1.0:1789760651.355636:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:1.0:1789760651.355641:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 36871 -> 38919 00010000:00010000:1.0:1789760651.355654:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.355666:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.355694:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.355708:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760651.355713:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.355723:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.355743:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.355751:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a739857484 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760651.355903:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777133568:12345-192.168.203.38@tcp:4:dd.500 Request processed in 56675us (137596us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789760651.355913:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:1.0:1789760651.355921:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327481555164 time 327483403429 state 0x2 ref 0 00000100:00100000:2.0:1789760651.376871:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760651.378314:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777133696 00000100:00100000:0.0:1789760651.378325:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777133696 00000100:00100000:0.0:1789760651.378383:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327481555164 time 327483403429 state 0x0 ref 1 00000100:00100000:0.0:1789760651.378395:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327683403429 time 327483403429 state 0x1 ref 1 00000100:00100000:0.0:1789760651.499399:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327683403429 time 327683598528 state 0x0 ref 1 00000100:00100000:0.0:1789760651.499432:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777133696:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760651.499491:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 19922944, mtime: 0x6aad948a, atime: 0x6aad9487, ctime: 0x6aad948a, blocks: 0x9807 00010000:00010000:0.0:1789760651.499499:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760651.499515:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:0.0:1789760651.499519:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760651.499525:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760651.499540:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760651.669690:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00002000:00010000:1.0:1789760651.669982:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:1.0:1789760651.669987:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 38919 -> 40967 00010000:00010000:1.0:1789760651.670002:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.670035:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.670043:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.670051:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760651.670055:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.670064:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.670084:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.670091:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985748b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760651.670198:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777133696:12345-192.168.203.38@tcp:4:dd.500 Request processed in 170777us (293333us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789760651.670208:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:1.0:1789760651.670216:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327683403429 time 327683598528 state 0x2 ref 0 00000100:00100000:1.0:1789760651.680173:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760651.680260:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777133824 00000100:00100000:2.0:1789760651.680270:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777133824 00000100:00100000:2.0:1789760651.680319:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327683403429 time 327683598528 state 0x0 ref 1 00000100:00100000:2.0:1789760651.680342:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327883598528 time 327683598528 state 0x1 ref 1 00000100:00100000:1.0:1789760651.701627:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327883598528 time 327885828030 state 0x0 ref 1 00000100:00100000:1.0:1789760651.701659:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777133824:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760651.701715:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 20971520, mtime: 0x6aad948a, atime: 0x6aad9487, ctime: 0x6aad948a, blocks: 0xa007 00010000:00010000:1.0:1789760651.701723:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.701739:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1789760651.701743:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760651.701749:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.701763:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760651.785856:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789760651.833276:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:2.0:1789760651.833286:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760650 -> 1789760651 00002000:00010000:2.0:1789760651.833288:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760650 -> 1789760651 00002000:00010000:2.0:1789760651.833304:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 40967 -> 43015 00010000:00010000:2.0:1789760651.833319:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.833333:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.833341:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.833348:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ea00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760651.833352:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.833361:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.833382:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760651.833390:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739857492 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760651.833509:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777133824:12345-192.168.203.38@tcp:4:dd.500 Request processed in 131861us (153353us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789760651.833521:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1789760651.833528:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327883598528 time 327885828030 state 0x2 ref 0 00000001:00080000:3.0:1789760651.833851:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00000100:00100000:2.0:1789760651.844781:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760651.844913:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777133952 00000100:00100000:1.0:1789760651.844924:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777133952 00000100:00100000:1.0:1789760651.844988:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 327883598528 time 327885828030 state 0x0 ref 1 00000100:00100000:1.0:1789760651.845001:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328085828030 time 327885828030 state 0x1 ref 1 00000100:00100000:1.0:1789760651.905301:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328085828030 time 328089497448 state 0x0 ref 1 00000100:00100000:1.0:1789760651.905339:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777133952:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760651.905402:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 22020096, mtime: 0x6aad948b, atime: 0x6aad9487, ctime: 0x6aad948b, blocks: 0xa807 00010000:00010000:1.0:1789760651.905411:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.905457:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:1.0:1789760651.905461:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760651.905468:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760651.905482:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760652.004352:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00002000:00010000:0.0:1789760652.004483:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:0.0:1789760652.004488:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 43015 -> 45063 00010000:00010000:0.0:1789760652.004501:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.004514:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.004523:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.004530:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760652.004535:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.004543:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.004562:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.004570:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a739857499 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760652.004670:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777133952:12345-192.168.203.38@tcp:4:dd.500 Request processed in 99345us (159908us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789760652.004693:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1789760652.004702:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328085828030 time 328089497448 state 0x2 ref 0 00000100:00100000:2.0:1789760652.016554:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760652.016694:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777134080 00000100:00100000:1.0:1789760652.016703:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777134080 00000100:00100000:1.0:1789760652.016758:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328085828030 time 328089497448 state 0x0 ref 1 00000100:00100000:1.0:1789760652.016780:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328289497448 time 328089497448 state 0x1 ref 1 00000100:00100000:3.0:1789760652.105461:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328289497448 time 328289661948 state 0x0 ref 1 00000100:00100000:3.0:1789760652.105495:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777134080:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760652.105564:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 23068672, mtime: 0x6aad948b, atime: 0x6aad9487, ctime: 0x6aad948b, blocks: 0xb007 00010000:00010000:3.0:1789760652.105573:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.105586:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1789760652.105589:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760652.105594:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.105606:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760652.139267:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:2.0:1789760652.139277:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 45063 -> 47111 00010000:00010000:2.0:1789760652.139292:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760652.139307:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760652.139317:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760652.139325:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760652.139330:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760652.139340:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760652.139363:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760652.139373:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a7398574a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760652.139539:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777134080:12345-192.168.203.38@tcp:4:dd.500 Request processed in 34056us (122989us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789760652.139562:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:2.0:1789760652.139570:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328289497448 time 328289661948 state 0x2 ref 0 00000001:00080000:0.0:1789760652.140404:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00000100:00100000:2.0:1789760652.144888:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760652.144981:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777134208 00000100:00100000:1.0:1789760652.144992:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777134208 00000100:00100000:1.0:1789760652.145039:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328289497448 time 328289661948 state 0x0 ref 1 00000100:00100000:1.0:1789760652.145052:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328489661948 time 328289661948 state 0x1 ref 1 00000100:00100000:0.0:1789760652.305614:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328489661948 time 328489814479 state 0x0 ref 1 00000100:00100000:0.0:1789760652.305646:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777134208:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760652.305701:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 24117248, mtime: 0x6aad948b, atime: 0x6aad9487, ctime: 0x6aad948b, blocks: 0xb807 00010000:00010000:0.0:1789760652.305710:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.305725:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1789760652.305730:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760652.305736:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.305751:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760652.439990:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00002000:00010000:3.0:1789760652.440259:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:3.0:1789760652.440264:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 47111 -> 49159 00010000:00010000:3.0:1789760652.440278:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.440290:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.440298:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.440307:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760652.440312:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.440341:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.440361:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.440369:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006666e9f4/0xc2b9a3a7398574a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760652.440460:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777134208:12345-192.168.203.38@tcp:4:dd.500 Request processed in 134825us (295577us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789760652.440470:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:3.0:1789760652.440479:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328489661948 time 328489814479 state 0x2 ref 0 00000100:00100000:1.0:1789760652.454471:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760652.454778:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777134336 00000100:00100000:2.0:1789760652.454824:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777134336 00000100:00100000:2.0:1789760652.454876:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328489661948 time 328489814479 state 0x0 ref 1 00000100:00100000:2.0:1789760652.454888:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328689814479 time 328489814479 state 0x1 ref 1 00000100:00100000:0.0:1789760652.505661:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328689814479 time 328689864252 state 0x0 ref 1 00000100:00100000:0.0:1789760652.505687:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777134336:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760652.506225:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 25165824, mtime: 0x6aad948b, atime: 0x6aad9487, ctime: 0x6aad948b, blocks: 0xc007 00010000:00010000:0.0:1789760652.506235:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.506266:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1789760652.506271:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760652.506277:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.506291:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760652.578080:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1789760652.578100:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1789760652.584878:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967324 is committed 00000001:00080000:3.0:1789760652.584900:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967327 is committed 00000001:00080000:3.0:1789760652.584914:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00010000:00010000:1.0:1789760652.584933:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.584945:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.584955:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.584967:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.584975:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760652.584980:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.584983:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.584994:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.584997:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.585004:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760652.585017:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585020:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5820ee500) 00010000:00010000:3.0:1789760652.585024:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585025:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760652.585031:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.585039:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:1.0:1789760652.585040:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c686600/0xc2b9a3a7398572bd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.585045:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760652.585050:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.585058:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd8f200/0xc2b9a3a7398573e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585063:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585072:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585078:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585083:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760652.585086:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585092:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585111:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:1.0:1789760652.585114:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760652.585117:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585123:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398572c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585137:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585144:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585150:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585268:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760652.585272:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585278:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585289:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:1.0:1789760652.585292:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789760652.585295:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585301:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a73985731f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585324:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585330:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585336:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585341:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760652.585345:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585351:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585359:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:1.0:1789760652.585362:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789760652.585366:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585372:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00400/0xc2b9a3a739857342 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585381:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585388:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585394:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585404:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760652.585407:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585413:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585565:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x4009f790 (ffff97e5489b1100) 00010000:00010000:1.0:1789760652.585569:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760652.585573:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585579:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e44c687c00/0xc2b9a3a739857373 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585597:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585603:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585609:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585613:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dca00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760652.585616:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585621:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585642:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:1.0:1789760652.585645:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760652.585649:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585655:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dca00/0xc2b9a3a739857388 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585667:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585673:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585679:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585685:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dce00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760652.585688:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585694:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585702:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:1.0:1789760652.585705:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789760652.585708:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.585714:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dce00/0xc2b9a3a7398573b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760652.587316:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00002000:00010000:3.0:1789760652.587454:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:3.0:1789760652.587459:0:13391:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760651 -> 1789760652 00002000:00010000:3.0:1789760652.587462:0:13391:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760651 -> 1789760652 00002000:00010000:3.0:1789760652.587464:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 49159 -> 51207 00010000:00010000:3.0:1789760652.587476:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.587489:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.587498:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.587503:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760652.587507:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.587526:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.587544:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.587552:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398574ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760652.587660:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777134336:12345-192.168.203.38@tcp:4:dd.500 Request processed in 81978us (133193us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789760652.587669:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1789760652.587676:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328689814479 time 328689864252 state 0x2 ref 0 00000100:00100000:1.0:1789760652.599577:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760652.599676:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777134464 00000100:00100000:0.0:1789760652.599687:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777134464 00000100:00100000:0.0:1789760652.599750:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328689814479 time 328689864252 state 0x0 ref 1 00000100:00100000:0.0:1789760652.599778:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328889864252 time 328689864252 state 0x1 ref 1 00000100:00100000:0.0:1789760652.707612:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328889864252 time 328891811041 state 0x0 ref 1 00000100:00100000:0.0:1789760652.707651:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777134464:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760652.707709:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 26214400, mtime: 0x6aad948c, atime: 0x6aad9487, ctime: 0x6aad948c, blocks: 0xc807 00010000:00010000:0.0:1789760652.707718:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.707737:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1789760652.707741:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760652.707761:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760652.707826:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760652.772565:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00002000:00010000:3.0:1789760652.772695:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:3.0:1789760652.772700:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 51207 -> 53255 00010000:00010000:3.0:1789760652.772714:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.772728:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.772737:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.772745:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760652.772777:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.772856:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.772879:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.772887:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398574b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760652.773031:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777134464:12345-192.168.203.38@tcp:4:dd.500 Request processed in 65393us (173458us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789760652.773043:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1789760652.773051:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328889864252 time 328891811041 state 0x2 ref 0 00000100:00100000:1.0:1789760652.784027:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760652.784162:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777134592 00000100:00100000:2.0:1789760652.784172:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777134592 00000100:00100000:2.0:1789760652.784228:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 328889864252 time 328891811041 state 0x0 ref 1 00000100:00100000:2.0:1789760652.784250:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329091811041 time 328891811041 state 0x1 ref 1 00010000:00010000:0.0:1789760652.807155:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760652.907863:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329091811041 time 329092063377 state 0x0 ref 1 00000100:00100000:1.0:1789760652.907896:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777134592:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760652.907951:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 27262976, mtime: 0x6aad948c, atime: 0x6aad9487, ctime: 0x6aad948c, blocks: 0xd007 00010000:00010000:1.0:1789760652.907960:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.907975:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1789760652.907979:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760652.907985:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760652.908002:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760652.939901:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00002000:00010000:3.0:1789760652.939931:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:3.0:1789760652.939937:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 53255 -> 55303 00010000:00010000:3.0:1789760652.939952:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.939965:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.939973:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.939999:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760652.940004:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.940013:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.940034:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760652.940042:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a7398574bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760652.940142:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777134592:12345-192.168.203.38@tcp:4:dd.500 Request processed in 32257us (156119us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789760652.940153:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1789760652.940161:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329091811041 time 329092063377 state 0x2 ref 0 00000100:00100000:0.0:1789760652.946486:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760652.946647:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777134720 00000100:00100000:3.0:1789760652.946656:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777134720 00000100:00100000:3.0:1789760652.946703:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329091811041 time 329092063377 state 0x0 ref 1 00000100:00100000:3.0:1789760652.946717:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329292063377 time 329092063377 state 0x1 ref 1 00000100:00100000:2.0:1789760652.999011:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798169472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760652.999081:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760652.999156:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798169472 00000100:00100000:1.0:1789760652.999166:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798169472 00000100:00100000:1.0:1789760652.999234:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789760652.999246:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798169472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760652.999284:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760652.999332:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798169472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760652.999353:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789760652.999403:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798169472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760652.999525:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798169600:0@lo:400:kworker.0 00000100:00100000:1.0:1789760652.999558:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789760652.999639:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760653.001410:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44bc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798169728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760653.001486:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760653.001527:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798170240:0@lo:400:kworker.0 00000100:00100000:3.0:1789760653.001536:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798169728 00000100:00100000:3.0:1789760653.001544:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798169728 00000100:00100000:0.0:1789760653.001558:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760653.001581:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798170752:0@lo:400:kworker.0 00000100:00100000:0.0:1789760653.001612:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760653.001621:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789760653.001634:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798170112:0@lo:400:kworker.0 00000100:00100000:0.0:1789760653.001643:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798170240 00000100:00100000:0.0:1789760653.001646:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798170240 00000100:00100000:3.0:1789760653.001654:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798169728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760653.001673:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760653.001676:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00002000:00000024:3.0:1789760653.001680:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760653.001686:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798170240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.001694:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798170624:0@lo:400:kworker.0 00000100:00100000:3.0:1789760653.001739:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798169728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760653.001746:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789760653.001886:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760653.001915:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798171136:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.001938:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760653.001958:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798170752 00000100:00100000:3.0:1789760653.001963:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798170752 00000100:00100000:1.0:1789760653.001982:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798169600 00000100:00100000:1.0:1789760653.001988:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798169600 00000100:00100000:3.0:1789760653.001999:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798170624 00000100:00100000:3.0:1789760653.002004:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798170624 00000100:00100000:1.0:1789760653.002027:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789760653.002033:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798171136 00000100:00100000:1.0:1789760653.002037:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798169600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760653.002039:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798171136 00000100:00100000:3.0:1789760653.002064:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789760653.002074:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798170752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002086:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798169600:12345-0@lo:400:kworker.0 Request processed in 50us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.002094:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789760653.002126:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760653.002134:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798170624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002165:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798170624:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.002171:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760653.002184:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789760653.002190:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798171136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002226:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798171136:12345-0@lo:400:kworker.0 Request processed in 36us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.002232:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789760653.002252:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798170112 00000100:00100000:1.0:1789760653.002256:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798170112 00000100:00100000:1.0:1789760653.002283:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789760653.002289:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798170112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002319:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798170112:12345-0@lo:400:kworker.0 Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.002326:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789760653.002357:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798169856:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002382:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760653.002434:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798170368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002457:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760653.002476:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798170880:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002497:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760653.002517:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789760653.002523:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798169984:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002544:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760653.002559:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798170496:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002577:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760653.002590:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798171008:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002608:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760653.002625:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798169856 00000100:00100000:1.0:1789760653.002629:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798169856 00000100:00100000:1.0:1789760653.002652:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798170368 00000100:00100000:1.0:1789760653.002655:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798170368 00000100:00100000:1.0:1789760653.002666:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798170880 00000100:00100000:1.0:1789760653.002667:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798170880 00000100:00100000:1.0:1789760653.002678:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798170496 00000100:00100000:1.0:1789760653.002680:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798170496 00000100:00100000:1.0:1789760653.002690:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798171008 00000100:00100000:1.0:1789760653.002692:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798171008 00000100:00100000:1.0:1789760653.002855:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789760653.002862:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798169856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.002902:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798169856:12345-0@lo:400:kworker.0 Request processed in 39us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.002908:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789760653.002925:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789760653.002932:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798170368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760653.002950:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798170752:12345-0@lo:400:kworker.0 Request processed in 875us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760653.002960:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789760653.002965:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798170368:12345-0@lo:400:kworker.0 Request processed in 34us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.002974:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789760653.002992:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789760653.002998:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798170880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003025:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798170880:12345-0@lo:400:kworker.0 Request processed in 29us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.003031:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789760653.003041:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789760653.003046:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798170496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003072:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798170496:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.003088:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789760653.003099:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789760653.003105:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798171008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003134:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798171008:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.003139:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789760653.003164:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798169984 00000100:00100000:1.0:1789760653.003168:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798169984 00000100:00100000:1.0:1789760653.003185:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789760653.003191:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798169984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003220:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798169984:12345-0@lo:400:kworker.0 Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.003226:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789760653.003264:0:3461:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967327 gen 2 00000004:00080000:1.0:1789760653.003270:0:3461:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967327 committed transno 4294967327 00000100:00100000:1.0:1789760653.003290:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798169984:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003302:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798170496:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003311:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798171008:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003320:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798169856:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003328:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798170368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003336:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798170880:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003448:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798170112:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003481:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798170624:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003490:0:3463:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789760653.003494:0:3463:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e44c6de300, transno 4294967323 00000004:00080000:1.0:1789760653.003504:0:3463:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e44c6dfb80, transno 4294967324 00000100:00100000:1.0:1789760653.003508:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798171136:0@lo:400:kworker.0 00000100:00100000:1.0:1789760653.003519:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798169600:0@lo:400:kworker.0 00000100:00100000:0.0:1789760653.003729:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798170240:12345-0@lo:400:kworker.0 Request processed in 2043us (2168us total) trans 0 rc 0/0 00000100:00080000:2.0:1789760653.003733:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760653.003739:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760653.003740:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1789760653.003744:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760653.003748:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760653.003997:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44bc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798169728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760653.004608:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798170240:0@lo:400:kworker.0 00000100:00100000:0.0:1789760653.004623:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798170752:0@lo:400:kworker.0 00000004:00080000:2.0:1789760653.038601:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000100:00100000:1.0:1789760653.038835:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798171264:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1789760653.038906:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760653.038949:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798171264 00000100:00100000:3.0:1789760653.038957:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798171264 00000100:00100000:3.0:1789760653.039001:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789760653.039011:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798171264:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1789760653.039042:0:13387:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1789760653.039073:0:13387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad9484, atime: 0x6aad9481, ctime: 0x6aad9484, blocks: 0x4007 00010000:00010000:3.0:1789760653.039081:0:13387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789760653.039086:0:7272:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 2 batchid updated 00010000:00010000:3.0:1789760653.039097:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1789760653.039102:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00000020:00080000:2.0:1789760653.039103:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 2 00010000:00010000:3.0:1789760653.039108:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.039130:0:13387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.039139:0:13387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.039146:0:13387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760653.039149:0:7284:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e581de50c0 with version 7 00000020:00080000:2.0:1789760653.039157:0:7284:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 2 cancel update log [0x200000401:0x2:0x0].2: rc = 0 00010000:00010000:3.0:1789760653.039161:0:13387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1789760653.039662:0:7284:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 2 cancel update log [0x240000400:0x2:0x0].2: rc = 0 00000020:00080000:2.0:1789760653.039676:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 2 00000004:00080000:2.0:1789760653.039686:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 7 rpc_version 7 00000020:00100000:2.0:1789760653.039706:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760653.039714:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e57d2dc380 x1876699798171520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760653.039731:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57d2dc380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798171520:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789760653.039778:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760653.039818:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e581de5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760653.039834:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798171520 00000100:00100000:2.0:1789760653.039838:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798171520 00000100:00100000:2.0:1789760653.039869:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789760653.039876:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7275:x1876699798171520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789760653.040427:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7275:x1876699798171520:12345-0@lo:1000:osp_up0-1.0 Request processed in 549us (646us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789760653.040435:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789760653.040512:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798171264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1501us (1605us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789760653.040521:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1789760653.040544:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760653.040550:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760653.040551:0:3464:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e57f033800/2, rc 0, transno 4294967352 00000100:00100000:1.0:1789760653.040557:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798171264:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1789760653.040560:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760653.040565:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.040574:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.040592:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.040607:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398574c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.040627:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760653.040629:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760653.040631:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760653.040714:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57d2dc380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798171520:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789760653.108009:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329292063377 time 329292205138 state 0x0 ref 1 00000100:00100000:0.0:1789760653.108070:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777134720:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760653.108140:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 28311552, mtime: 0x6aad948c, atime: 0x6aad9487, ctime: 0x6aad948c, blocks: 0xd807 00010000:00010000:0.0:1789760653.108148:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760653.108162:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1789760653.108167:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760653.108173:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760653.108187:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760653.108406:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760653.167914:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00000001:00080000:0.0:1789760653.167936:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00002000:00010000:3.0:1789760653.168025:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:3.0:1789760653.168031:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 55303 -> 57351 00010000:00010000:3.0:1789760653.168045:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.168057:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.168066:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.168073:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760653.168077:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.168086:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.168105:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760653.168132:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a7398574ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760653.168250:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777134720:12345-192.168.203.38@tcp:4:dd.500 Request processed in 60208us (221759us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789760653.168261:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:3.0:1789760653.168270:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329292063377 time 329292205138 state 0x2 ref 0 00000100:00100000:0.0:1789760653.178211:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760653.178360:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777134848 00000100:00100000:3.0:1789760653.178370:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777134848 00000100:00100000:3.0:1789760653.178429:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329292063377 time 329292205138 state 0x0 ref 1 00000100:00100000:3.0:1789760653.178442:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329492205138 time 329292205138 state 0x1 ref 1 00000100:00100000:1.0:1789760653.308415:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329492205138 time 329492614262 state 0x0 ref 1 00000100:00100000:1.0:1789760653.308449:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777134848:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760653.308509:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 29360128, mtime: 0x6aad948c, atime: 0x6aad9487, ctime: 0x6aad948c, blocks: 0xe007 00010000:00010000:1.0:1789760653.308518:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.308534:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1789760653.308539:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760653.308545:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.308560:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760653.418156:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00002000:00010000:1.0:1789760653.418258:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:1.0:1789760653.418263:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 57351 -> 59399 00010000:00010000:1.0:1789760653.418277:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.418299:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.418308:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.418316:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760653.418320:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.418330:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.418351:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.418358:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760653.418640:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777134848:12345-192.168.203.38@tcp:4:dd.500 Request processed in 110201us (240434us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789760653.418663:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:1.0:1789760653.418671:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329492205138 time 329492614262 state 0x2 ref 0 00000100:00100000:0.0:1789760653.431094:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760653.431275:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777134976 00000100:00100000:3.0:1789760653.431285:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777134976 00000100:00100000:3.0:1789760653.431337:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329492205138 time 329492614262 state 0x0 ref 1 00000100:00100000:3.0:1789760653.431350:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329692614262 time 329492614262 state 0x1 ref 1 00000100:00100000:1.0:1789760653.508643:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329692614262 time 329692842358 state 0x0 ref 1 00000100:00100000:1.0:1789760653.508675:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777134976:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760653.508734:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 30408704, mtime: 0x6aad948c, atime: 0x6aad9487, ctime: 0x6aad948c, blocks: 0xe807 00010000:00010000:1.0:1789760653.508743:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.508770:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1789760653.508774:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760653.508781:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.508941:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760653.511236:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798171648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760653.511302:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760653.511423:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798171648 00000100:00100000:1.0:1789760653.511431:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798171648 00000100:00100000:1.0:1789760653.511480:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789760653.511488:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3461:x1876699798171648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760653.511523:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760653.511577:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3461:x1876699798171648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760653.511584:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789760653.511637:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798171648:0@lo:41:osp-pre-0-1.0 00002000:00010000:1.0:1789760653.574266:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:1.0:1789760653.574276:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 59399 -> 61447 00010000:00010000:1.0:1789760653.574295:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.574308:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.574317:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.574325:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760653.574330:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.574339:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.574357:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.574364:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760653.574475:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777134976:12345-192.168.203.38@tcp:4:dd.500 Request processed in 65811us (143386us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789760653.574502:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1789760653.574509:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329692614262 time 329692842358 state 0x2 ref 0 00000001:00080000:3.0:1789760653.575185:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00000100:00100000:1.0:1789760653.584103:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760653.584199:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777135104 00000100:00100000:3.0:1789760653.584210:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777135104 00000100:00100000:3.0:1789760653.584260:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329692614262 time 329692842358 state 0x0 ref 1 00000100:00100000:3.0:1789760653.584274:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329892842358 time 329692842358 state 0x1 ref 1 00000100:00100000:1.0:1789760653.708908:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329892842358 time 329893107186 state 0x0 ref 1 00000100:00100000:1.0:1789760653.708941:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777135104:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760653.709000:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 31457280, mtime: 0x6aad948c, atime: 0x6aad9487, ctime: 0x6aad948c, blocks: 0xf007 00010000:00010000:1.0:1789760653.709010:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.709026:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1789760653.709031:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760653.709037:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.709051:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760653.773430:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00002000:00010000:1.0:1789760653.773631:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:1.0:1789760653.773636:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760652 -> 1789760653 00002000:00010000:1.0:1789760653.773639:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760652 -> 1789760653 00002000:00010000:1.0:1789760653.773641:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 61447 -> 63495 00010000:00010000:1.0:1789760653.774042:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.774075:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.774084:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.774091:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760653.774096:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.774105:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.774123:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760653.774130:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a7398574df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760653.774232:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777135104:12345-192.168.203.38@tcp:4:dd.500 Request processed in 65302us (190134us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789760653.774254:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:1.0:1789760653.774263:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329892842358 time 329893107186 state 0x2 ref 0 00000100:00100000:0.0:1789760653.789779:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760653.790600:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777135232 00000100:00100000:3.0:1789760653.790621:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777135232 00000100:00100000:3.0:1789760653.790682:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 329892842358 time 329893107186 state 0x0 ref 1 00000100:00100000:3.0:1789760653.790695:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330093107186 time 329893107186 state 0x1 ref 1 00010000:00010000:3.0:1789760653.830982:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760653.909359:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330093107186 time 330093557929 state 0x0 ref 1 00000100:00100000:0.0:1789760653.909393:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777135232:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760653.909466:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 32505856, mtime: 0x6aad948d, atime: 0x6aad9487, ctime: 0x6aad948d, blocks: 0xf807 00010000:00010000:0.0:1789760653.909475:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760653.909520:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1789760653.909525:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760653.909531:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760653.909548:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760653.982884:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00002000:00010000:2.0:1789760653.986156:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:2.0:1789760653.986167:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 63495 -> 65543 00010000:00010000:2.0:1789760653.986182:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760653.986195:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760653.986204:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760653.986229:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760653.986234:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760653.986259:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760653.986280:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760653.986289:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398574e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760653.986384:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777135232:12345-192.168.203.38@tcp:4:dd.500 Request processed in 77004us (196610us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1789760653.986395:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1789760653.986403:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330093107186 time 330093557929 state 0x2 ref 0 00000100:00100000:1.0:1789760654.001749:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760654.001926:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777135360 00000100:00100000:2.0:1789760654.001936:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777135360 00000100:00100000:2.0:1789760654.001990:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330093107186 time 330093557929 state 0x0 ref 1 00000100:00100000:2.0:1789760654.002003:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330293557929 time 330093557929 state 0x1 ref 1 00000100:00100000:1.0:1789760654.023866:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798171776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760654.023932:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760654.025724:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798171776 00000100:00100000:2.0:1789760654.025737:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798171776 00000100:00100000:2.0:1789760654.025843:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789760654.025865:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798171776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760654.025904:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760654.025980:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798171776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760654.025988:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789760654.026094:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798171776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760654.109579:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330293557929 time 330293779900 state 0x0 ref 1 00000100:00100000:2.0:1789760654.109610:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777135360:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760654.109667:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 33554432, mtime: 0x6aad948d, atime: 0x6aad9487, ctime: 0x6aad948d, blocks: 0x10007 00010000:00010000:2.0:1789760654.109677:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.109692:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1789760654.109696:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760654.109703:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.109717:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760654.176336:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00002000:00010000:2.0:1789760654.177983:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:2.0:1789760654.177989:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 65543 -> 67591 00010000:00010000:2.0:1789760654.178000:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.178009:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.178029:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.178034:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760654.178038:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.178047:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.178066:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.178074:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a7398574ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760654.178156:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777135360:12345-192.168.203.38@tcp:4:dd.500 Request processed in 68557us (176414us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1789760654.178163:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:2.0:1789760654.178170:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330293557929 time 330293779900 state 0x2 ref 0 00000100:00100000:1.0:1789760654.184009:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760654.184180:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777135488 00000100:00100000:2.0:1789760654.184190:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777135488 00000100:00100000:2.0:1789760654.184240:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330293557929 time 330293779900 state 0x0 ref 1 00000100:00100000:2.0:1789760654.184252:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330493779900 time 330293779900 state 0x1 ref 1 00000100:00100000:0.0:1789760654.310868:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330493779900 time 330495069480 state 0x0 ref 1 00000100:00100000:0.0:1789760654.310900:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777135488:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760654.310956:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 34603008, mtime: 0x6aad948d, atime: 0x6aad9487, ctime: 0x6aad948d, blocks: 0x10807 00010000:00010000:0.0:1789760654.310964:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.310979:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1789760654.310983:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760654.310990:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.311002:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760654.416580:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00002000:00010000:0.0:1789760654.416684:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:0.0:1789760654.416703:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 67591 -> 69639 00010000:00010000:0.0:1789760654.416718:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.416730:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.416739:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.416746:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760654.417199:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.417212:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.417233:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.417240:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a7398574f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760654.417500:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777135488:12345-192.168.203.38@tcp:4:dd.500 Request processed in 106516us (233402us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1789760654.417512:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:1.0:1789760654.417522:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330493779900 time 330495069480 state 0x2 ref 0 00000100:00100000:0.0:1789760654.429723:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760654.429843:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777135616 00000100:00100000:1.0:1789760654.429852:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777135616 00000100:00100000:1.0:1789760654.429904:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330493779900 time 330495069480 state 0x0 ref 1 00000100:00100000:1.0:1789760654.429917:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330695069480 time 330495069480 state 0x1 ref 1 00000100:00100000:1.0:1789760654.510966:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330695069480 time 330695167347 state 0x0 ref 1 00000100:00100000:1.0:1789760654.511002:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777135616:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760654.511063:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 35651584, mtime: 0x6aad948d, atime: 0x6aad9487, ctime: 0x6aad948d, blocks: 0x11007 00010000:00010000:1.0:1789760654.511073:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760654.511089:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1789760654.511093:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760654.511099:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760654.511113:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760654.537389:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57d2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798171904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760654.537479:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760654.537565:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798171904 00000100:00100000:2.0:1789760654.537573:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798171904 00000100:00100000:2.0:1789760654.537620:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789760654.537629:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798171904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760654.537647:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 132710400 pending 1703936 free 3827302400 avail 3822059520 00000100:00100000:2.0:1789760654.537690:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798171904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760654.537697:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789760654.537745:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57d2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798171904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760654.541006:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798172032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760654.541076:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760654.542097:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798172032 00000100:00100000:3.0:1789760654.542109:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798172032 00000100:00100000:3.0:1789760654.542173:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789760654.542184:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798172032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760654.542207:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 132710400 pending 1703936 free 3827302400 avail 3822059520 00000100:00100000:3.0:1789760654.542268:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798172032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760654.542275:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789760654.543626:0:3464:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967352 gen 2 00000004:00080000:1.0:1789760654.543636:0:3464:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e57f033800, transno 4294967352 00000100:00100000:1.0:1789760654.543659:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798172032:0@lo:13:osp-pre-0-1.0 00002000:00010000:1.0:1789760654.596679:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:1.0:1789760654.596689:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 69639 -> 71687 00010000:00010000:1.0:1789760654.596704:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760654.596718:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760654.596726:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760654.596734:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760654.596739:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760654.596759:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760654.596780:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760654.596818:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a7398574fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760654.596922:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777135616:12345-192.168.203.38@tcp:4:dd.500 Request processed in 85933us (167203us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789760654.596933:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1789760654.596942:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330695069480 time 330695167347 state 0x2 ref 0 00000001:00080000:0.0:1789760654.604125:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000100:00100000:0.0:1789760654.612824:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760654.613036:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777135744 00000100:00100000:1.0:1789760654.613048:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777135744 00000100:00100000:1.0:1789760654.613112:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330695069480 time 330695167347 state 0x0 ref 1 00000100:00100000:1.0:1789760654.613125:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330895167347 time 330695167347 state 0x1 ref 1 00000100:00100000:3.0:1789760654.711110:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330895167347 time 330895301218 state 0x0 ref 1 00000100:00100000:3.0:1789760654.711145:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777135744:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760654.711204:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 36700160, mtime: 0x6aad948d, atime: 0x6aad9487, ctime: 0x6aad948d, blocks: 0x11807 00010000:00010000:3.0:1789760654.711214:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760654.711228:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1789760654.711233:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760654.711239:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760654.711273:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760654.786769:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00002000:00010000:0.0:1789760654.789920:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:0.0:1789760654.789943:0:13385:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760653 -> 1789760654 00002000:00010000:0.0:1789760654.789945:0:13385:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760653 -> 1789760654 00002000:00010000:0.0:1789760654.789947:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 71687 -> 73735 00010000:00010000:0.0:1789760654.789960:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.789973:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.789981:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.789989:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760654.789995:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.790004:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.790034:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760654.790043:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a739857502 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760654.790143:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777135744:12345-192.168.203.38@tcp:4:dd.500 Request processed in 79010us (177356us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1789760654.790162:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:0.0:1789760654.790170:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330895167347 time 330895301218 state 0x2 ref 0 00000100:00100000:0.0:1789760654.807947:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760654.808373:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777135872 00000100:00100000:2.0:1789760654.808382:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777135872 00000100:00100000:2.0:1789760654.808453:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 330895167347 time 330895301218 state 0x0 ref 1 00000100:00100000:2.0:1789760654.808466:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331095301218 time 330895301218 state 0x1 ref 1 00010000:00010000:0.0:1789760654.855152:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760654.913850:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331095301218 time 331098051741 state 0x0 ref 1 00000100:00100000:3.0:1789760654.913883:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777135872:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760654.913936:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 37748736, mtime: 0x6aad948e, atime: 0x6aad9487, ctime: 0x6aad948e, blocks: 0x12007 00010000:00010000:3.0:1789760654.913946:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760654.913961:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1789760654.913965:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760654.913971:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760654.913988:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760654.981858:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 00002000:00010000:2.0:1789760654.982069:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:2.0:1789760654.982075:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 73735 -> 75783 00010000:00010000:2.0:1789760654.982088:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.982102:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.982128:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.982135:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dde00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760654.982140:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.982148:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.982168:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760654.982177:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a739857509 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760654.982382:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777135872:12345-192.168.203.38@tcp:4:dd.500 Request processed in 68508us (174439us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789760654.982392:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:2.0:1789760654.982455:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331095301218 time 331098051741 state 0x2 ref 0 00000100:00100000:0.0:1789760654.993561:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760654.995039:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777136000 00000100:00100000:1.0:1789760654.995050:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777136000 00000100:00100000:1.0:1789760654.995106:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331095301218 time 331098051741 state 0x0 ref 1 00000100:00100000:1.0:1789760654.995119:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331298051741 time 331098051741 state 0x1 ref 1 00000100:00100000:3.0:1789760655.115974:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331298051741 time 331300174927 state 0x0 ref 1 00000100:00100000:3.0:1789760655.116028:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777136000:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760655.116084:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 38797312, mtime: 0x6aad948e, atime: 0x6aad9487, ctime: 0x6aad948e, blocks: 0x12807 00010000:00010000:3.0:1789760655.116093:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.116125:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1789760655.116129:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760655.116135:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.116150:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760655.124894:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760655.212988:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00002000:00010000:3.0:1789760655.213008:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:3.0:1789760655.213015:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 75783 -> 77831 00010000:00010000:3.0:1789760655.213031:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.213046:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.213056:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.213063:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dcc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760655.213069:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.213079:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.213120:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.213130:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857510 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760655.213230:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777136000:12345-192.168.203.38@tcp:4:dd.500 Request processed in 97235us (219675us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789760655.213241:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:3.0:1789760655.213249:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331298051741 time 331300174927 state 0x2 ref 0 00000100:00100000:1.0:1789760655.220715:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760655.220918:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777136128 00000100:00100000:3.0:1789760655.220928:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777136128 00000100:00100000:3.0:1789760655.220981:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331298051741 time 331300174927 state 0x0 ref 1 00000100:00100000:3.0:1789760655.220993:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331500174927 time 331300174927 state 0x1 ref 1 00000100:00100000:2.0:1789760655.316357:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331500174927 time 331500557668 state 0x0 ref 1 00000100:00100000:2.0:1789760655.316391:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777136128:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760655.316468:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 39845888, mtime: 0x6aad948e, atime: 0x6aad9487, ctime: 0x6aad948e, blocks: 0x13007 00010000:00010000:2.0:1789760655.316478:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.316493:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1789760655.316497:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760655.316504:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.316518:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760655.402887:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00002000:00010000:0.0:1789760655.403011:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:0.0:1789760655.403016:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 77831 -> 79879 00010000:00010000:0.0:1789760655.403029:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760655.403051:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760655.403060:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760655.403069:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760655.403073:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760655.403083:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760655.403103:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760655.403127:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857517 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760655.403231:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777136128:12345-192.168.203.38@tcp:4:dd.500 Request processed in 86846us (182515us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789760655.403241:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:0.0:1789760655.403248:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331500174927 time 331500557668 state 0x2 ref 0 00000100:00100000:1.0:1789760655.414878:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760655.414980:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777136256 00000100:00100000:0.0:1789760655.414990:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777136256 00000100:00100000:0.0:1789760655.415051:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331500174927 time 331500557668 state 0x0 ref 1 00000100:00100000:0.0:1789760655.415063:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331700557668 time 331500557668 state 0x1 ref 1 00000100:00100000:1.0:1789760655.524614:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331700557668 time 331708813442 state 0x0 ref 1 00000100:00100000:1.0:1789760655.524646:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777136256:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760655.524699:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 40894464, mtime: 0x6aad948e, atime: 0x6aad9487, ctime: 0x6aad948e, blocks: 0x13807 00010000:00010000:1.0:1789760655.524707:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760655.524736:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:1.0:1789760655.524740:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760655.524756:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760655.524772:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760655.631922:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00002000:00010000:3.0:1789760655.632051:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:3.0:1789760655.632057:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 79879 -> 81927 00010000:00010000:3.0:1789760655.632071:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.632083:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.632093:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.632121:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ec00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760655.632125:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.632135:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.632156:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.632164:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985751e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760655.632483:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777136256:12345-192.168.203.38@tcp:4:dd.500 Request processed in 107848us (217609us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789760655.632615:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:3.0:1789760655.632624:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331700557668 time 331708813442 state 0x2 ref 0 00000100:00100000:1.0:1789760655.642475:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760655.642881:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777136384 00000100:00100000:2.0:1789760655.642890:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777136384 00000100:00100000:2.0:1789760655.642943:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331700557668 time 331708813442 state 0x0 ref 1 00000100:00100000:2.0:1789760655.642955:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331908813442 time 331708813442 state 0x1 ref 1 00000100:00100000:2.0:1789760655.725419:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331908813442 time 331909618511 state 0x0 ref 1 00000100:00100000:2.0:1789760655.725453:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777136384:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760655.725519:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 41943040, mtime: 0x6aad948e, atime: 0x6aad9487, ctime: 0x6aad948e, blocks: 0x14007 00010000:00010000:2.0:1789760655.725528:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.725559:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1789760655.725563:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760655.725568:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.725581:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760655.840112:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00002000:00010000:3.0:1789760655.840242:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:3.0:1789760655.840247:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760654 -> 1789760655 00002000:00010000:3.0:1789760655.840249:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760654 -> 1789760655 00002000:00010000:3.0:1789760655.840251:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 81927 -> 83975 00010000:00010000:3.0:1789760655.840265:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.840296:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.840305:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.840312:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760655.840317:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.840327:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.840348:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760655.840356:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857525 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760655.840493:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777136384:12345-192.168.203.38@tcp:4:dd.500 Request processed in 115052us (198022us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789760655.840503:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:3.0:1789760655.840510:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331908813442 time 331909618511 state 0x2 ref 0 00000100:00100000:1.0:1789760655.858565:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760655.858850:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777136512 00000100:00100000:3.0:1789760655.858869:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777136512 00000100:00100000:3.0:1789760655.858922:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 331908813442 time 331909618511 state 0x0 ref 1 00000100:00100000:3.0:1789760655.858936:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332109618511 time 331909618511 state 0x1 ref 1 00010000:00010000:3.0:1789760655.879009:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760655.917765:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760655.917846:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760655.917880:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760655.917903:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760655.917921:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760655.917962:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760655.918047:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777136768 00000100:00100000:1.0:1789760655.918057:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777136768 00000100:00100000:1.0:1789760655.918119:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777137280 00000100:00100000:1.0:1789760655.918123:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777137280 00000100:00100000:1.0:1789760655.918137:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777136896 00000100:00100000:1.0:1789760655.918139:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777136896 00000100:00100000:1.0:1789760655.918152:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777137152 00000100:00100000:1.0:1789760655.918154:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777137152 00000100:00100000:1.0:1789760655.918172:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 249 00000100:00100000:1.0:1789760655.918180:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777136768:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760655.918250:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777136768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760655.918258:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 249 00000100:00100000:1.0:1789760655.918275:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 250 00000100:00100000:1.0:1789760655.918281:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777137280:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760655.918302:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777137280:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760655.918315:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 250 00000100:00100000:1.0:1789760655.918326:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 251 00000100:00100000:1.0:1789760655.918332:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777136896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760655.918356:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777136896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760655.918363:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 251 00000100:00100000:1.0:1789760655.918373:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 252 00000100:00100000:1.0:1789760655.918380:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777137152:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760655.918414:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777137152:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760655.918420:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 252 00000100:00100000:0.0:1789760655.918753:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777136640 00000100:00100000:0.0:1789760655.918758:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777136640 00000100:00100000:0.0:1789760655.918814:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 344 00000100:00100000:0.0:1789760655.918823:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777136640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760655.918853:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777136640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760655.918860:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 344 00000100:00100000:3.0:1789760655.919008:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777137024 00000100:00100000:3.0:1789760655.919013:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777137024 00000100:00100000:3.0:1789760655.919060:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:3.0:1789760655.919067:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777137024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760655.919097:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777137024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760655.919103:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00080000:2.0:1789760655.919169:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760655.919174:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760655.919177:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760655.927173:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332109618511 time 332111374223 state 0x0 ref 1 00000100:00100000:1.0:1789760655.927206:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777136512:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760655.927262:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 42991616, mtime: 0x6aad948f, atime: 0x6aad9487, ctime: 0x6aad948f, blocks: 0x14807 00010000:00010000:1.0:1789760655.927271:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760655.927286:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1789760655.927290:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760655.927296:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760655.927320:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760655.991421:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:2.0:1789760655.991430:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 83975 -> 86023 00010000:00010000:2.0:1789760655.991445:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.991466:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.991477:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.991497:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ec00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760655.991502:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.991510:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.991530:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760655.991538:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985752c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760655.991628:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777136512:12345-192.168.203.38@tcp:4:dd.500 Request processed in 64433us (133068us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789760655.991638:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:2.0:1789760655.991646:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332109618511 time 332111374223 state 0x2 ref 0 00000001:00080000:3.0:1789760655.994055:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00000100:00100000:2.0:1789760656.003365:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760656.003532:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777137408 00000100:00100000:0.0:1789760656.003541:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777137408 00000100:00100000:0.0:1789760656.003592:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332109618511 time 332111374223 state 0x0 ref 1 00000100:00100000:0.0:1789760656.003606:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332311374223 time 332111374223 state 0x1 ref 1 00000100:00100000:2.0:1789760656.127664:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332311374223 time 332311865759 state 0x0 ref 1 00000100:00100000:2.0:1789760656.127695:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777137408:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760656.127759:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 44040192, mtime: 0x6aad948f, atime: 0x6aad9487, ctime: 0x6aad948f, blocks: 0x15007 00010000:00010000:2.0:1789760656.127768:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760656.127837:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1789760656.127842:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760656.127848:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760656.127862:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760656.182594:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:3.0:1789760656.182602:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 86023 -> 88071 00010000:00010000:3.0:1789760656.182616:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.182629:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.182638:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.182646:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760656.182652:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.182675:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.182692:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.182697:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857533 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760656.182855:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777137408:12345-192.168.203.38@tcp:4:dd.500 Request processed in 55169us (180122us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789760656.182866:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1789760656.182873:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332311374223 time 332311865759 state 0x2 ref 0 00000001:00080000:3.0:1789760656.182910:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00000100:00100000:2.0:1789760656.188110:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760656.188563:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777137536 00000100:00100000:3.0:1789760656.188573:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777137536 00000100:00100000:3.0:1789760656.188622:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332311374223 time 332311865759 state 0x0 ref 1 00000100:00100000:3.0:1789760656.188635:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332511865759 time 332311865759 state 0x1 ref 1 00000100:00100000:2.0:1789760656.328024:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332511865759 time 332512223985 state 0x0 ref 1 00000100:00100000:2.0:1789760656.328060:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777137536:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760656.328118:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 45088768, mtime: 0x6aad948f, atime: 0x6aad9487, ctime: 0x6aad948f, blocks: 0x15807 00010000:00010000:2.0:1789760656.328127:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760656.328141:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1789760656.328145:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760656.328150:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760656.328164:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760656.392065:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00002000:00010000:3.0:1789760656.392221:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:3.0:1789760656.392227:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 88071 -> 90121 00010000:00010000:3.0:1789760656.392240:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.392253:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.392268:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.392275:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760656.392280:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.392289:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.392307:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.392315:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a73985753a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760656.392408:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777137536:12345-192.168.203.38@tcp:4:dd.500 Request processed in 64360us (204302us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789760656.392418:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:3.0:1789760656.392426:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332511865759 time 332512223985 state 0x2 ref 0 00000100:00100000:1.0:1789760656.400598:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760656.400839:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777137664 00000100:00100000:3.0:1789760656.400849:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777137664 00000100:00100000:3.0:1789760656.400900:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332511865759 time 332512223985 state 0x0 ref 1 00000100:00100000:3.0:1789760656.400918:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332712223985 time 332512223985 state 0x1 ref 1 00000100:00100000:1.0:1789760656.528881:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332712223985 time 332713082488 state 0x0 ref 1 00000100:00100000:1.0:1789760656.528916:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777137664:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760656.528971:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 46137344, mtime: 0x6aad948f, atime: 0x6aad9487, ctime: 0x6aad948f, blocks: 0x16009 00010000:00010000:1.0:1789760656.528980:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760656.528997:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1789760656.529002:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760656.529008:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760656.529024:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760656.615312:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00002000:00010000:3.0:1789760656.615510:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:3.0:1789760656.615517:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 90121 -> 92169 00010000:00010000:3.0:1789760656.615536:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.615550:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.615559:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.615567:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760656.615573:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.615582:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.615608:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.615617:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857541 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760656.615772:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777137664:12345-192.168.203.38@tcp:4:dd.500 Request processed in 86866us (215176us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789760656.615867:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:3.0:1789760656.615878:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332712223985 time 332713082488 state 0x2 ref 0 00000100:00100000:1.0:1789760656.626935:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760656.627130:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777137792 00000100:00100000:2.0:1789760656.627143:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777137792 00000100:00100000:2.0:1789760656.627208:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332712223985 time 332713082488 state 0x0 ref 1 00000100:00100000:2.0:1789760656.627223:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332913082488 time 332713082488 state 0x1 ref 1 00000100:00100000:0.0:1789760656.729435:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332913082488 time 332913627892 state 0x0 ref 1 00000100:00100000:0.0:1789760656.729483:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777137792:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760656.729563:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 47185920, mtime: 0x6aad948f, atime: 0x6aad9487, ctime: 0x6aad948f, blocks: 0x16809 00010000:00010000:0.0:1789760656.729575:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760656.729595:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1789760656.729601:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760656.729608:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760656.729625:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760656.787535:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:3.0:1789760656.787544:0:8119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760655 -> 1789760656 00002000:00010000:3.0:1789760656.787547:0:8119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760655 -> 1789760656 00002000:00010000:3.0:1789760656.787549:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 92169 -> 94217 00010000:00010000:3.0:1789760656.787562:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.787575:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.787584:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.787592:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760656.787597:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.787606:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.787626:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760656.787652:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857548 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760656.787751:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777137792:12345-192.168.203.38@tcp:4:dd.500 Request processed in 58288us (160826us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789760656.787761:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:3.0:1789760656.787768:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332913082488 time 332913627892 state 0x2 ref 0 00000001:00080000:2.0:1789760656.787882:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00000100:00100000:3.0:1789760656.795479:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760656.795928:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777137920 00000100:00100000:2.0:1789760656.795938:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777137920 00000100:00100000:2.0:1789760656.795993:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 332913082488 time 332913627892 state 0x0 ref 1 00000100:00100000:2.0:1789760656.796006:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333113627892 time 332913627892 state 0x1 ref 1 00010000:00010000:3.0:1789760656.903115:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760656.929578:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333113627892 time 333113779217 state 0x0 ref 1 00000100:00100000:1.0:1789760656.929611:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777137920:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760656.929666:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 48234496, mtime: 0x6aad9490, atime: 0x6aad9487, ctime: 0x6aad9490, blocks: 0x17009 00010000:00010000:1.0:1789760656.929675:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760656.929717:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1789760656.929722:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760656.929744:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760656.929762:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760657.008552:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00002000:00010000:0.0:1789760657.008728:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:0.0:1789760657.008743:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 94217 -> 96265 00010000:00010000:0.0:1789760657.008757:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.008771:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.008780:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.008835:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760657.008840:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.008849:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.008870:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.008878:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a73985754f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760657.009144:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777137920:12345-192.168.203.38@tcp:4:dd.500 Request processed in 79544us (213670us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789760657.009154:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:0.0:1789760657.009162:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333113627892 time 333113779217 state 0x2 ref 0 00000100:00100000:3.0:1789760657.038024:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760657.038109:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777138048 00000100:00100000:2.0:1789760657.038119:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777138048 00000100:00100000:2.0:1789760657.038193:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333113627892 time 333113779217 state 0x0 ref 1 00000100:00100000:2.0:1789760657.038205:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333313779217 time 333113779217 state 0x1 ref 1 00000100:00080000:0.0:1789760657.038211:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760657.129870:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333313779217 time 333314070600 state 0x0 ref 1 00000100:00100000:2.0:1789760657.129910:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777138048:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760657.129968:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 49283072, mtime: 0x6aad9490, atime: 0x6aad9487, ctime: 0x6aad9490, blocks: 0x17809 00010000:00010000:2.0:1789760657.129978:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.129995:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1789760657.129999:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760657.130018:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.130033:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760657.221616:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:2.0:1789760657.221625:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 96265 -> 98313 00010000:00010000:2.0:1789760657.221639:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.221651:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.221659:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.221668:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760657.221673:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.221682:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.221700:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.221725:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739857556 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760657.221954:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777138048:12345-192.168.203.38@tcp:4:dd.500 Request processed in 91967us (183840us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789760657.221964:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1789760657.221972:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333313779217 time 333314070600 state 0x2 ref 0 00000001:00080000:3.0:1789760657.222032:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00000100:00100000:1.0:1789760657.235380:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760657.235445:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777138176 00000100:00100000:3.0:1789760657.235455:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777138176 00000100:00100000:3.0:1789760657.235513:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333313779217 time 333314070600 state 0x0 ref 1 00000100:00100000:3.0:1789760657.235527:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333514070600 time 333314070600 state 0x1 ref 1 00000100:00100000:2.0:1789760657.330365:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333514070600 time 333514564932 state 0x0 ref 1 00000100:00100000:2.0:1789760657.330411:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777138176:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760657.330963:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 50331648, mtime: 0x6aad9490, atime: 0x6aad9487, ctime: 0x6aad9490, blocks: 0x18009 00010000:00010000:2.0:1789760657.330973:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.330988:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1789760657.330993:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760657.330999:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.331014:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760657.416334:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00002000:00010000:2.0:1789760657.416505:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:2.0:1789760657.416510:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 98313 -> 100361 00010000:00010000:2.0:1789760657.416533:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.416546:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.416555:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.416563:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760657.416569:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.416578:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.416597:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760657.416605:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985755d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760657.416700:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777138176:12345-192.168.203.38@tcp:4:dd.500 Request processed in 86313us (181323us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789760657.417094:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:2.0:1789760657.417103:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333514070600 time 333514564932 state 0x2 ref 0 00000100:00100000:2.0:1789760657.429597:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760657.429780:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777138304 00000100:00100000:3.0:1789760657.429820:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777138304 00000100:00100000:3.0:1789760657.429878:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333514070600 time 333514564932 state 0x0 ref 1 00000100:00100000:3.0:1789760657.429893:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333714564932 time 333514564932 state 0x1 ref 1 00000100:00100000:3.0:1789760657.530426:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333714564932 time 333714629223 state 0x0 ref 1 00000100:00100000:3.0:1789760657.530462:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777138304:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760657.530510:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 51380224, mtime: 0x6aad9490, atime: 0x6aad9487, ctime: 0x6aad9490, blocks: 0x18809 00010000:00010000:3.0:1789760657.530516:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760657.530529:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1789760657.530532:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760657.530536:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760657.530547:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760657.606018:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:0.0:1789760657.606037:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 100361 -> 102409 00010000:00010000:0.0:1789760657.606052:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.606065:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.606088:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.606244:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dcc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760657.606250:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.606259:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.606280:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.606288:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739857564 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760657.606438:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777138304:12345-192.168.203.38@tcp:4:dd.500 Request processed in 75933us (176787us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789760657.606449:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:0.0:1789760657.606458:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333714564932 time 333714629223 state 0x2 ref 0 00000001:00080000:1.0:1789760657.607945:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00000100:00100000:0.0:1789760657.635378:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760657.635508:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777138432 00000100:00100000:3.0:1789760657.635519:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777138432 00000100:00100000:3.0:1789760657.635570:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333714564932 time 333714629223 state 0x0 ref 1 00000100:00100000:3.0:1789760657.635582:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333914629223 time 333714629223 state 0x1 ref 1 00000001:00080000:1.0:1789760657.638020:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967328 is committed 00000100:00100000:1.0:1789760657.731512:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333914629223 time 333915712879 state 0x0 ref 1 00000100:00100000:1.0:1789760657.731546:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777138432:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760657.731612:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 52428800, mtime: 0x6aad9490, atime: 0x6aad9487, ctime: 0x6aad9490, blocks: 0x19009 00010000:00010000:1.0:1789760657.731622:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760657.731637:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1789760657.731641:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760657.731647:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760657.731660:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760657.769657:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967376 is committed 00002000:00010000:1.0:1789760657.769829:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:1.0:1789760657.769834:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760656 -> 1789760657 00002000:00010000:1.0:1789760657.769837:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760656 -> 1789760657 00002000:00010000:1.0:1789760657.769839:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 102409 -> 104457 00010000:00010000:1.0:1789760657.769853:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760657.769865:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760657.769873:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760657.769880:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760657.769886:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760657.769895:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760657.769915:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760657.769922:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a73985756b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760657.770076:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777138432:12345-192.168.203.38@tcp:4:dd.500 Request processed in 38540us (134698us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789760657.770086:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:1.0:1789760657.770094:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333914629223 time 333915712879 state 0x2 ref 0 00000100:00100000:2.0:1789760657.778916:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760657.779040:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777138560 00000100:00100000:0.0:1789760657.779050:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777138560 00000100:00100000:0.0:1789760657.779101:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 333914629223 time 333915712879 state 0x0 ref 1 00000100:00100000:0.0:1789760657.779128:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334115712879 time 333915712879 state 0x1 ref 1 00010000:00010000:0.0:1789760657.926978:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760657.931627:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334115712879 time 334115825079 state 0x0 ref 1 00000100:00100000:0.0:1789760657.931663:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777138560:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760657.931735:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 53477376, mtime: 0x6aad9491, atime: 0x6aad9487, ctime: 0x6aad9491, blocks: 0x19809 00010000:00010000:0.0:1789760657.931882:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.931902:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1789760657.931908:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760657.931917:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.931936:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760657.996820:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967377 is committed 00002000:00010000:0.0:1789760657.996912:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:0.0:1789760657.996917:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 104457 -> 106505 00010000:00010000:0.0:1789760657.996931:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.997011:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.997021:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.997043:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760657.997049:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.997058:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.997078:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760657.997086:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857572 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760657.997217:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777138560:12345-192.168.203.38@tcp:4:dd.500 Request processed in 65566us (218304us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789760657.997228:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:0.0:1789760657.997237:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334115712879 time 334115825079 state 0x2 ref 0 00000100:00100000:2.0:1789760658.003457:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760658.003899:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777138688 00000100:00100000:0.0:1789760658.003908:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777138688 00000100:00100000:0.0:1789760658.004017:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334115712879 time 334115825079 state 0x0 ref 1 00000100:00100000:0.0:1789760658.004030:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334315825079 time 334115825079 state 0x1 ref 1 00000100:00100000:1.0:1789760658.119694:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fbc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798172160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760658.119784:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760658.119872:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760658.119882:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798172672:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.119916:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760658.119939:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798172288:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.119973:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760658.119978:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798172800:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.120003:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798173184:0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120019:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760658.120035:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760658.120048:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798173312:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.120060:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798173696:0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120078:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760658.120099:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798172160 00000100:00100000:1.0:1789760658.120106:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798172160 00000100:00100000:3.0:1789760658.120118:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798172416:0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120147:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760658.120166:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798172928:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.120171:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789760658.120184:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798172160:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760658.120200:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789760658.120219:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760658.120219:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798173440:0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120242:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760658.120263:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789760658.120269:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798172544:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.120275:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798172160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760658.120284:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789760658.120296:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760658.120315:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798173056:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.120322:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798172672 00000100:00100000:1.0:1789760658.120327:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798172672 00000100:00100000:3.0:1789760658.120338:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760658.120353:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798172416 00000100:00100000:1.0:1789760658.120358:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798172416 00000100:00100000:3.0:1789760658.120361:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798173568:0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120381:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760658.120403:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798172800 00000100:00100000:3.0:1789760658.120407:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798172800 00000100:00100000:3.0:1789760658.120432:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798172544 00000100:00100000:3.0:1789760658.120435:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798172544 00000100:00100000:3.0:1789760658.120451:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789760658.120458:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798172800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120496:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798172800:12345-0@lo:400:kworker.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760658.120503:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789760658.120504:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798172928 00000100:00100000:0.0:1789760658.120509:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798172928 00000100:00100000:3.0:1789760658.120520:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789760658.120528:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798172544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760658.120533:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798173440 00000100:00100000:0.0:1789760658.120543:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798173440 00000100:00100000:3.0:1789760658.120565:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798172544:12345-0@lo:400:kworker.0 Request processed in 38us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760658.120572:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798173056 00000100:00100000:3.0:1789760658.120574:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789760658.120578:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798173056 00000100:00100000:3.0:1789760658.120598:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798173184 00000100:00100000:0.0:1789760658.120600:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798173568 00000100:00100000:3.0:1789760658.120604:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798173184 00000100:00100000:0.0:1789760658.120605:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798173568 00000100:00100000:0.0:1789760658.120621:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789760658.120632:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798172672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120645:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798173312 00000100:00100000:3.0:1789760658.120649:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798173312 00000100:00100000:3.0:1789760658.120675:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789760658.120677:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798172672:12345-0@lo:400:kworker.0 Request processed in 45us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760658.120685:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798173184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760658.120689:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789760658.120706:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789760658.120714:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798172928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120741:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798173184:12345-0@lo:400:kworker.0 Request processed in 57us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760658.120748:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789760658.120765:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798172928:12345-0@lo:400:kworker.0 Request processed in 51us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760658.120766:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789760658.120777:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789760658.120780:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798173312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760658.120817:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789760658.120825:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798173440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120837:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798173312:12345-0@lo:400:kworker.0 Request processed in 60us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760658.120844:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789760658.120865:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798173440:12345-0@lo:400:kworker.0 Request processed in 40us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760658.120873:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789760658.120880:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798173056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.120909:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798173056:12345-0@lo:400:kworker.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760658.120939:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789760658.120956:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789760658.120964:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798173568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760658.120996:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798173568:12345-0@lo:400:kworker.0 Request processed in 34us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760658.121003:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789760658.121017:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fbc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798173824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789760658.121023:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760658.121028:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760658.121037:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760658.121039:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760658.121054:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760658.121057:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798172288 00000100:00100000:0.0:1789760658.121063:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798172288 00000100:00100000:2.0:1789760658.121091:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798172800:0@lo:400:kworker.0 00000100:00100000:0.0:1789760658.121097:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789760658.121106:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798172288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121109:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798173312:0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121148:0:3463:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967328 gen 2 00000100:00100000:0.0:1789760658.121154:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798172288:12345-0@lo:400:kworker.0 Request processed in 47us (1178us total) trans 0 rc 0/0 00000004:00080000:2.0:1789760658.121155:0:3463:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967328 committed transno 4294967328 00000100:00100000:0.0:1789760658.121165:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789760658.121178:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798172544:0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121194:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798173056:0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121206:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798173568:0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121217:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798172928:0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121230:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798173440:0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121298:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798173824 00000100:00100000:2.0:1789760658.121303:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798173824 00000100:00100000:2.0:1789760658.121334:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789760658.121342:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798173824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760658.121356:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760658.121390:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798173824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760658.121396:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789760658.121424:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fbc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798173824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760658.121451:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760658.121490:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798172672:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.121496:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789760658.121504:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798172288:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.121508:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798172416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121526:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fbc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798172160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760658.121557:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798172416:12345-0@lo:400:kworker.0 Request processed in 52us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760658.121559:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798173184:0@lo:400:kworker.0 00000100:00100000:1.0:1789760658.121571:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789760658.121599:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798173696 00000100:00100000:2.0:1789760658.121604:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798173696 00000100:00100000:1.0:1789760658.121610:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798172416:0@lo:400:kworker.0 00000100:00100000:2.0:1789760658.121635:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789760658.121645:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798173696:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789760658.121650:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760658.121683:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798173696:12345-0@lo:400:kworker.0 Request processed in 40us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760658.121691:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789760658.121706:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798173696:0@lo:400:kworker.0 00000100:00100000:3.0:1789760658.122212:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789760658.131963:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334315825079 time 334316163994 state 0x0 ref 1 00000100:00100000:0.0:1789760658.131992:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777138688:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760658.132046:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 54525952, mtime: 0x6aad9491, atime: 0x6aad9487, ctime: 0x6aad9491, blocks: 0x1a009 00010000:00010000:0.0:1789760658.132055:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760658.132071:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1789760658.132075:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760658.132081:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760658.132096:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760658.232437:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967378 is committed 00002000:00010000:1.0:1789760658.232513:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:1.0:1789760658.232519:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 106505 -> 108553 00010000:00010000:1.0:1789760658.232534:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760658.232546:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760658.232554:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760658.232560:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760658.232565:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760658.232591:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760658.232611:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760658.232617:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce9df1b6/0xc2b9a3a739857579 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760658.232991:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777138688:12345-192.168.203.38@tcp:4:dd.500 Request processed in 101006us (229536us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789760658.233001:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:1.0:1789760658.233010:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334315825079 time 334316163994 state 0x2 ref 0 00000100:00100000:2.0:1789760658.263649:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760658.263830:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777138816 00000100:00100000:0.0:1789760658.263839:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777138816 00000100:00100000:0.0:1789760658.263902:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334315825079 time 334316163994 state 0x0 ref 1 00000100:00100000:0.0:1789760658.263916:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334516163994 time 334316163994 state 0x1 ref 1 00000100:00100000:2.0:1789760658.332125:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334516163994 time 334516322594 state 0x0 ref 1 00000100:00100000:2.0:1789760658.332160:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777138816:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760658.332221:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 55574528, mtime: 0x6aad9491, atime: 0x6aad9487, ctime: 0x6aad9491, blocks: 0x1a809 00010000:00010000:2.0:1789760658.332231:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.332249:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1789760658.332253:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760658.332259:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.332274:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760658.431566:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967379 is committed 00002000:00010000:2.0:1789760658.431674:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:2.0:1789760658.431679:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 108553 -> 110601 00010000:00010000:2.0:1789760658.431692:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.431705:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.431714:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.431730:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760658.431735:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.431743:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.431762:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.431769:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857580 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760658.432016:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777138816:12345-192.168.203.38@tcp:4:dd.500 Request processed in 99868us (168373us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789760658.432040:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1789760658.432048:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334516163994 time 334516322594 state 0x2 ref 0 00000100:00100000:0.0:1789760658.447006:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760658.447080:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777138944 00000100:00100000:1.0:1789760658.447091:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777138944 00000100:00100000:1.0:1789760658.447144:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334516163994 time 334516322594 state 0x0 ref 1 00000100:00100000:1.0:1789760658.447157:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334716322594 time 334516322594 state 0x1 ref 1 00000100:00100000:3.0:1789760658.532341:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334716322594 time 334716537884 state 0x0 ref 1 00000100:00100000:3.0:1789760658.532374:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777138944:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760658.532432:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 56623104, mtime: 0x6aad9491, atime: 0x6aad9487, ctime: 0x6aad9491, blocks: 0x1b009 00010000:00010000:3.0:1789760658.532441:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760658.532457:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1789760658.532474:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760658.532481:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760658.532495:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760658.615617:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:2.0:1789760658.615626:0:13391:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760657 -> 1789760658 00002000:00010000:2.0:1789760658.615629:0:13391:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760657 -> 1789760658 00002000:00010000:2.0:1789760658.615631:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 110601 -> 112649 00010000:00010000:2.0:1789760658.615644:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.615657:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.615665:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.615673:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760658.615677:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.615697:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.615732:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.615759:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a739857587 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760658.615894:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777138944:12345-192.168.203.38@tcp:4:dd.500 Request processed in 83524us (168887us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789760658.615905:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:2.0:1789760658.615917:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334716322594 time 334716537884 state 0x2 ref 0 00000001:00080000:2.0:1789760658.619529:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967380 is committed 00000100:00100000:2.0:1789760658.631270:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798173952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760658.631342:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760658.632375:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798173952 00000100:00100000:0.0:1789760658.632385:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798173952 00000100:00100000:0.0:1789760658.632447:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789760658.632457:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798173952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760658.632498:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760658.632563:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798173952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760658.632569:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789760658.634579:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798173952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760658.646240:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760658.646351:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777139072 00000100:00100000:0.0:1789760658.646360:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777139072 00000100:00100000:0.0:1789760658.646417:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334716322594 time 334716537884 state 0x0 ref 1 00000100:00100000:0.0:1789760658.646431:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334916537884 time 334716537884 state 0x1 ref 1 00000100:00100000:0.0:1789760658.732625:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334916537884 time 334916825535 state 0x0 ref 1 00000100:00100000:0.0:1789760658.732659:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777139072:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760658.732731:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 57671680, mtime: 0x6aad9492, atime: 0x6aad9487, ctime: 0x6aad9492, blocks: 0x1b809 00010000:00010000:0.0:1789760658.732740:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760658.732755:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1789760658.732760:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760658.732766:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760658.732825:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760658.806564:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967381 is committed 00002000:00010000:2.0:1789760658.806981:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:2.0:1789760658.806987:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 112649 -> 114697 00010000:00010000:2.0:1789760658.807003:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.807016:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.807025:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.807059:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760658.807064:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.807073:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.807094:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.807102:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f99953/0xc2b9a3a73985758e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760658.807196:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777139072:12345-192.168.203.38@tcp:4:dd.500 Request processed in 74550us (160960us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789760658.807206:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:2.0:1789760658.807213:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334916537884 time 334916825535 state 0x2 ref 0 00000100:00100000:1.0:1789760658.820881:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760658.821046:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777139200 00000100:00100000:0.0:1789760658.821057:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777139200 00000100:00100000:0.0:1789760658.821111:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 334916537884 time 334916825535 state 0x0 ref 1 00000100:00100000:0.0:1789760658.821123:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335116825535 time 334916825535 state 0x1 ref 1 00000100:00100000:0.0:1789760658.932819:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335116825535 time 335116993681 state 0x0 ref 1 00000100:00100000:0.0:1789760658.932854:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777139200:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760658.932912:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 58720256, mtime: 0x6aad9492, atime: 0x6aad9487, ctime: 0x6aad9492, blocks: 0x1c009 00010000:00010000:0.0:1789760658.932922:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760658.932939:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1789760658.932944:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760658.932951:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760658.932969:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760658.952144:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789760659.004018:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:3.0:1789760659.004027:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 114697 -> 116745 00010000:00010000:3.0:1789760659.004042:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.004053:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.004062:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.004069:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760659.004074:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.004083:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.004103:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.004129:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b012424e/0xc2b9a3a739857595 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760659.004514:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777139200:12345-192.168.203.38@tcp:4:dd.500 Request processed in 71672us (183638us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1789760659.004525:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:3.0:1789760659.004533:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335116825535 time 335116993681 state 0x2 ref 0 00000001:00080000:2.0:1789760659.005823:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967382 is committed 00000100:00100000:2.0:1789760659.015594:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760659.015693:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777139328 00000100:00100000:3.0:1789760659.015722:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777139328 00000100:00100000:3.0:1789760659.015828:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335116825535 time 335116993681 state 0x0 ref 1 00000100:00100000:3.0:1789760659.015842:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335316993681 time 335116993681 state 0x1 ref 1 00000100:00080000:1.0:1789760659.016112:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760659.132952:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335316993681 time 335317144680 state 0x0 ref 1 00000100:00100000:0.0:1789760659.133003:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777139328:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760659.133067:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 59768832, mtime: 0x6aad9492, atime: 0x6aad9487, ctime: 0x6aad9492, blocks: 0x1c809 00010000:00010000:0.0:1789760659.133078:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760659.133095:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1789760659.133100:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760659.133106:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760659.133121:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760659.143180:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798174080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760659.143245:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760659.143369:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798174080 00000100:00100000:3.0:1789760659.143376:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798174080 00000100:00100000:3.0:1789760659.143428:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789760659.143438:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798174080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760659.143471:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760659.143516:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798174080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760659.143523:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789760659.143782:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798174080:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1789760659.237898:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967383 is committed 00002000:00010000:3.0:1789760659.238420:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:3.0:1789760659.238427:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 116745 -> 118793 00010000:00010000:3.0:1789760659.238440:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.238465:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.238473:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.238480:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760659.238485:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.238494:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.238513:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.238519:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061705614/0xc2b9a3a73985759c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760659.238651:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777139328:12345-192.168.203.38@tcp:4:dd.500 Request processed in 105656us (223062us total) trans 4294967383 rc 0/0 00000100:00100000:3.0:1789760659.238661:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:3.0:1789760659.238669:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335316993681 time 335317144680 state 0x2 ref 0 00000100:00100000:2.0:1789760659.247070:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760659.247301:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777139456 00000100:00100000:3.0:1789760659.247324:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777139456 00000100:00100000:3.0:1789760659.247395:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335316993681 time 335317144680 state 0x0 ref 1 00000100:00100000:3.0:1789760659.247408:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335517144680 time 335317144680 state 0x1 ref 1 00000100:00100000:3.0:1789760659.333161:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335517144680 time 335517359294 state 0x0 ref 1 00000100:00100000:3.0:1789760659.333206:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777139456:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760659.333279:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 60817408, mtime: 0x6aad9492, atime: 0x6aad9487, ctime: 0x6aad9492, blocks: 0x1d009 00010000:00010000:3.0:1789760659.333290:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.333307:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1789760659.333312:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760659.333319:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.333334:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760659.463139:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967384 is committed 00002000:00010000:1.0:1789760659.463409:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:1.0:1789760659.463415:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 118793 -> 120841 00010000:00010000:1.0:1789760659.463428:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760659.463459:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760659.463469:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760659.463476:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760659.463481:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760659.463490:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760659.463508:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760659.463516:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b59641e/0xc2b9a3a7398575a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760659.463621:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777139456:12345-192.168.203.38@tcp:4:dd.500 Request processed in 130437us (216555us total) trans 4294967384 rc 0/0 00000100:00100000:1.0:1789760659.463885:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:1.0:1789760659.463896:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335517144680 time 335517359294 state 0x2 ref 0 00000100:00100000:0.0:1789760659.474144:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760659.474230:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777139584 00000100:00100000:2.0:1789760659.474239:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777139584 00000100:00100000:2.0:1789760659.474290:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335517144680 time 335517359294 state 0x0 ref 1 00000100:00100000:2.0:1789760659.474302:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335717359294 time 335517359294 state 0x1 ref 1 00000100:00100000:3.0:1789760659.533999:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335717359294 time 335718198257 state 0x0 ref 1 00000100:00100000:3.0:1789760659.534039:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777139584:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760659.534116:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 61865984, mtime: 0x6aad9492, atime: 0x6aad9487, ctime: 0x6aad9492, blocks: 0x1d809 00010000:00010000:3.0:1789760659.534126:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.534161:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1789760659.534166:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760659.534173:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.534188:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760659.651633:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967385 is committed 00002000:00010000:2.0:1789760659.651834:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:2.0:1789760659.651840:0:13388:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760658 -> 1789760659 00002000:00010000:2.0:1789760659.651842:0:13388:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760658 -> 1789760659 00002000:00010000:2.0:1789760659.651844:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 120841 -> 122889 00010000:00010000:2.0:1789760659.651857:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.651870:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.651878:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.651885:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dcc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760659.651890:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.651899:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.651917:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.651939:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a7398575aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760659.652026:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777139584:12345-192.168.203.38@tcp:4:dd.500 Request processed in 118002us (177887us total) trans 4294967385 rc 0/0 00000100:00100000:2.0:1789760659.652036:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:2.0:1789760659.652045:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335717359294 time 335718198257 state 0x2 ref 0 00000100:00100000:1.0:1789760659.654992:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798174208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760659.655072:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760659.655216:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798174336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760659.655260:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760659.655348:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798174208 00000100:00100000:0.0:1789760659.655371:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798174208 00000100:00100000:0.0:1789760659.655411:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798174336 00000100:00100000:0.0:1789760659.655414:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798174336 00000100:00100000:0.0:1789760659.655430:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789760659.655438:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798174208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760659.655459:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 173604864 pending 0 free 3806330880 avail 3794796544 00000100:00100000:0.0:1789760659.655515:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798174208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760659.655523:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789760659.655539:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789760659.655554:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798174336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789760659.655564:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 173604864 pending 0 free 3806330880 avail 3794796544 00000100:00100000:1.0:1789760659.655773:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798174208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760659.655820:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798174336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760659.655843:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798174336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760659.655851:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789760659.666991:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760659.667211:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777139712 00000100:00100000:3.0:1789760659.667220:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777139712 00000100:00100000:3.0:1789760659.667280:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335717359294 time 335718198257 state 0x0 ref 1 00000100:00100000:3.0:1789760659.667292:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335918198257 time 335718198257 state 0x1 ref 1 00000100:00100000:2.0:1789760659.735881:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335918198257 time 335920080179 state 0x0 ref 1 00000100:00100000:2.0:1789760659.735926:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777139712:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760659.735989:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 62914560, mtime: 0x6aad9493, atime: 0x6aad9487, ctime: 0x6aad9493, blocks: 0x1e009 00010000:00010000:2.0:1789760659.735999:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.736015:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1789760659.736019:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760659.736025:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.736229:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760659.829432:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:2.0:1789760659.829442:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 122889 -> 124937 00010000:00010000:2.0:1789760659.829469:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.829482:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.829490:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.829498:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760659.829503:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.829512:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.829535:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760659.829544:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398575b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760659.829649:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777139712:12345-192.168.203.38@tcp:4:dd.500 Request processed in 93734us (162661us total) trans 4294967386 rc 0/0 00000100:00100000:2.0:1789760659.829659:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:2.0:1789760659.829669:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335918198257 time 335920080179 state 0x2 ref 0 00000001:00080000:2.0:1789760659.829961:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967386 is committed 00000100:00100000:0.0:1789760659.844088:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760659.844304:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777139840 00000100:00100000:3.0:1789760659.844314:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777139840 00000100:00100000:3.0:1789760659.844379:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 335918198257 time 335920080179 state 0x0 ref 1 00000100:00100000:3.0:1789760659.844392:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336120080179 time 335920080179 state 0x1 ref 1 00000100:00100000:0.0:1789760659.937558:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336120080179 time 336121757833 state 0x0 ref 1 00000100:00100000:0.0:1789760659.937590:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777139840:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760659.937657:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 63963136, mtime: 0x6aad9493, atime: 0x6aad9487, ctime: 0x6aad9493, blocks: 0x1e809 00010000:00010000:0.0:1789760659.937667:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760659.937683:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1789760659.937688:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760659.937695:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760659.937717:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760659.980913:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789760660.021926:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:3.0:1789760660.021934:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 124937 -> 126985 00010000:00010000:3.0:1789760660.021949:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.021974:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.021983:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.021990:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760660.021994:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.022002:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.022020:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.022027:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f62b18e1/0xc2b9a3a7398575b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760660.022116:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777139840:12345-192.168.203.38@tcp:4:dd.500 Request processed in 84536us (178032us total) trans 4294967387 rc 0/0 00000100:00100000:3.0:1789760660.022126:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:3.0:1789760660.022134:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336120080179 time 336121757833 state 0x2 ref 0 00000001:00080000:3.0:1789760660.022277:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967387 is committed 00000100:00100000:2.0:1789760660.029164:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760660.029407:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777139968 00000100:00100000:1.0:1789760660.029416:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777139968 00000100:00100000:1.0:1789760660.029467:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336120080179 time 336121757833 state 0x0 ref 1 00000100:00100000:1.0:1789760660.029480:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336321757833 time 336121757833 state 0x1 ref 1 00000100:00100000:0.0:1789760660.138350:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336321757833 time 336322541553 state 0x0 ref 1 00000100:00100000:0.0:1789760660.138393:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777139968:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760660.138454:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 65011712, mtime: 0x6aad9493, atime: 0x6aad9487, ctime: 0x6aad9493, blocks: 0x1f009 00010000:00010000:0.0:1789760660.138476:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760660.138493:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1789760660.138498:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760660.138505:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760660.138519:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760660.231968:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967388 is committed 00002000:00010000:1.0:1789760660.232101:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:1.0:1789760660.232106:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 126985 -> 129033 00010000:00010000:1.0:1789760660.232120:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760660.232133:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760660.232142:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760660.232150:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760660.232154:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760660.232163:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760660.232183:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760660.232205:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398575bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760660.232310:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777139968:12345-192.168.203.38@tcp:4:dd.500 Request processed in 93929us (203150us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789760660.232321:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:1.0:1789760660.232329:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336321757833 time 336322541553 state 0x2 ref 0 00000100:00100000:2.0:1789760660.272014:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760660.272126:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777140096 00000100:00100000:3.0:1789760660.272137:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777140096 00000100:00100000:3.0:1789760660.272195:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336321757833 time 336322541553 state 0x0 ref 1 00000100:00100000:3.0:1789760660.272209:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336522541553 time 336322541553 state 0x1 ref 1 00000100:00100000:2.0:1789760660.338503:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336522541553 time 336522704834 state 0x0 ref 1 00000100:00100000:2.0:1789760660.338537:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777140096:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760660.338592:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 66060288, mtime: 0x6aad9493, atime: 0x6aad9487, ctime: 0x6aad9493, blocks: 0x1f809 00010000:00010000:2.0:1789760660.338600:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.338614:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1789760660.338618:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760660.338624:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.338638:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760660.393937:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967389 is committed 00002000:00010000:3.0:1789760660.394113:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:3.0:1789760660.394119:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 129033 -> 131081 00010000:00010000:3.0:1789760660.394134:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.394147:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.394157:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.394165:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760660.394170:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.394180:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.394200:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.394208:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398575c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760660.394314:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777140096:12345-192.168.203.38@tcp:4:dd.500 Request processed in 55788us (122303us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789760660.394325:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:3.0:1789760660.394334:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336522541553 time 336522704834 state 0x2 ref 0 00000100:00100000:0.0:1789760660.399658:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760660.399723:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777140224 00000100:00100000:2.0:1789760660.399733:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777140224 00000100:00100000:2.0:1789760660.399821:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336522541553 time 336522704834 state 0x0 ref 1 00000100:00100000:2.0:1789760660.399835:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336722704834 time 336522704834 state 0x1 ref 1 00000100:00100000:2.0:1789760660.538610:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336722704834 time 336722810366 state 0x0 ref 1 00000100:00100000:2.0:1789760660.538643:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777140224:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760660.538722:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 67108864, mtime: 0x6aad9493, atime: 0x6aad9487, ctime: 0x6aad9493, blocks: 0x20009 00010000:00010000:2.0:1789760660.538744:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.538758:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1789760660.538762:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760660.538766:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.538777:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760660.577450:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967390 is committed 00002000:00010000:2.0:1789760660.577567:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:2.0:1789760660.577573:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 131081 -> 133129 00010000:00010000:2.0:1789760660.577586:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.577600:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.577607:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.577612:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760660.577615:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.577622:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.577649:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.577654:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760660.577745:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777140224:12345-192.168.203.38@tcp:4:dd.500 Request processed in 39113us (178092us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789760660.577755:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:2.0:1789760660.577762:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336722704834 time 336722810366 state 0x2 ref 0 00000100:00100000:0.0:1789760660.582278:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760660.582400:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777140352 00000100:00100000:3.0:1789760660.582409:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777140352 00000100:00100000:3.0:1789760660.582453:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336722704834 time 336722810366 state 0x0 ref 1 00000100:00100000:3.0:1789760660.582463:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336922810366 time 336722810366 state 0x1 ref 1 00000100:00100000:2.0:1789760660.738758:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336922810366 time 336922958636 state 0x0 ref 1 00000100:00100000:2.0:1789760660.738830:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777140352:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760660.739256:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 68157440, mtime: 0x6aad9493, atime: 0x6aad9487, ctime: 0x6aad9493, blocks: 0x20809 00010000:00010000:2.0:1789760660.739266:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.739282:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1789760660.739287:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760660.739293:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.739307:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760660.814491:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:3.0:1789760660.814500:0:8118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760659 -> 1789760660 00002000:00010000:3.0:1789760660.814503:0:8118:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760659 -> 1789760660 00002000:00010000:3.0:1789760660.814505:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 133129 -> 135177 00010000:00010000:3.0:1789760660.814519:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.814533:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.814543:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.814551:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760660.814568:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.814577:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.814594:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760660.814601:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398575d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760660.814692:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777140352:12345-192.168.203.38@tcp:4:dd.500 Request processed in 75910us (232418us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789760660.814713:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:3.0:1789760660.814722:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336922810366 time 336922958636 state 0x2 ref 0 00000001:00080000:0.0:1789760660.819208:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967391 is committed 00000100:00100000:0.0:1789760660.820935:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760660.821035:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777140480 00000100:00100000:2.0:1789760660.821045:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777140480 00000100:00100000:2.0:1789760660.821096:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 336922810366 time 336922958636 state 0x0 ref 1 00000100:00100000:2.0:1789760660.821109:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337122958636 time 336922958636 state 0x1 ref 1 00000100:00100000:0.0:1789760660.940272:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337122958636 time 337124471641 state 0x0 ref 1 00000100:00100000:2.0:1789760660.944972:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777140480:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760660.945042:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 69206016, mtime: 0x6aad9494, atime: 0x6aad9487, ctime: 0x6aad9494, blocks: 0x21009 00010000:00010000:2.0:1789760660.945052:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.945070:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1789760660.945074:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760660.945080:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.945098:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760660.999299:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760661.007847:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967392 is committed 00002000:00010000:0.0:1789760661.008161:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:0.0:1789760661.008165:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 135177 -> 137225 00010000:00010000:0.0:1789760661.008179:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.008192:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.008200:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.008225:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760661.008230:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.008238:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.008257:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.008264:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a7398575db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760661.008395:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777140480:12345-192.168.203.38@tcp:4:dd.500 Request processed in 68100us (187463us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789760661.008405:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:0.0:1789760661.008413:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337122958636 time 337124471641 state 0x2 ref 0 00000100:00100000:2.0:1789760661.024673:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760661.024977:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777140608 00000100:00100000:3.0:1789760661.024988:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777140608 00000100:00100000:3.0:1789760661.025156:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337122958636 time 337124471641 state 0x0 ref 1 00000100:00100000:3.0:1789760661.025170:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337324471641 time 337124471641 state 0x1 ref 1 00000100:00080000:1.0:1789760661.025242:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760661.037681:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760661.037726:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760661.037829:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777140864 00000100:00100000:2.0:1789760661.037839:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777140864 00000100:00100000:2.0:1789760661.037910:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 259 00000100:00100000:2.0:1789760661.037920:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777140864:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760661.038006:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777140864:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 88us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760661.038014:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 259 00000100:00080000:3.0:1789760661.038187:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760661.038344:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760661.038374:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760661.038402:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760661.038425:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760661.038442:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777141376 00000100:00100000:0.0:1789760661.038452:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777141376 00000100:00100000:0.0:1789760661.038479:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777140992 00000100:00100000:0.0:1789760661.038481:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777140992 00000100:00100000:0.0:1789760661.038498:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777141248 00000100:00100000:0.0:1789760661.038501:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777141248 00000100:00100000:0.0:1789760661.038516:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 260 00000100:00100000:0.0:1789760661.038522:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777141376:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760661.038558:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777141376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760661.038565:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 260 00000100:00100000:0.0:1789760661.038577:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 261 00000100:00100000:0.0:1789760661.038583:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777140992:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760661.038605:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777140992:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760661.038611:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 261 00000100:00100000:0.0:1789760661.038621:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 262 00000100:00100000:0.0:1789760661.038627:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777141248:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760661.038648:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777141248:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760661.038654:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 262 00000100:00100000:3.0:1789760661.038866:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777140736 00000100:00100000:3.0:1789760661.038871:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777140736 00000100:00100000:3.0:1789760661.038902:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 346 00000100:00100000:3.0:1789760661.038910:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777140736:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760661.038948:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777140736:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760661.038955:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 346 00000100:00080000:3.0:1789760661.038981:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760661.038984:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760661.041714:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777141120 00000100:00100000:1.0:1789760661.041729:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777141120 00000100:00100000:1.0:1789760661.041833:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:1.0:1789760661.041844:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777141120:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760661.041912:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777141120:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 70us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760661.041919:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00080000:3.0:1789760661.042107:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760661.142604:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337324471641 time 337326801025 state 0x0 ref 1 00000100:00100000:3.0:1789760661.142638:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777140608:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760661.142694:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 70254592, mtime: 0x6aad9494, atime: 0x6aad9487, ctime: 0x6aad9494, blocks: 0x21809 00010000:00010000:3.0:1789760661.142716:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760661.142731:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1789760661.142735:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760661.142741:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760661.142756:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760661.185694:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967393 is committed 00002000:00010000:1.0:1789760661.185749:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:1.0:1789760661.185755:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 137225 -> 139273 00010000:00010000:1.0:1789760661.185771:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.185814:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.185843:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.185851:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760661.185857:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.185867:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.185968:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.185978:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c0b7c7/0xc2b9a3a7398575e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760661.186068:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777140608:12345-192.168.203.38@tcp:4:dd.500 Request processed in 43442us (161400us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789760661.186078:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:1.0:1789760661.186086:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337324471641 time 337326801025 state 0x2 ref 0 00000100:00100000:0.0:1789760661.192872:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760661.193131:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777141504 00000100:00100000:2.0:1789760661.193141:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777141504 00000100:00100000:2.0:1789760661.193191:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337324471641 time 337326801025 state 0x0 ref 1 00000100:00100000:2.0:1789760661.193203:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337526801025 time 337326801025 state 0x1 ref 1 00000100:00100000:3.0:1789760661.342769:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337526801025 time 337526969193 state 0x0 ref 1 00000100:00100000:3.0:1789760661.342834:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777141504:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760661.342889:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 71303168, mtime: 0x6aad9494, atime: 0x6aad9487, ctime: 0x6aad9494, blocks: 0x22009 00010000:00010000:3.0:1789760661.342898:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760661.342927:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1789760661.342931:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760661.342938:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760661.342952:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760661.381188:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967394 is committed 00002000:00010000:0.0:1789760661.381253:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:0.0:1789760661.381259:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 139273 -> 141321 00010000:00010000:0.0:1789760661.381273:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.381300:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.381307:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.381312:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dde00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760661.381317:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.381323:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.381339:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.381344:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398575e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760661.381462:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777141504:12345-192.168.203.38@tcp:4:dd.500 Request processed in 38672us (188596us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789760661.381470:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:0.0:1789760661.381477:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337526801025 time 337526969193 state 0x2 ref 0 00000100:00100000:2.0:1789760661.388959:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760661.389055:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777141632 00000100:00100000:3.0:1789760661.389072:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777141632 00000100:00100000:3.0:1789760661.389123:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337526801025 time 337526969193 state 0x0 ref 1 00000100:00100000:3.0:1789760661.389148:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337726969193 time 337526969193 state 0x1 ref 1 00000100:00100000:2.0:1789760661.542945:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337726969193 time 337727143897 state 0x0 ref 1 00000100:00100000:3.0:1789760661.545919:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777141632:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760661.546062:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 72351744, mtime: 0x6aad9494, atime: 0x6aad9487, ctime: 0x6aad9494, blocks: 0x22809 00010000:00010000:3.0:1789760661.546073:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760661.546089:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1789760661.546093:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760661.546100:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760661.546116:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760661.621036:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:1.0:1789760661.621045:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 141321 -> 143369 00010000:00010000:1.0:1789760661.621059:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.621086:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.621096:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.621104:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dce00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760661.621109:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.621119:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.621138:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.621146:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398575f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760661.621263:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777141632:12345-192.168.203.38@tcp:4:dd.500 Request processed in 77336us (232309us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789760661.621273:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:1.0:1789760661.621282:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337726969193 time 337727143897 state 0x2 ref 0 00000001:00080000:2.0:1789760661.624327:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967395 is committed 00000100:00100000:2.0:1789760661.635978:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760661.636055:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777141760 00000100:00100000:0.0:1789760661.636077:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777141760 00000100:00100000:0.0:1789760661.636129:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337726969193 time 337727143897 state 0x0 ref 1 00000100:00100000:0.0:1789760661.636142:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337927143897 time 337727143897 state 0x1 ref 1 00000100:00100000:3.0:1789760661.743607:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337927143897 time 337927808704 state 0x0 ref 1 00000100:00100000:3.0:1789760661.743636:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777141760:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760661.743693:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 73400320, mtime: 0x6aad9494, atime: 0x6aad9487, ctime: 0x6aad9494, blocks: 0x23009 00010000:00010000:3.0:1789760661.743712:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760661.743728:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1789760661.743732:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760661.743738:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760661.743761:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760661.832504:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:0.0:1789760661.832514:0:13392:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760660 -> 1789760661 00002000:00010000:0.0:1789760661.832517:0:13392:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760660 -> 1789760661 00002000:00010000:0.0:1789760661.832519:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 143369 -> 145417 00010000:00010000:0.0:1789760661.832533:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.832545:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.832555:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.832562:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dca00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760661.832567:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.832576:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.832597:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760661.832623:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398575f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760661.832826:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967396 is committed 00000100:00100000:0.0:1789760661.834965:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777141760:12345-192.168.203.38@tcp:4:dd.500 Request processed in 91331us (198986us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789760661.834979:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:0.0:1789760661.834987:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337927143897 time 337927808704 state 0x2 ref 0 00000100:00100000:2.0:1789760661.841912:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760661.842124:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777141888 00000100:00100000:1.0:1789760661.842133:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777141888 00000100:00100000:1.0:1789760661.842249:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 337927143897 time 337927808704 state 0x0 ref 1 00000100:00100000:1.0:1789760661.842324:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338127808704 time 337927808704 state 0x1 ref 1 00000100:00100000:1.0:1789760661.943928:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338127808704 time 338128128759 state 0x0 ref 1 00000100:00100000:1.0:1789760661.943961:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777141888:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760661.944016:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 74448896, mtime: 0x6aad9495, atime: 0x6aad9487, ctime: 0x6aad9495, blocks: 0x23809 00010000:00010000:1.0:1789760661.944024:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.944040:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1789760661.944044:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760661.944050:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760661.944065:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.023051:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789760662.071544:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967397 is committed 00002000:00010000:2.0:1789760662.071709:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:2.0:1789760662.071715:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 145417 -> 147465 00010000:00010000:2.0:1789760662.071729:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.071742:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.071751:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.071758:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ec00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760662.071763:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.071807:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.071829:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.071837:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a7398575fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760662.071937:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777141888:12345-192.168.203.38@tcp:4:dd.500 Request processed in 127986us (230029us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789760662.071948:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:2.0:1789760662.071956:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338127808704 time 338128128759 state 0x2 ref 0 00000100:00100000:0.0:1789760662.079130:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760662.079260:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777142016 00000100:00100000:3.0:1789760662.079269:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777142016 00000100:00100000:3.0:1789760662.079318:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338127808704 time 338128128759 state 0x0 ref 1 00000100:00100000:3.0:1789760662.079330:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338328128759 time 338128128759 state 0x1 ref 1 00000100:00100000:2.0:1789760662.144128:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338328128759 time 338328327481 state 0x0 ref 1 00000100:00100000:2.0:1789760662.144163:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777142016:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760662.144237:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 75497472, mtime: 0x6aad9495, atime: 0x6aad9487, ctime: 0x6aad9495, blocks: 0x24009 00010000:00010000:2.0:1789760662.144248:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.144265:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1789760662.144270:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760662.144277:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.144312:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760662.234893:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967398 is committed 00002000:00010000:0.0:1789760662.235168:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:0.0:1789760662.235174:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 147465 -> 149513 00010000:00010000:0.0:1789760662.235189:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.235203:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.235212:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.235220:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760662.235224:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.235250:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.235267:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.235274:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857605 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760662.235373:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777142016:12345-192.168.203.38@tcp:4:dd.500 Request processed in 91223us (156248us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789760662.235384:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:0.0:1789760662.235392:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338328128759 time 338328327481 state 0x2 ref 0 00000100:00100000:0.0:1789760662.251854:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760662.253134:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777142144 00000100:00100000:1.0:1789760662.253145:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777142144 00000100:00100000:1.0:1789760662.253200:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338328128759 time 338328327481 state 0x0 ref 1 00000100:00100000:1.0:1789760662.253213:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338528327481 time 338328327481 state 0x1 ref 1 00000100:00100000:2.0:1789760662.344717:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338528327481 time 338528917638 state 0x0 ref 1 00000100:00100000:2.0:1789760662.344751:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777142144:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760662.344839:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 76546048, mtime: 0x6aad9495, atime: 0x6aad9487, ctime: 0x6aad9495, blocks: 0x24809 00010000:00010000:2.0:1789760662.344850:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.344867:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1789760662.344871:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760662.344879:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760662.344894:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760662.477114:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:3.0:1789760662.477124:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 149513 -> 151561 00010000:00010000:3.0:1789760662.477137:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.477170:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.477187:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.477194:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760662.477198:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.477207:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.477226:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.477234:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a73985760c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760662.477328:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777142144:12345-192.168.203.38@tcp:4:dd.500 Request processed in 132589us (225479us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789760662.477338:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:3.0:1789760662.477354:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338528327481 time 338528917638 state 0x2 ref 0 00000001:00080000:2.0:1789760662.479055:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967399 is committed 00000100:00100000:1.0:1789760662.490826:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760662.491057:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777142272 00000100:00100000:0.0:1789760662.491067:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777142272 00000100:00100000:0.0:1789760662.491121:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338528327481 time 338528917638 state 0x0 ref 1 00000100:00100000:0.0:1789760662.491134:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338728917638 time 338528917638 state 0x1 ref 1 00000100:00100000:1.0:1789760662.544932:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338728917638 time 338729132644 state 0x0 ref 1 00000100:00100000:1.0:1789760662.544977:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777142272:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760662.545038:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 77594624, mtime: 0x6aad9495, atime: 0x6aad9487, ctime: 0x6aad9495, blocks: 0x25009 00010000:00010000:1.0:1789760662.545048:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760662.545063:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1789760662.545068:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760662.545074:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760662.545099:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760662.637421:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967400 is committed 00002000:00010000:3.0:1789760662.637825:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:3.0:1789760662.637841:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760661 -> 1789760662 00002000:00010000:3.0:1789760662.637843:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760661 -> 1789760662 00002000:00010000:3.0:1789760662.637845:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 151561 -> 153609 00010000:00010000:3.0:1789760662.637858:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.637870:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.637877:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.637884:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760662.637888:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.637896:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.637914:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.637922:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a37e62/0xc2b9a3a739857613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760662.638013:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777142272:12345-192.168.203.38@tcp:4:dd.500 Request processed in 93043us (147229us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789760662.638032:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:3.0:1789760662.638040:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338728917638 time 338729132644 state 0x2 ref 0 00000100:00100000:1.0:1789760662.649318:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760662.649560:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777142400 00000100:00100000:2.0:1789760662.649570:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777142400 00000100:00100000:2.0:1789760662.649622:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338728917638 time 338729132644 state 0x0 ref 1 00000100:00100000:2.0:1789760662.649636:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338929132644 time 338729132644 state 0x1 ref 1 00000100:00100000:1.0:1789760662.745199:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338929132644 time 338929399457 state 0x0 ref 1 00000100:00100000:1.0:1789760662.745231:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777142400:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760662.745287:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 78643200, mtime: 0x6aad9496, atime: 0x6aad9487, ctime: 0x6aad9496, blocks: 0x25809 00010000:00010000:1.0:1789760662.745295:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760662.745312:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1789760662.745317:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760662.745323:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760662.745569:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760662.828965:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967401 is committed 00002000:00010000:3.0:1789760662.829136:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789760662.829142:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 153609 -> 155657 00010000:00010000:3.0:1789760662.829155:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.829166:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.829185:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.829192:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ec00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760662.829196:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.829205:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.829227:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760662.829233:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a73985761a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760662.829354:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777142400:12345-192.168.203.38@tcp:4:dd.500 Request processed in 84125us (180034us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789760662.829372:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:3.0:1789760662.829380:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338929132644 time 338929399457 state 0x2 ref 0 00000100:00100000:0.0:1789760662.838232:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760662.838680:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777142528 00000100:00100000:2.0:1789760662.838699:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777142528 00000100:00100000:2.0:1789760662.838751:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 338929132644 time 338929399457 state 0x0 ref 1 00000100:00100000:2.0:1789760662.838762:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339129399457 time 338929399457 state 0x1 ref 1 00000100:00100000:0.0:1789760662.946148:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339129399457 time 339130350301 state 0x0 ref 1 00000100:00100000:0.0:1789760662.946192:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777142528:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760662.946269:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 79691776, mtime: 0x6aad9496, atime: 0x6aad9487, ctime: 0x6aad9496, blocks: 0x26009 00010000:00010000:0.0:1789760662.946278:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.946293:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1789760662.946297:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760662.946304:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760662.946318:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760663.052115:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760663.055721:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967402 is committed 00002000:00010000:3.0:1789760663.055905:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:3.0:1789760663.055910:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 155657 -> 157705 00010000:00010000:3.0:1789760663.055923:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.055937:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.055946:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.055953:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760663.055958:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.055968:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.055994:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.056022:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857621 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760663.056114:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777142528:12345-192.168.203.38@tcp:4:dd.500 Request processed in 109944us (217886us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789760663.056124:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:3.0:1789760663.056132:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339129399457 time 339130350301 state 0x2 ref 0 00000100:00100000:2.0:1789760663.066761:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760663.066999:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777142656 00000100:00100000:3.0:1789760663.067009:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777142656 00000100:00100000:3.0:1789760663.067064:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339129399457 time 339130350301 state 0x0 ref 1 00000100:00100000:3.0:1789760663.067087:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339330350301 time 339130350301 state 0x1 ref 1 00000100:00080000:0.0:1789760663.067288:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760663.146352:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339330350301 time 339330543504 state 0x0 ref 1 00000100:00100000:2.0:1789760663.146497:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777142656:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760663.146557:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 80740352, mtime: 0x6aad9496, atime: 0x6aad9487, ctime: 0x6aad9496, blocks: 0x26809 00010000:00010000:2.0:1789760663.146567:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760663.146583:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1789760663.146587:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760663.146593:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760663.146609:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760663.216391:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967403 is committed 00002000:00010000:1.0:1789760663.216667:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:1.0:1789760663.216673:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 157705 -> 159753 00010000:00010000:1.0:1789760663.216694:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.216706:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.216715:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.216722:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760663.216728:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.216737:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.216756:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.216780:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf59545/0xc2b9a3a739857628 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760663.216963:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777142656:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70479us (150208us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789760663.216972:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:1.0:1789760663.216980:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339330350301 time 339330543504 state 0x2 ref 0 00000100:00100000:2.0:1789760663.226331:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760663.226516:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777142784 00000100:00100000:3.0:1789760663.226525:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777142784 00000100:00100000:3.0:1789760663.226574:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339330350301 time 339330543504 state 0x0 ref 1 00000100:00100000:3.0:1789760663.226586:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339530543504 time 339330543504 state 0x1 ref 1 00000100:00100000:1.0:1789760663.239218:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798174720:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239290:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760663.239373:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798175232:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239398:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760663.239418:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798175744:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239439:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760663.239474:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789760663.239479:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798174848:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239500:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760663.239517:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798175360:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239540:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760663.239554:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798175872:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239573:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760663.239606:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798175232 00000100:00100000:1.0:1789760663.239614:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798175232 00000100:00100000:1.0:1789760663.239659:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798175744 00000100:00100000:1.0:1789760663.239674:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798175744 00000100:00100000:1.0:1789760663.239704:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798174848 00000100:00100000:1.0:1789760663.239707:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798174848 00000100:00100000:1.0:1789760663.239720:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789760663.239727:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798175232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239773:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798175232:12345-0@lo:400:kworker.0 Request processed in 46us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760663.239780:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789760663.239818:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789760663.239824:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798175744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239850:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798175744:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760663.239856:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789760663.239866:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789760663.239872:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798174848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.239897:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798174848:12345-0@lo:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760663.239902:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789760663.239923:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798175360 00000100:00100000:1.0:1789760663.239927:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798175360 00000100:00100000:1.0:1789760663.239949:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798175872 00000100:00100000:1.0:1789760663.239952:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798175872 00000100:00100000:1.0:1789760663.239970:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789760663.239976:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798175360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.240004:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798175360:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760663.240010:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789760663.240029:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789760663.240035:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798175872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.240062:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798175872:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760663.240068:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1789760663.240082:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760663.240086:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760663.240088:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760663.240115:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798174848:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.240125:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798175360:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.240133:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798175872:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.240140:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798175232:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.240148:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798175744:0@lo:400:kworker.0 00000100:00100000:0.0:1789760663.240592:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798174720 00000100:00100000:0.0:1789760663.240597:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798174720 00000100:00100000:0.0:1789760663.240635:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789760663.240643:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798174720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760663.240682:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798174720:12345-0@lo:400:kworker.0 Request processed in 40us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760663.240696:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789760663.240762:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798174592:0@lo:400:kworker.0 00000100:00100000:3.0:1789760663.240880:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760663.240994:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798174464:0@lo:400:kworker.0 00000100:00100000:2.0:1789760663.241028:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760663.241055:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798174976:0@lo:400:kworker.0 00000100:00100000:2.0:1789760663.241098:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760663.241115:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798175488:0@lo:400:kworker.0 00000100:00100000:2.0:1789760663.241136:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760663.241153:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798176000:0@lo:400:kworker.0 00000100:00100000:2.0:1789760663.241184:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760663.241217:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798175488 00000100:00100000:2.0:1789760663.241220:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798175488 00000100:00100000:2.0:1789760663.241254:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798176000 00000100:00100000:2.0:1789760663.241257:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798176000 00000100:00100000:2.0:1789760663.241273:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789760663.241279:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798175488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760663.241314:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798175488:12345-0@lo:400:kworker.0 Request processed in 35us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760663.241320:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789760663.241333:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789760663.241640:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798175104:0@lo:400:kworker.0 00000100:00100000:3.0:1789760663.241665:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760663.241691:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798176000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760663.241722:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798176000:12345-0@lo:400:kworker.0 Request processed in 383us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760663.241728:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789760663.241805:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798174976 00000100:00100000:1.0:1789760663.241810:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798174976 00000100:00100000:1.0:1789760663.241837:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789760663.241843:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798174976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.241875:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798174976:12345-0@lo:400:kworker.0 Request processed in 32us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760663.241881:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789760663.241914:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798174720:0@lo:400:kworker.0 00000100:00100000:3.0:1789760663.245313:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798175616:0@lo:400:kworker.0 00000100:00100000:3.0:1789760663.245622:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760663.245704:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798174592 00000100:00100000:0.0:1789760663.245711:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798174592 00000100:00100000:0.0:1789760663.245759:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798175104 00000100:00100000:0.0:1789760663.245762:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798175104 00000100:00100000:0.0:1789760663.245784:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789760663.245810:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798174592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760663.245863:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798174592:12345-0@lo:400:kworker.0 Request processed in 55us (4983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760663.245877:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789760663.245893:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789760663.245899:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798175104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760663.245928:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798175104:12345-0@lo:400:kworker.0 Request processed in 29us (4262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760663.245933:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789760663.246384:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798174464 00000100:00100000:0.0:1789760663.246389:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798174464 00000100:00100000:0.0:1789760663.246418:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789760663.246425:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798174464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760663.246460:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798174464:12345-0@lo:400:kworker.0 Request processed in 36us (5430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760663.246466:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789760663.246626:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760663.246639:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798176256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760663.246669:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760663.246707:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798176256 00000100:00100000:0.0:1789760663.246711:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798176256 00000100:00100000:0.0:1789760663.246737:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789760663.246743:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798176256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760663.246772:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760663.246820:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798176256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760663.246827:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789760663.246874:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798176256:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789760663.251948:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760663.251959:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760663.251962:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760663.252007:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798174464:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.252041:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798174976:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.252055:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798175488:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.252066:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798176000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.252105:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760663.252115:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798176128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760663.252457:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760663.252614:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798176128 00000100:00100000:0.0:1789760663.252621:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798176128 00000100:00100000:0.0:1789760663.252659:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789760663.252668:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798176128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760663.252701:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760663.252755:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798176128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760663.252762:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789760663.252839:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798176128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760663.253297:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798175616 00000100:00100000:0.0:1789760663.253302:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798175616 00000100:00100000:0.0:1789760663.253351:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789760663.253366:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798175616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760663.253412:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798175616:12345-0@lo:400:kworker.0 Request processed in 49us (7790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760663.253418:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1789760663.255012:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760663.256593:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798175616:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.256630:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798174592:0@lo:400:kworker.0 00000100:00100000:1.0:1789760663.256642:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798175104:0@lo:400:kworker.0 00000100:00100000:3.0:1789760663.347125:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339530543504 time 339531326037 state 0x0 ref 1 00000100:00100000:3.0:1789760663.347158:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777142784:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760663.347224:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 81788928, mtime: 0x6aad9496, atime: 0x6aad9487, ctime: 0x6aad9496, blocks: 0x27009 00010000:00010000:3.0:1789760663.347233:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.347248:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1789760663.347253:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760663.347259:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.347274:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760663.448395:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:3.0:1789760663.448404:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 159753 -> 161801 00010000:00010000:3.0:1789760663.448418:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.448432:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.448441:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.448468:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760663.448473:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.448482:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.448501:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.448509:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a73985762f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760663.448606:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777142784:12345-192.168.203.38@tcp:4:dd.500 Request processed in 101458us (222281us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1789760663.448617:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:3.0:1789760663.448625:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339530543504 time 339531326037 state 0x2 ref 0 00000001:00080000:3.0:1789760663.448665:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967404 is committed 00000100:00100000:0.0:1789760663.461827:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760663.462385:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777142912 00000100:00100000:3.0:1789760663.462396:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777142912 00000100:00100000:3.0:1789760663.462448:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339530543504 time 339531326037 state 0x0 ref 1 00000100:00100000:3.0:1789760663.462467:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339731326037 time 339531326037 state 0x1 ref 1 00000100:00100000:1.0:1789760663.547333:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339731326037 time 339731532293 state 0x0 ref 1 00000100:00100000:1.0:1789760663.547545:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777142912:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760663.547600:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 82837504, mtime: 0x6aad9496, atime: 0x6aad9487, ctime: 0x6aad9496, blocks: 0x27809 00010000:00010000:1.0:1789760663.547610:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.547626:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1789760663.547631:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760663.547637:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.547724:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760663.618256:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967405 is committed 00002000:00010000:3.0:1789760663.618531:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:3.0:1789760663.618536:0:13390:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760662 -> 1789760663 00002000:00010000:3.0:1789760663.618550:0:13390:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760662 -> 1789760663 00002000:00010000:3.0:1789760663.618552:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 161801 -> 163849 00010000:00010000:3.0:1789760663.618567:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.618580:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.618590:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.618598:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760663.618603:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.618612:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.618632:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760663.618640:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e48f9a31/0xc2b9a3a739857636 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760663.618743:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777142912:12345-192.168.203.38@tcp:4:dd.500 Request processed in 71271us (156958us total) trans 4294967405 rc 0/0 00000100:00100000:3.0:1789760663.618752:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:3.0:1789760663.618765:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339731326037 time 339731532293 state 0x2 ref 0 00000100:00100000:0.0:1789760663.627856:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760663.627954:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777143040 00000100:00100000:3.0:1789760663.627963:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777143040 00000100:00100000:3.0:1789760663.628013:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339731326037 time 339731532293 state 0x0 ref 1 00000100:00100000:3.0:1789760663.628025:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339931532293 time 339731532293 state 0x1 ref 1 00000100:00100000:1.0:1789760663.747855:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339931532293 time 339932055060 state 0x0 ref 1 00000100:00100000:1.0:1789760663.747888:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777143040:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760663.747953:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 83886080, mtime: 0x6aad9497, atime: 0x6aad9487, ctime: 0x6aad9497, blocks: 0x28009 00010000:00010000:1.0:1789760663.747962:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.747978:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1789760663.747982:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760663.747988:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760663.748002:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760663.781822:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798176384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760663.781887:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760663.781964:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798176384 00000100:00100000:0.0:1789760663.781972:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798176384 00000100:00100000:0.0:1789760663.782012:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789760663.782021:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798176384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760663.782055:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760663.782109:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798176384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760663.782126:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789760663.782192:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798176384:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1789760663.843575:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967406 is committed 00002000:00010000:0.0:1789760663.843631:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:0.0:1789760663.843636:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 163849 -> 165897 00010000:00010000:0.0:1789760663.843650:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760663.843663:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760663.843672:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760663.843687:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760663.843692:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760663.843700:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760663.843723:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760663.843731:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863f9233/0xc2b9a3a73985763d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760663.843889:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777143040:12345-192.168.203.38@tcp:4:dd.500 Request processed in 96011us (216037us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789760663.843899:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:0.0:1789760663.843907:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339931532293 time 339932055060 state 0x2 ref 0 00000100:00100000:3.0:1789760663.856893:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760663.857030:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777143168 00000100:00100000:1.0:1789760663.857039:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777143168 00000100:00100000:1.0:1789760663.857100:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 339931532293 time 339932055060 state 0x0 ref 1 00000100:00100000:1.0:1789760663.857113:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340132055060 time 339932055060 state 0x1 ref 1 00000100:00100000:2.0:1789760663.949031:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340132055060 time 340133229870 state 0x0 ref 1 00000100:00100000:2.0:1789760663.949065:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777143168:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760663.949136:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 84934656, mtime: 0x6aad9497, atime: 0x6aad9487, ctime: 0x6aad9497, blocks: 0x28809 00010000:00010000:2.0:1789760663.949146:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760663.949700:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1789760663.949705:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760663.949712:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760663.949728:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760664.054459:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967407 is committed 00002000:00010000:3.0:1789760664.054626:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:3.0:1789760664.054633:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 165897 -> 167945 00010000:00010000:3.0:1789760664.054648:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.054668:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.054685:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.054693:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760664.054698:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.054708:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.054727:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.054753:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760664.054881:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777143168:12345-192.168.203.38@tcp:4:dd.500 Request processed in 105828us (197991us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1789760664.054891:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:3.0:1789760664.054910:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340132055060 time 340133229870 state 0x2 ref 0 00000100:00100000:1.0:1789760664.064012:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760664.064544:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777143296 00000100:00100000:3.0:1789760664.064556:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777143296 00000100:00100000:3.0:1789760664.064614:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340132055060 time 340133229870 state 0x0 ref 1 00000100:00100000:3.0:1789760664.064627:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340333229870 time 340133229870 state 0x1 ref 1 00010000:00010000:2.0:1789760664.070997:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760664.149343:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340333229870 time 340333537241 state 0x0 ref 1 00000100:00100000:2.0:1789760664.149375:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777143296:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760664.149431:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 85983232, mtime: 0x6aad9497, atime: 0x6aad9487, ctime: 0x6aad9497, blocks: 0x29009 00010000:00010000:2.0:1789760664.149440:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760664.149455:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1789760664.149459:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760664.149474:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760664.149488:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760664.209616:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967408 is committed 00002000:00010000:3.0:1789760664.209987:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:3.0:1789760664.209993:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 167945 -> 169993 00010000:00010000:3.0:1789760664.210006:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.210019:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.210028:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.210036:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760664.210047:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.210056:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.210236:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.210246:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a73985764b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760664.216287:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777143296:12345-192.168.203.38@tcp:4:dd.500 Request processed in 66915us (152273us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789760664.216303:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:3.0:1789760664.216311:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340333229870 time 340333537241 state 0x2 ref 0 00000100:00100000:3.0:1789760664.233667:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760664.234280:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777143424 00000100:00100000:1.0:1789760664.234289:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777143424 00000100:00100000:1.0:1789760664.234348:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340333229870 time 340333537241 state 0x0 ref 1 00000100:00100000:1.0:1789760664.234360:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340533537241 time 340333537241 state 0x1 ref 1 00000100:00100000:2.0:1789760664.263777:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798176512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760664.263879:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760664.264040:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798176512 00000100:00100000:3.0:1789760664.264050:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798176512 00000100:00100000:3.0:1789760664.264102:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789760664.264112:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798176512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760664.264148:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760664.264259:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798176512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760664.264268:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789760664.265917:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798176512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760664.350427:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340533537241 time 340534627150 state 0x0 ref 1 00000100:00100000:2.0:1789760664.350460:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777143424:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760664.350516:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 87031808, mtime: 0x6aad9497, atime: 0x6aad9487, ctime: 0x6aad9497, blocks: 0x29809 00010000:00010000:2.0:1789760664.350525:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760664.350540:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1789760664.350544:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760664.350550:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760664.350564:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760664.440543:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967409 is committed 00002000:00010000:3.0:1789760664.440641:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:3.0:1789760664.440662:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 169993 -> 172041 00010000:00010000:3.0:1789760664.440688:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.440702:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.440710:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.440718:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760664.440722:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.440732:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.440753:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.440761:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a739857652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760664.440905:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777143424:12345-192.168.203.38@tcp:4:dd.500 Request processed in 90456us (207243us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789760664.440917:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:3.0:1789760664.440924:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340533537241 time 340534627150 state 0x2 ref 0 00000100:00100000:0.0:1789760664.446747:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760664.446876:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777143552 00000100:00100000:2.0:1789760664.446886:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777143552 00000100:00100000:2.0:1789760664.446940:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340533537241 time 340534627150 state 0x0 ref 1 00000100:00100000:2.0:1789760664.446952:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340734627150 time 340534627150 state 0x1 ref 1 00000100:00100000:3.0:1789760664.550840:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340734627150 time 340735040664 state 0x0 ref 1 00000100:00100000:3.0:1789760664.550872:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777143552:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760664.550931:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 88080384, mtime: 0x6aad9497, atime: 0x6aad9487, ctime: 0x6aad9497, blocks: 0x2a009 00010000:00010000:3.0:1789760664.550941:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.550955:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1789760664.550959:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760664.550965:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.550980:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760664.651236:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967410 is committed 00002000:00010000:3.0:1789760664.651314:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:3.0:1789760664.651319:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760663 -> 1789760664 00002000:00010000:3.0:1789760664.651323:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760663 -> 1789760664 00002000:00010000:3.0:1789760664.651326:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 172041 -> 174089 00010000:00010000:3.0:1789760664.651339:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.651352:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.651362:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.651382:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760664.651388:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.651397:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.651418:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.651426:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760664.651521:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777143552:12345-192.168.203.38@tcp:4:dd.500 Request processed in 100661us (204780us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789760664.651532:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:3.0:1789760664.651539:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340734627150 time 340735040664 state 0x2 ref 0 00000100:00100000:0.0:1789760664.663763:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760664.663834:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777143680 00000100:00100000:3.0:1789760664.663846:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777143680 00000100:00100000:3.0:1789760664.663907:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340734627150 time 340735040664 state 0x0 ref 1 00000100:00100000:3.0:1789760664.663920:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340935040664 time 340735040664 state 0x1 ref 1 00000100:00100000:1.0:1789760664.750978:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340935040664 time 340935178284 state 0x0 ref 1 00000100:00100000:1.0:1789760664.751032:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777143680:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760664.751087:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 89128960, mtime: 0x6aad9498, atime: 0x6aad9487, ctime: 0x6aad9498, blocks: 0x2a809 00010000:00010000:1.0:1789760664.751096:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760664.751113:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1789760664.751117:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760664.751123:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760664.751138:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760664.776225:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798176640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760664.776295:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760664.776375:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798176640 00000100:00100000:3.0:1789760664.776383:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798176640 00000100:00100000:3.0:1789760664.776621:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789760664.776631:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798176640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760664.776654:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 219611136 pending 1703936 free 3774873600 avail 3768582144 00000100:00100000:3.0:1789760664.776710:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798176640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760664.776717:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789760664.776762:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798176640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760664.777144:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760664.777156:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798176768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760664.777189:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760664.777301:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798176768 00000100:00100000:3.0:1789760664.777306:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798176768 00000100:00100000:3.0:1789760664.777337:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789760664.777343:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798176768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760664.777354:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 219611136 pending 1703936 free 3774873600 avail 3768582144 00000100:00100000:3.0:1789760664.777386:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798176768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760664.778051:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789760664.778497:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798176768:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789760664.820652:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967411 is committed 00002000:00010000:1.0:1789760664.820777:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:1.0:1789760664.820783:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 174089 -> 176137 00010000:00010000:1.0:1789760664.820852:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760664.820884:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760664.820893:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760664.820901:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760664.820972:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760664.820983:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760664.821006:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760664.821015:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cd0e154/0xc2b9a3a739857660 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760664.821211:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777143680:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70197us (157453us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789760664.821222:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:1.0:1789760664.821230:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340935040664 time 340935178284 state 0x2 ref 0 00000100:00100000:1.0:1789760664.833013:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760664.833187:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777143808 00000100:00100000:3.0:1789760664.833197:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777143808 00000100:00100000:3.0:1789760664.833252:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 340935040664 time 340935178284 state 0x0 ref 1 00000100:00100000:3.0:1789760664.833266:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341135178284 time 340935178284 state 0x1 ref 1 00000100:00100000:3.0:1789760664.951155:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341135178284 time 341135352280 state 0x0 ref 1 00000100:00100000:3.0:1789760664.951191:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777143808:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760664.951279:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 90177536, mtime: 0x6aad9498, atime: 0x6aad9487, ctime: 0x6aad9498, blocks: 0x2b009 00010000:00010000:3.0:1789760664.951288:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.951305:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1789760664.951309:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760664.951315:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760664.951331:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760665.034775:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:0.0:1789760665.034813:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 176137 -> 178185 00010000:00010000:0.0:1789760665.034829:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.034842:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.034851:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.034859:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760665.034864:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.034873:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.034906:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.034915:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760665.035004:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777143808:12345-192.168.203.38@tcp:4:dd.500 Request processed in 83825us (201998us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789760665.035014:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:0.0:1789760665.035022:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341135178284 time 341135352280 state 0x2 ref 0 00000001:00080000:2.0:1789760665.037094:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967412 is committed 00000100:00100000:1.0:1789760665.051258:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760665.051616:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777143936 00000100:00100000:2.0:1789760665.051626:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777143936 00000100:00100000:2.0:1789760665.051958:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341135178284 time 341135352280 state 0x0 ref 1 00000100:00100000:2.0:1789760665.051970:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341335352280 time 341135352280 state 0x1 ref 1 00000100:00080000:1.0:1789760665.052094:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760665.094998:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760665.151311:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341335352280 time 341335511027 state 0x0 ref 1 00000100:00100000:1.0:1789760665.151353:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777143936:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760665.151421:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 91226112, mtime: 0x6aad9498, atime: 0x6aad9487, ctime: 0x6aad9498, blocks: 0x2b809 00010000:00010000:1.0:1789760665.151431:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760665.151446:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1789760665.151450:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760665.151456:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760665.151471:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760665.254932:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967413 is committed 00002000:00010000:0.0:1789760665.255155:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:0.0:1789760665.255161:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 178185 -> 180233 00010000:00010000:0.0:1789760665.255174:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.255187:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.255196:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.255205:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760665.255210:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.255232:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.255253:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.255262:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985766e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760665.255502:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777143936:12345-192.168.203.38@tcp:4:dd.500 Request processed in 104168us (204248us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789760665.255513:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:0.0:1789760665.255521:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341335352280 time 341335511027 state 0x2 ref 0 00000100:00100000:3.0:1789760665.264379:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760665.265688:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777144064 00000100:00100000:1.0:1789760665.265698:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777144064 00000100:00100000:1.0:1789760665.265746:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341335352280 time 341335511027 state 0x0 ref 1 00000100:00100000:1.0:1789760665.265758:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341535511027 time 341335511027 state 0x1 ref 1 00000100:00100000:0.0:1789760665.351569:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341535511027 time 341535768292 state 0x0 ref 1 00000100:00100000:0.0:1789760665.351602:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777144064:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760665.351660:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 92274688, mtime: 0x6aad9498, atime: 0x6aad9487, ctime: 0x6aad9498, blocks: 0x2c009 00010000:00010000:0.0:1789760665.351681:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.351697:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1789760665.351702:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760665.351842:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.351875:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760665.477531:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:0.0:1789760665.477540:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 180233 -> 182281 00010000:00010000:0.0:1789760665.477555:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.477569:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.477577:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.477585:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760665.477589:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.477598:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.477618:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.477625:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760665.477768:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777144064:12345-192.168.203.38@tcp:4:dd.500 Request processed in 126178us (213393us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789760665.477779:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:0.0:1789760665.477825:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341535511027 time 341535768292 state 0x2 ref 0 00000001:00080000:2.0:1789760665.478084:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967414 is committed 00000100:00100000:1.0:1789760665.486539:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760665.486820:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777144192 00000100:00100000:3.0:1789760665.486830:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777144192 00000100:00100000:3.0:1789760665.486884:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341535511027 time 341535768292 state 0x0 ref 1 00000100:00100000:3.0:1789760665.486897:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341735768292 time 341535768292 state 0x1 ref 1 00000100:00100000:0.0:1789760665.551691:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341735768292 time 341735891904 state 0x0 ref 1 00000100:00100000:0.0:1789760665.551733:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777144192:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760665.551836:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 93323264, mtime: 0x6aad9498, atime: 0x6aad9487, ctime: 0x6aad9498, blocks: 0x2c809 00010000:00010000:0.0:1789760665.551845:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.551861:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1789760665.551866:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760665.551872:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.551886:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760665.619109:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967415 is committed 00002000:00010000:0.0:1789760665.619399:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:0.0:1789760665.619404:0:13390:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760664 -> 1789760665 00002000:00010000:0.0:1789760665.619406:0:13390:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760664 -> 1789760665 00002000:00010000:0.0:1789760665.619409:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 182281 -> 184331 00010000:00010000:0.0:1789760665.619422:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.619448:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.619457:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.619465:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760665.619470:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.619480:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.619499:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.619507:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a73985767c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760665.619639:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777144192:12345-192.168.203.38@tcp:4:dd.500 Request processed in 67918us (133106us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789760665.619649:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:0.0:1789760665.619657:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341735768292 time 341735891904 state 0x2 ref 0 00000100:00100000:3.0:1789760665.628411:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760665.628535:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777144320 00000100:00100000:0.0:1789760665.628559:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777144320 00000100:00100000:0.0:1789760665.628612:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341735768292 time 341735891904 state 0x0 ref 1 00000100:00100000:0.0:1789760665.628625:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341935891904 time 341735891904 state 0x1 ref 1 00000100:00100000:0.0:1789760665.752497:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341935891904 time 341936695454 state 0x0 ref 1 00000100:00100000:0.0:1789760665.752533:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777144320:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760665.752590:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 94371840, mtime: 0x6aad9499, atime: 0x6aad9487, ctime: 0x6aad9499, blocks: 0x2d00b 00010000:00010000:0.0:1789760665.752599:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.752616:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1789760665.752620:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760665.752627:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760665.752642:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760665.806047:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967416 is committed 00002000:00010000:1.0:1789760665.806250:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:1.0:1789760665.806256:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 184331 -> 186379 00010000:00010000:1.0:1789760665.806271:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760665.806298:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760665.806308:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760665.806316:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760665.806378:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760665.806388:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760665.806407:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760665.806415:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a739857683 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760665.806511:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777144320:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53991us (178104us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789760665.806520:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:1.0:1789760665.806528:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341935891904 time 341936695454 state 0x2 ref 0 00000100:00100000:1.0:1789760665.819343:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760665.819440:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777144448 00000100:00100000:0.0:1789760665.819449:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777144448 00000100:00100000:0.0:1789760665.819498:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 341935891904 time 341936695454 state 0x0 ref 1 00000100:00100000:0.0:1789760665.819511:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342136695454 time 341936695454 state 0x1 ref 1 00000100:00100000:3.0:1789760665.952651:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342136695454 time 342136851288 state 0x0 ref 1 00000100:00100000:3.0:1789760665.952693:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777144448:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760665.952759:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 95420416, mtime: 0x6aad9499, atime: 0x6aad9487, ctime: 0x6aad9499, blocks: 0x2d80b 00010000:00010000:3.0:1789760665.952768:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760665.952836:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1789760665.952840:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760665.952847:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760665.952863:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760666.019785:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:2.0:1789760666.019812:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 186379 -> 188427 00010000:00010000:2.0:1789760666.019828:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.019840:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.019847:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.019854:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dca00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760666.019859:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.019868:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.019889:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.019916:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a73985768a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760666.020026:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777144448:12345-192.168.203.38@tcp:4:dd.500 Request processed in 67343us (200697us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789760666.020036:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:2.0:1789760666.020045:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342136695454 time 342136851288 state 0x2 ref 0 00000001:00080000:2.0:1789760666.020085:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967417 is committed 00000100:00100000:2.0:1789760666.035287:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.035421:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777144576 00000100:00100000:0.0:1789760666.035431:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777144576 00000100:00100000:0.0:1789760666.035493:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342136695454 time 342136851288 state 0x0 ref 1 00000100:00100000:0.0:1789760666.035520:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342336851288 time 342136851288 state 0x1 ref 1 00010000:00010000:2.0:1789760666.119284:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760666.156539:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342336851288 time 342340736743 state 0x0 ref 1 00000100:00100000:2.0:1789760666.156574:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777144576:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760666.156641:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 96468992, mtime: 0x6aad9499, atime: 0x6aad9487, ctime: 0x6aad9499, blocks: 0x2e00b 00010000:00010000:2.0:1789760666.156650:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.156675:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1789760666.156680:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760666.156686:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.156700:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760666.158049:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.158088:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.158116:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.158146:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.158167:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.158206:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.158241:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777144704 00000100:00100000:0.0:1789760666.158249:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777144704 00000100:00100000:0.0:1789760666.158289:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 348 00000100:00100000:0.0:1789760666.158297:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777144704:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760666.158362:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777144704:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760666.158369:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 348 00000100:00100000:0.0:1789760666.158401:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777144832 00000100:00100000:0.0:1789760666.158405:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777144832 00000100:00100000:0.0:1789760666.158436:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777145344 00000100:00100000:0.0:1789760666.158440:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777145344 00000100:00100000:0.0:1789760666.158454:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777144960 00000100:00100000:0.0:1789760666.158456:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777144960 00000100:00100000:0.0:1789760666.158467:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777145216 00000100:00100000:0.0:1789760666.158469:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777145216 00000100:00100000:0.0:1789760666.158483:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 269 00000100:00100000:0.0:1789760666.158490:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777144832:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760666.158520:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777144832:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760666.158538:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 269 00000100:00100000:0.0:1789760666.158550:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:0.0:1789760666.158556:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777145344:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760666.158581:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777145344:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760666.158587:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:0.0:1789760666.158597:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 271 00000100:00100000:0.0:1789760666.158603:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777144960:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760666.158626:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777144960:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760666.158632:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 271 00000100:00100000:0.0:1789760666.158643:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 272 00000100:00100000:0.0:1789760666.158649:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777145216:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760666.158684:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777145216:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760666.158690:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 272 00000100:00080000:0.0:1789760666.158709:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760666.158713:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760666.159638:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777145088 00000100:00100000:3.0:1789760666.159647:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777145088 00000100:00100000:3.0:1789760666.159714:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:3.0:1789760666.159723:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777145088:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760666.159813:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777145088:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 63us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760666.159821:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00080000:0.0:1789760666.162576:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789760666.314962:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967418 is committed 00002000:00010000:3.0:1789760666.315092:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:3.0:1789760666.315097:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 188427 -> 190475 00010000:00010000:3.0:1789760666.315111:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.315124:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.315134:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.315160:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760666.315165:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.315173:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.315193:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.315202:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760666.315299:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777144576:12345-192.168.203.38@tcp:4:dd.500 Request processed in 158737us (280017us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789760666.315309:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:3.0:1789760666.315327:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342336851288 time 342340736743 state 0x2 ref 0 00000100:00100000:1.0:1789760666.328602:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.328710:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777145472 00000100:00100000:0.0:1789760666.328720:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777145472 00000100:00100000:0.0:1789760666.328785:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342336851288 time 342340736743 state 0x0 ref 1 00000100:00100000:0.0:1789760666.328817:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342540736743 time 342340736743 state 0x1 ref 1 00000100:00100000:2.0:1789760666.356708:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342540736743 time 342540907226 state 0x0 ref 1 00000100:00100000:2.0:1789760666.356741:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777145472:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760666.364683:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 97517568, mtime: 0x6aad9499, atime: 0x6aad9487, ctime: 0x6aad9499, blocks: 0x2e80b 00010000:00010000:3.0:1789760666.364704:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.364721:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1789760666.364726:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760666.364733:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.364771:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760666.420960:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:3.0:1789760666.420970:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 190475 -> 192523 00010000:00010000:3.0:1789760666.420984:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.420997:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.421007:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.421015:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760666.421020:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.421028:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.421048:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.421056:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857698 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760666.421735:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967419 is committed 00000100:00100000:3.0:1789760666.422650:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777145472:12345-192.168.203.38@tcp:4:dd.500 Request processed in 65917us (94048us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789760666.422671:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:3.0:1789760666.422679:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342540736743 time 342540907226 state 0x2 ref 0 00000100:00100000:3.0:1789760666.430943:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760666.432873:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777145600 00000100:00100000:1.0:1789760666.432886:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777145600 00000100:00100000:1.0:1789760666.432941:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342540736743 time 342540907226 state 0x0 ref 1 00000100:00100000:1.0:1789760666.432954:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342740907226 time 342540907226 state 0x1 ref 1 00000100:00100000:1.0:1789760666.556859:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342740907226 time 342741048192 state 0x0 ref 1 00000100:00100000:1.0:1789760666.556895:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777145600:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760666.556954:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 98566144, mtime: 0x6aad9499, atime: 0x6aad9487, ctime: 0x6aad9499, blocks: 0x2f00b 00010000:00010000:1.0:1789760666.556963:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760666.556980:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1789760666.556984:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760666.556990:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760666.557004:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760666.622652:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967420 is committed 00002000:00010000:2.0:1789760666.622739:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:2.0:1789760666.622744:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 192523 -> 194571 00010000:00010000:2.0:1789760666.622758:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.622772:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.622782:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.622851:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760666.622856:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.622865:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.622884:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.622911:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a73985769f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760666.623040:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777145600:12345-192.168.203.38@tcp:4:dd.500 Request processed in 66158us (192100us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789760666.623050:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1789760666.623058:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342740907226 time 342741048192 state 0x2 ref 0 00000100:00100000:3.0:1789760666.630430:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760666.630548:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777145728 00000100:00100000:2.0:1789760666.630558:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777145728 00000100:00100000:2.0:1789760666.630608:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342740907226 time 342741048192 state 0x0 ref 1 00000100:00100000:2.0:1789760666.630621:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342941048192 time 342741048192 state 0x1 ref 1 00000100:00100000:3.0:1789760666.759915:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342941048192 time 342944116734 state 0x0 ref 1 00000100:00100000:3.0:1789760666.759946:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777145728:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760666.759999:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 99614720, mtime: 0x6aad9499, atime: 0x6aad9487, ctime: 0x6aad9499, blocks: 0x2f80b 00010000:00010000:3.0:1789760666.760008:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.760023:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1789760666.760028:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760666.760044:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.760060:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760666.836557:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:2.0:1789760666.836566:0:8118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760665 -> 1789760666 00002000:00010000:2.0:1789760666.836569:0:8118:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760665 -> 1789760666 00002000:00010000:2.0:1789760666.836571:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 194571 -> 196619 00010000:00010000:2.0:1789760666.836588:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.836610:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.836620:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.836645:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dce00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760666.836651:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.836669:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.836693:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760666.836700:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760666.837731:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777145728:12345-192.168.203.38@tcp:4:dd.500 Request processed in 76858us (206367us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789760666.837742:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:2.0:1789760666.837751:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342941048192 time 342944116734 state 0x2 ref 0 00000001:00080000:0.0:1789760666.838010:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967421 is committed 00000100:00100000:3.0:1789760666.853106:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760666.854157:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777145856 00000100:00100000:0.0:1789760666.854168:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777145856 00000100:00100000:0.0:1789760666.854222:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 342941048192 time 342944116734 state 0x0 ref 1 00000100:00100000:0.0:1789760666.854235:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343144116734 time 342944116734 state 0x1 ref 1 00000100:00100000:3.0:1789760666.960227:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343144116734 time 343144424112 state 0x0 ref 1 00000100:00100000:3.0:1789760666.960290:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777145856:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760666.960369:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 100663296, mtime: 0x6aad949a, atime: 0x6aad9487, ctime: 0x6aad949a, blocks: 0x3000b 00010000:00010000:3.0:1789760666.960379:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.960395:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1789760666.960399:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760666.960405:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760666.960420:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760667.041051:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:2.0:1789760667.041061:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 196619 -> 198667 00010000:00010000:2.0:1789760667.041075:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.041088:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.041115:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.041123:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dde00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760667.041128:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.041136:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.041156:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.041163:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000661947c8/0xc2b9a3a7398576ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760667.041725:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777145856:12345-192.168.203.38@tcp:4:dd.500 Request processed in 81448us (188695us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789760667.041745:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:2.0:1789760667.041755:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343144116734 time 343144424112 state 0x2 ref 0 00000001:00080000:0.0:1789760667.042826:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967422 is committed 00000100:00100000:3.0:1789760667.051063:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760667.051180:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777145984 00000100:00100000:0.0:1789760667.051190:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777145984 00000100:00100000:0.0:1789760667.051277:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343144116734 time 343144424112 state 0x0 ref 1 00000100:00100000:0.0:1789760667.051290:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343344424112 time 343144424112 state 0x1 ref 1 00000100:00080000:1.0:1789760667.051951:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760667.145272:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760667.162818:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343344424112 time 343346993556 state 0x0 ref 1 00000100:00100000:0.0:1789760667.162855:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777145984:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760667.162910:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 101711872, mtime: 0x6aad949a, atime: 0x6aad9487, ctime: 0x6aad949a, blocks: 0x3080b 00010000:00010000:0.0:1789760667.162919:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.162935:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1789760667.162939:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760667.162946:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.162960:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760667.254838:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967423 is committed 00002000:00010000:2.0:1789760667.260257:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:2.0:1789760667.260266:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 198667 -> 200715 00010000:00010000:2.0:1789760667.260281:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.260310:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.260318:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.260325:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760667.260389:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.260399:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.260419:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.260426:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724f9420/0xc2b9a3a7398576b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760667.260725:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777145984:12345-192.168.203.38@tcp:4:dd.500 Request processed in 97880us (209678us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789760667.260735:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:2.0:1789760667.260742:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343344424112 time 343346993556 state 0x2 ref 0 00000100:00100000:0.0:1789760667.271317:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760667.271381:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777146112 00000100:00100000:2.0:1789760667.271403:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777146112 00000100:00100000:2.0:1789760667.271457:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343344424112 time 343346993556 state 0x0 ref 1 00000100:00100000:2.0:1789760667.271470:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343546993556 time 343346993556 state 0x1 ref 1 00000100:00100000:0.0:1789760667.362933:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343546993556 time 343547134710 state 0x0 ref 1 00000100:00100000:0.0:1789760667.362965:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777146112:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760667.363024:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 102760448, mtime: 0x6aad949a, atime: 0x6aad9487, ctime: 0x6aad949a, blocks: 0x3100b 00010000:00010000:0.0:1789760667.363033:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.363113:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1789760667.363118:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760667.363124:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.363246:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760667.453962:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967424 is committed 00002000:00010000:2.0:1789760667.454239:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:2.0:1789760667.454244:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 200715 -> 202763 00010000:00010000:2.0:1789760667.454258:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.454271:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.454279:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.454287:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c687400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760667.454292:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.454301:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.454333:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.454342:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050cd2ab/0xc2b9a3a7398576bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760667.454598:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777146112:12345-192.168.203.38@tcp:4:dd.500 Request processed in 91643us (183293us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1789760667.454608:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:2.0:1789760667.454615:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343546993556 time 343547134710 state 0x2 ref 0 00000100:00100000:1.0:1789760667.478955:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760667.479054:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777146240 00000100:00100000:2.0:1789760667.479064:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777146240 00000100:00100000:2.0:1789760667.479119:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343546993556 time 343547134710 state 0x0 ref 1 00000100:00100000:2.0:1789760667.479131:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343747134710 time 343547134710 state 0x1 ref 1 00000100:00100000:0.0:1789760667.568455:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343747134710 time 343752655103 state 0x0 ref 1 00000100:00100000:0.0:1789760667.568489:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777146240:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760667.568560:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 103809024, mtime: 0x6aad949a, atime: 0x6aad9487, ctime: 0x6aad949a, blocks: 0x3180b 00010000:00010000:0.0:1789760667.568570:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.568605:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1789760667.568610:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760667.568616:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.568632:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760667.636774:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967425 is committed 00002000:00010000:0.0:1789760667.636944:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:0.0:1789760667.636948:0:13388:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 1789760666 -> 1789760667 00002000:00010000:0.0:1789760667.636951:0:13388:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 1789760666 -> 1789760667 00002000:00010000:0.0:1789760667.636953:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 202763 -> 204811 00010000:00010000:0.0:1789760667.636966:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.636978:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.636987:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.636995:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760667.636999:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.637027:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.637046:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760667.637054:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a7398576c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760667.637150:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777146240:12345-192.168.203.38@tcp:4:dd.500 Request processed in 68673us (158200us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1789760667.637160:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:0.0:1789760667.637168:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343747134710 time 343752655103 state 0x2 ref 0 00000100:00100000:3.0:1789760667.641235:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760667.641734:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777146496 00000100:00100000:2.0:1789760667.641743:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777146496 00000100:00100000:2.0:1789760667.641867:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1789760667.641879:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11475:x1876699777146496:12345-192.168.203.38@tcp:35:dd.500 00000001:00080000:2.0:1789760667.642300:0:6469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967329 00000100:00100000:2.0:1789760667.642526:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11475:x1876699777146496:12345-192.168.203.38@tcp:35:dd.500 Request processed in 648us (1298us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789760667.642534:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000020:00080000:2.0:1789760667.642539:0:6469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789760667.854912:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760667.856035:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777146752 00000100:00100000:3.0:1789760667.856045:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777146752 00000100:00100000:3.0:1789760667.856097:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:3.0:1789760667.856106:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11493:x1876699777146752:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:3.0:1789760667.856127:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760667.856156:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a7398576c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a28 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856224:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856249:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856262:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856275:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856283:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856289:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856927:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dde00/0xc2b9a3a7398576de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856937:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dde00/0xc2b9a3a7398576de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.856945:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dde00/0xc2b9a3a7398576de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760667.856955:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 104857600 00010000:00010000:3.0:1789760667.857095:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857104:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857111:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857122:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dcc00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760667.857127:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857135:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857145:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:3.0:1789760667.857148:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760667.857152:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857158:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dcc00/0xc2b9a3a7398576d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857169:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857175:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857181:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857186:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760667.857189:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857194:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857209:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x4009f790 (ffff97e544c16b00) 00010000:00010000:3.0:1789760667.857212:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760667.857215:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857221:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc800/0xc2b9a3a7398576d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857261:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dc400/0xc2b9a3a7398576c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a28 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857275:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dde00/0xc2b9a3a7398576de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a28 expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.857283:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:3.0:1789760667.857285:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789760667.857287:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dde00, rc 0) 00000100:00100000:3.0:1789760667.857354:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11493:x1876699777146752:12345-192.168.203.38@tcp:101:dd.500 Request processed in 1248us (2448us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789760667.857361:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:0.0:1789760667.863840:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760667.863931:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777146880 00000100:00100000:3.0:1789760667.863941:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777146880 00000100:00100000:3.0:1789760667.863991:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:3.0:1789760667.864001:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777146880:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:3.0:1789760667.864019:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760667.864045:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a2f expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760667.864089:0:9533:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 104857600, mtime: 0x6aad949b, atime: 0x6aad9487, ctime: 0x6aad949b, blocks: 0x3200b 00010000:00010000:3.0:1789760667.864108:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1789760667.864113:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760667.864123:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a2f expref: 6 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.864156:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a2f expref: 6 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.864169:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e4486dce00, rc 0) 00000100:00100000:3.0:1789760667.864225:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777146880:12345-192.168.203.38@tcp:101:dd.500 Request processed in 225us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760667.864232:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:3.0:1789760667.872017:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760667.872054:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777147008 00000100:00100000:3.0:1789760667.872064:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777147008 00000100:00100000:3.0:1789760667.872113:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343747134710 time 343752655103 state 0x0 ref 1 00000100:00100000:3.0:1789760667.872125:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343952655103 time 343752655103 state 0x1 ref 1 00000100:00100000:3.0:1789760667.872160:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343952655103 time 344056369858 state 0x0 ref 1 00000100:00100000:3.0:1789760667.872173:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777147008:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760667.872206:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.872240:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760667.872245:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760667.872252:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760667.872267:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.929441:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.929461:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.929489:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.929497:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dca00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760667.929502:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.929512:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.929534:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760667.929542:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a7398576f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760667.929631:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777147008:12345-192.168.203.38@tcp:3:dd.500 Request processed in 57456us (57620us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760667.929641:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:2.0:1789760667.929659:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343952655103 time 344056369858 state 0x2 ref 0 00000100:00100000:0.0:1789760667.951874:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760667.951983:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777147136 00000100:00100000:3.0:1789760667.951994:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777147136 00000100:00100000:3.0:1789760667.952058:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 343952655103 time 344056369858 state 0x0 ref 1 00000100:00100000:3.0:1789760667.952072:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344256369858 time 344056369858 state 0x1 ref 1 00000001:00080000:2.0:1789760667.972325:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000100:00100000:2.0:1789760668.072326:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344256369858 time 344256526685 state 0x0 ref 1 00000100:00100000:2.0:1789760668.072357:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777147136:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760668.072401:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.072432:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760668.072437:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760668.072444:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.072459:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.109169:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.109199:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.109210:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.109219:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760668.109225:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.109235:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.109263:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.109296:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a7398576fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760668.109418:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777147136:12345-192.168.203.38@tcp:3:dd.500 Request processed in 37069us (157547us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760668.109430:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:2.0:1789760668.109440:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344256369858 time 344256526685 state 0x2 ref 0 00000100:00100000:0.0:1789760668.116749:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760668.119541:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777147264 00000100:00100000:3.0:1789760668.119568:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777147264 00000100:00100000:0.0:1789760668.119762:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344256369858 time 344256526685 state 0x0 ref 1 00000100:00100000:0.0:1789760668.119780:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344456526685 time 344256526685 state 0x1 ref 1 00010000:00010000:0.0:1789760668.167550:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760668.272632:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344456526685 time 344456820446 state 0x0 ref 1 00000100:00100000:2.0:1789760668.272700:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777147264:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760668.272766:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.272836:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760668.272842:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760668.272850:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.272867:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.338604:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.338631:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.338664:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.338673:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760668.338679:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.338688:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.338714:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.338722:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857701 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760668.338964:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777147264:12345-192.168.203.38@tcp:3:dd.500 Request processed in 66290us (222225us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760668.338976:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:2.0:1789760668.338986:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344456526685 time 344456820446 state 0x2 ref 0 00000100:00100000:0.0:1789760668.348703:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760668.348822:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777147392 00000100:00100000:1.0:1789760668.348843:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777147392 00000100:00100000:1.0:1789760668.348920:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344456526685 time 344456820446 state 0x0 ref 1 00000100:00100000:1.0:1789760668.348937:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344656820446 time 344456820446 state 0x1 ref 1 00000100:00100000:0.0:1789760668.359582:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798177024:0@lo:400:kworker.0 00000100:00100000:0.0:1789760668.359704:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760668.359778:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798177536:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.360347:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798176896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760668.360397:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.360432:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798177408:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.360463:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.360485:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798177920:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.360512:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.360529:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798178432:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.360549:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.360577:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789760668.360583:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798177280:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.360626:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.360662:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798177792:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.360686:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.360704:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798178304:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.360725:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.360759:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798177152:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.360784:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.360820:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798177664:0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.361013:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798177920 00000100:00100000:2.0:1789760668.361024:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798177024 00000100:00100000:2.0:1789760668.361032:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798177024 00000100:00100000:1.0:1789760668.361033:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798177920 00000100:00100000:1.0:1789760668.361099:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798178432 00000100:00100000:1.0:1789760668.361104:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798178432 00000100:00100000:2.0:1789760668.361112:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789760668.361126:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798177024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.361134:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789760668.361145:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798177920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.361225:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798177920:12345-0@lo:400:kworker.0 Request processed in 84us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760668.361234:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789760668.361255:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789760668.361264:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798178432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760668.361273:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798177024:12345-0@lo:400:kworker.0 Request processed in 149us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760668.361282:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789760668.361304:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798178432:12345-0@lo:400:kworker.0 Request processed in 41us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760668.361311:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1789760668.361331:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760668.361335:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760668.361414:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798177280 00000100:00100000:2.0:1789760668.361419:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798177280 00000100:00100000:2.0:1789760668.361447:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789760668.361455:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798177280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760668.361492:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798177280:12345-0@lo:400:kworker.0 Request processed in 38us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760668.361499:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789760668.361525:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798177408 00000100:00100000:2.0:1789760668.361529:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798177408 00000100:00100000:2.0:1789760668.361557:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798177792 00000100:00100000:2.0:1789760668.361560:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798177792 00000100:00100000:2.0:1789760668.361583:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798178304 00000100:00100000:2.0:1789760668.361586:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798178304 00000100:00100000:2.0:1789760668.361602:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798177152 00000100:00100000:2.0:1789760668.361605:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798177152 00000100:00080000:1.0:1789760668.361618:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760668.361623:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789760668.361631:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798177408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.361677:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789760668.361682:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798177408:12345-0@lo:400:kworker.0 Request processed in 51us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760668.361693:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789760668.361701:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798177792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760668.361710:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789760668.361719:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798178304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.361748:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798177792:12345-0@lo:400:kworker.0 Request processed in 52us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760668.361755:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789760668.361762:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798178304:12345-0@lo:400:kworker.0 Request processed in 43us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760668.361772:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789760668.361782:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798177152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760668.361784:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789760668.361856:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798177152:12345-0@lo:400:kworker.0 Request processed in 77us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760668.361863:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789760668.361925:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798177280:0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.361942:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798177792:0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.361954:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798178304:0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.361967:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798177408:0@lo:400:kworker.0 00000100:00100000:0.0:1789760668.361986:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760668.361986:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798177920:0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.362005:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798178432:0@lo:400:kworker.0 00000100:00100000:0.0:1789760668.362025:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798178048:0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.362055:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798177536 00000100:00100000:0.0:1789760668.362061:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760668.362063:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798177536 00000100:00100000:0.0:1789760668.362085:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798178560:0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.362099:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789760668.362109:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798177536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760668.362114:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760668.362489:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798177024:0@lo:400:kworker.0 00000100:00100000:0.0:1789760668.362502:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760668.362510:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798178688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760668.362539:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798176896 00000100:00100000:2.0:1789760668.362544:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798176896 00000100:00100000:2.0:1789760668.362574:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789760668.362581:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798176896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760668.362618:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760668.362743:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798177536:12345-0@lo:400:kworker.0 Request processed in 634us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760668.362751:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789760668.363746:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798178048 00000100:00100000:1.0:1789760668.363756:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798178048 00000100:00100000:1.0:1789760668.363843:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798178560 00000100:00100000:1.0:1789760668.363847:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798178560 00000100:00100000:1.0:1789760668.363876:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789760668.363885:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798178048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.363964:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798178048:12345-0@lo:400:kworker.0 Request processed in 81us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760668.363993:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789760668.365748:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789760668.365773:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798178560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760668.365896:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798178560:12345-0@lo:400:kworker.0 Request processed in 135us (3783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760668.365904:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1789760668.365951:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760668.365958:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760668.366574:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.366629:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798178176:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.366682:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760668.366737:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798177152:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.366781:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798177664 00000100:00100000:3.0:1789760668.366802:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798177664 00000100:00100000:3.0:1789760668.366861:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798178176 00000100:00100000:3.0:1789760668.366865:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798178176 00000100:00100000:3.0:1789760668.366888:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789760668.366896:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798177664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.366948:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798177664:12345-0@lo:400:kworker.0 Request processed in 52us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760668.366956:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789760668.366971:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789760668.366977:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798178176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.367004:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798178176:12345-0@lo:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760668.367027:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1789760668.367056:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760668.367094:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798177664:0@lo:400:kworker.0 00000100:00100000:3.0:1789760668.367106:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798178176:0@lo:400:kworker.0 00000100:00100000:0.0:1789760668.372576:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760668.372703:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798177536:0@lo:400:kworker.0 00000100:00100000:0.0:1789760668.372725:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798178048:0@lo:400:kworker.0 00000100:00100000:0.0:1789760668.372738:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798178560:0@lo:400:kworker.0 00000100:00100000:2.0:1789760668.373028:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798176896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10444us (12628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760668.373042:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789760668.373089:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798178688 00000100:00100000:2.0:1789760668.373097:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798178688 00000100:00100000:2.0:1789760668.373147:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789760668.373157:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798178688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760668.373188:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760668.373231:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798178688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760668.373238:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789760668.373285:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798176896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760668.374942:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798178688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760668.472784:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344656820446 time 344656977920 state 0x0 ref 1 00000100:00100000:1.0:1789760668.473079:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777147392:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760668.473142:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760668.473164:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760668.473169:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760668.473176:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760668.473273:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.501222:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.501241:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.501249:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.501279:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f6d2400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760668.501285:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.501295:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.501324:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760668.501332:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d96e1a/0xc2b9a3a739857708 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760668.501428:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777147392:12345-192.168.203.38@tcp:3:dd.500 Request processed in 28434us (152737us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760668.501437:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:2.0:1789760668.501446:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344656820446 time 344656977920 state 0x2 ref 0 00000100:00100000:1.0:1789760668.514376:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760668.514504:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777147520 00000100:00100000:2.0:1789760668.514519:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777147520 00000100:00100000:2.0:1789760668.514595:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344656820446 time 344656977920 state 0x0 ref 1 00000100:00100000:2.0:1789760668.514611:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344856977920 time 344656977920 state 0x1 ref 1 00000100:00100000:0.0:1789760668.674287:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344856977920 time 344858480784 state 0x0 ref 1 00000100:00100000:0.0:1789760668.674336:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777147520:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760668.674393:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.674482:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760668.674487:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760668.674495:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.674598:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.727017:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.727044:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.727055:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.727063:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760668.727069:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.727080:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.727117:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.727131:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a73985770f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760668.727273:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777147520:12345-192.168.203.38@tcp:3:dd.500 Request processed in 52956us (212908us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760668.727302:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:0.0:1789760668.727312:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344856977920 time 344858480784 state 0x2 ref 0 00000100:00100000:1.0:1789760668.735706:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760668.735860:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777147648 00000100:00100000:2.0:1789760668.735874:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777147648 00000100:00100000:2.0:1789760668.735946:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 344856977920 time 344858480784 state 0x0 ref 1 00000100:00100000:2.0:1789760668.735977:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345058480784 time 344858480784 state 0x1 ref 1 00000100:00100000:0.0:1789760668.877935:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345058480784 time 345062130887 state 0x0 ref 1 00000100:00100000:0.0:1789760668.877980:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777147648:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760668.878049:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.878072:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760668.878077:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760668.878085:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.878105:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760668.879611:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798178816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760668.879729:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760668.879923:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798178816 00000100:00100000:2.0:1789760668.879935:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798178816 00000100:00100000:2.0:1789760668.880018:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789760668.880031:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798178816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760668.880084:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760668.880152:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798178816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760668.880159:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789760668.880219:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798178816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789760668.896861:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.896888:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.896899:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.896906:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760668.896926:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.896936:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.896962:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760668.896971:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857716 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760668.897089:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777147648:12345-192.168.203.38@tcp:3:dd.500 Request processed in 19125us (161390us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760668.897099:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:0.0:1789760668.897110:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345058480784 time 345062130887 state 0x2 ref 0 00000100:00100000:2.0:1789760668.910591:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760668.910725:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777147776 00000100:00100000:1.0:1789760668.910737:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777147776 00000100:00100000:1.0:1789760668.910843:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345058480784 time 345062130887 state 0x0 ref 1 00000100:00100000:1.0:1789760668.910858:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345262130887 time 345062130887 state 0x1 ref 1 00000100:00100000:1.0:1789760669.079530:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345262130887 time 345263724631 state 0x0 ref 1 00000100:00100000:1.0:1789760669.079606:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777147776:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760669.079680:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.079701:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760669.079707:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760669.079714:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.079732:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760669.082362:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760669.114597:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.114622:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.114632:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.114651:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadd400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760669.114656:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.114688:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.114712:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.114721:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a6d944/0xc2b9a3a73985771d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760669.114894:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777147776:12345-192.168.203.38@tcp:3:dd.500 Request processed in 35334us (204310us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760669.114906:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:0.0:1789760669.114916:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345262130887 time 345263724631 state 0x2 ref 0 00000100:00100000:2.0:1789760669.120617:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760669.120823:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777147904 00000100:00100000:1.0:1789760669.120836:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777147904 00000100:00100000:1.0:1789760669.120908:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345262130887 time 345263724631 state 0x0 ref 1 00000100:00100000:1.0:1789760669.120925:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345463724631 time 345263724631 state 0x1 ref 1 00010000:00010000:2.0:1789760669.191661:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760669.282425:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345463724631 time 345466622087 state 0x0 ref 1 00000100:00100000:3.0:1789760669.282470:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777147904:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760669.282529:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.282549:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760669.282555:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760669.282562:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.282578:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.302433:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.302457:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.302467:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.302490:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f6d3200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760669.302495:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.302505:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.302526:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.302533:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a739857724 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760669.302631:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777147904:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20180us (182021us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760669.302649:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:3.0:1789760669.302658:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345463724631 time 345466622087 state 0x2 ref 0 00000100:00100000:2.0:1789760669.308179:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760669.308508:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777148032 00000100:00100000:0.0:1789760669.308663:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777148032 00000100:00100000:0.0:1789760669.308733:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345463724631 time 345466622087 state 0x0 ref 1 00000100:00100000:0.0:1789760669.308750:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345666622087 time 345466622087 state 0x1 ref 1 00000100:00100000:2.0:1789760669.383132:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760669.383159:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798178944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760669.383258:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760669.388589:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798178944 00000100:00100000:3.0:1789760669.388609:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798178944 00000100:00100000:0.0:1789760669.391052:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789760669.391070:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798178944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760669.391127:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760669.391266:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798178944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (8007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760669.391275:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789760669.391494:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798178944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760669.483174:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345666622087 time 345667369280 state 0x0 ref 1 00000100:00100000:3.0:1789760669.483238:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777148032:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760669.483294:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.483337:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760669.483342:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760669.483350:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.483368:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.500714:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.500733:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.500743:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.500750:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f6d3200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760669.500755:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.500764:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.500783:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.500832:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d209d60/0xc2b9a3a73985772b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760669.500919:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777148032:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17719us (192801us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760669.500929:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:3.0:1789760669.500937:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345666622087 time 345667369280 state 0x2 ref 0 00000100:00100000:2.0:1789760669.509694:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760669.509824:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777148160 00000100:00100000:0.0:1789760669.509835:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777148160 00000100:00100000:0.0:1789760669.509888:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345666622087 time 345667369280 state 0x0 ref 1 00000100:00100000:0.0:1789760669.509902:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345867369280 time 345667369280 state 0x1 ref 1 00000100:00100000:0.0:1789760669.683267:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345867369280 time 345867467889 state 0x0 ref 1 00000100:00100000:0.0:1789760669.683365:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777148160:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760669.683465:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.683484:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760669.683488:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760669.683494:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.683508:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.709140:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.709166:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.709174:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.709198:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760669.709204:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.709214:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.709233:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.709241:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857732 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760669.709335:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777148160:12345-192.168.203.38@tcp:3:dd.500 Request processed in 26048us (199646us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760669.709347:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:0.0:1789760669.709357:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345867369280 time 345867467889 state 0x2 ref 0 00000100:00100000:2.0:1789760669.716348:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760669.716508:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777148288 00000100:00100000:0.0:1789760669.716517:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777148288 00000100:00100000:0.0:1789760669.716565:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 345867369280 time 345867467889 state 0x0 ref 1 00000100:00100000:0.0:1789760669.716576:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346067467889 time 345867467889 state 0x1 ref 1 00000100:00100000:2.0:1789760669.883528:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346067467889 time 346067713625 state 0x0 ref 1 00000100:00100000:2.0:1789760669.883562:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777148288:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760669.883603:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760669.883649:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760669.883653:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760669.883660:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760669.883677:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760669.895070:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760669.895097:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798179072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760669.895254:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760669.895402:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760669.895413:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798179200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760669.895457:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760669.895870:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798179072 00000100:00100000:2.0:1789760669.895879:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798179072 00000100:00100000:2.0:1789760669.895916:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798179200 00000100:00100000:2.0:1789760669.895919:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798179200 00000100:00100000:2.0:1789760669.895938:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789760669.895947:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798179072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760669.895980:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789760669.896023:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798179072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760669.896030:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789760669.896046:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789760669.896053:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798179200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760669.896063:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789760669.896100:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798179200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760669.896106:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789760669.897769:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798179200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760669.898705:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798179072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789760669.966273:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.966304:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.966313:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.966321:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e550f0f600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760669.966326:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.966353:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.966372:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.966380:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fc0308a/0xc2b9a3a739857739 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760669.966458:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777148288:12345-192.168.203.38@tcp:3:dd.500 Request processed in 82908us (250171us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760669.966469:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:3.0:1789760669.966477:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346067467889 time 346067713625 state 0x2 ref 0 00000100:00100000:2.0:1789760669.978705:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760669.978783:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777148416 00000100:00100000:3.0:1789760669.978814:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777148416 00000100:00100000:3.0:1789760669.978862:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346067467889 time 346067713625 state 0x0 ref 1 00000100:00100000:3.0:1789760669.978873:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346267713625 time 346067713625 state 0x1 ref 1 00000100:00100000:0.0:1789760670.084192:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346267713625 time 346268392796 state 0x0 ref 1 00000100:00100000:0.0:1789760670.084225:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777148416:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760670.084267:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.084284:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760670.084299:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760670.084305:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.084318:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.097753:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.097821:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.097830:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.097838:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f0200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760670.097843:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.097853:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.097873:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.097881:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4da6b7/0xc2b9a3a739857740 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760670.097964:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777148416:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13750us (119262us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760670.097974:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:1.0:1789760670.097982:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346267713625 time 346268392796 state 0x2 ref 0 00000100:00100000:0.0:1789760670.109194:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760670.109285:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777148544 00000100:00100000:3.0:1789760670.109294:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777148544 00000100:00100000:3.0:1789760670.109360:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346267713625 time 346268392796 state 0x0 ref 1 00000100:00100000:3.0:1789760670.109373:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346468392796 time 346268392796 state 0x1 ref 1 00010000:00010000:2.0:1789760670.215217:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760670.285204:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346468392796 time 346469402985 state 0x0 ref 1 00000100:00100000:1.0:1789760670.285250:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777148544:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760670.285292:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.285310:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760670.285313:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760670.285319:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.285334:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.308886:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.308907:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.308917:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.308924:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e558262400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760670.308929:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.308938:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.308975:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.308982:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5577463/0xc2b9a3a739857747 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760670.309077:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777148544:12345-192.168.203.38@tcp:3:dd.500 Request processed in 23835us (199889us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760670.309086:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:1.0:1789760670.309095:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346468392796 time 346469402985 state 0x2 ref 0 00000100:00100000:0.0:1789760670.322684:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760670.323292:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777148672 00000100:00100000:3.0:1789760670.323324:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777148672 00000100:00100000:3.0:1789760670.323374:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346468392796 time 346469402985 state 0x0 ref 1 00000100:00100000:3.0:1789760670.323402:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346669402985 time 346469402985 state 0x1 ref 1 00000100:00100000:0.0:1789760670.485427:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346669402985 time 346669625383 state 0x0 ref 1 00000100:00100000:0.0:1789760670.485460:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777148672:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760670.485505:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.485523:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760670.485527:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760670.485546:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.485561:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.501200:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.501220:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.501229:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.501236:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f1800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760670.501240:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.501248:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.501279:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760670.501285:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e34f381/0xc2b9a3a73985774e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760670.501362:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777148672:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15913us (178685us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760670.501372:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:1.0:1789760670.501379:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346669402985 time 346669625383 state 0x2 ref 0 00000100:00100000:2.0:1789760670.516423:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760670.516500:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777148800 00000100:00100000:3.0:1789760670.516509:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777148800 00000100:00100000:3.0:1789760670.516559:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346669402985 time 346669625383 state 0x0 ref 1 00000100:00100000:3.0:1789760670.516576:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346869625383 time 346669625383 state 0x1 ref 1 00000100:00100000:2.0:1789760670.687667:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346869625383 time 346871868455 state 0x0 ref 1 00000100:00100000:2.0:1789760670.687701:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777148800:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760670.687754:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760670.687769:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760670.687773:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760670.687778:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760670.687820:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760670.702665:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760670.702684:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760670.702694:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760670.702701:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ec00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760670.702706:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760670.702715:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760670.702861:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760670.702895:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000facf8d30/0xc2b9a3a739857755 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760670.702990:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777148800:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15302us (186572us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760670.703000:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:3.0:1789760670.703007:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346869625383 time 346871868455 state 0x2 ref 0 00000100:00100000:2.0:1789760670.712293:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760670.712414:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777148928 00000100:00100000:1.0:1789760670.712425:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777148928 00000100:00100000:1.0:1789760670.712477:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 346869625383 time 346871868455 state 0x0 ref 1 00000100:00100000:1.0:1789760670.712492:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347071868455 time 346871868455 state 0x1 ref 1 00000100:00100000:0.0:1789760670.888019:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347071868455 time 347072217110 state 0x0 ref 1 00000100:00100000:0.0:1789760670.888053:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777148928:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760670.888097:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.888114:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760670.888119:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760670.888125:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.888142:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.911031:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.911049:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.911057:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.911079:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f0e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760670.911083:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.911092:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.911110:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760670.911119:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e3b6358/0xc2b9a3a73985775c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760670.911216:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777148928:12345-192.168.203.38@tcp:3:dd.500 Request processed in 23175us (198930us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760670.911226:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:0.0:1789760670.911234:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347071868455 time 347072217110 state 0x2 ref 0 00000100:00100000:1.0:1789760670.918519:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760670.918705:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777149056 00000100:00100000:2.0:1789760670.918718:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777149056 00000100:00100000:2.0:1789760670.918855:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347071868455 time 347072217110 state 0x0 ref 1 00000100:00100000:2.0:1789760670.918871:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347272217110 time 347072217110 state 0x1 ref 1 00000100:00100000:3.0:1789760671.088197:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347272217110 time 347272391029 state 0x0 ref 1 00000100:00100000:3.0:1789760671.088285:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777149056:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760671.088352:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.088376:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760671.088382:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760671.088391:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.088409:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760671.089692:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760671.108650:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.108702:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.108713:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.108723:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f6d3600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760671.108729:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.108740:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.108764:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.108773:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077bb9d08/0xc2b9a3a739857763 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760671.108938:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777149056:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20710us (190427us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760671.108950:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:3.0:1789760671.108960:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347272217110 time 347272391029 state 0x2 ref 0 00000100:00100000:1.0:1789760671.116028:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760671.116145:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777149184 00000100:00100000:0.0:1789760671.116157:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777149184 00000100:00100000:0.0:1789760671.116234:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347272217110 time 347272391029 state 0x0 ref 1 00000100:00100000:0.0:1789760671.116250:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347472391029 time 347272391029 state 0x1 ref 1 00010000:00010000:0.0:1789760671.239087:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760671.283560:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760671.283688:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777149312 00000100:00100000:1.0:1789760671.283704:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760671.283705:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777149312 00000100:00100000:0.0:1789760671.283857:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 350 00000100:00100000:1.0:1789760671.283866:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760671.283966:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777149312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760671.284089:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777149312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 215us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760671.284097:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 350 00000100:00100000:2.0:1789760671.288372:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347472391029 time 347472572103 state 0x0 ref 1 00000100:00100000:2.0:1789760671.288403:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777149184:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760671.288444:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.288479:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760671.288484:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760671.288490:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.288504:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760671.291163:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760671.291217:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760671.292415:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777149696 00000100:00100000:0.0:1789760671.292431:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777149696 00000100:00100000:0.0:1789760671.292508:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:0.0:1789760671.292519:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2402:x1876699777149696:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1789760671.292550:0:9533:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2b9a3a739856e6b 00000100:00080000:0.0:1789760671.292560:0:9533:0:(import.c:65:import_set_state_nolock()) ffff97e543261000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789760671.292598:0:9533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789760671.292896:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+2:2402:x1876699777149696:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 378us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760671.292905:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00080000:0.0:1789760671.292932:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789760671.292954:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760671.298897:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777149568 00000100:00100000:3.0:1789760671.298949:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777149568 00000100:00100000:3.0:1789760671.299051:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777149440 00000100:00100000:3.0:1789760671.299055:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777149440 00000100:00100000:3.0:1789760671.299091:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 279 00000100:00100000:3.0:1789760671.299107:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777149568:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:0.0:1789760671.300018:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760671.300029:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760671.300085:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00100000:0.0:1789760671.300122:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2403:x1876699777149440:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760671.302083:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777149952 00000100:00100000:2.0:1789760671.302099:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777149952 00000100:00080000:2.0:1789760671.302148:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760671.303922:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 281 00000100:00100000:2.0:1789760671.303942:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777149952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760671.304840:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777149568:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 5721us (21120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.304857:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 279 00000100:00100000:0.0:1789760671.313717:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2403:x1876699777149440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 13610us (29848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760671.313733:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00100000:2.0:1789760671.316194:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777149952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 12244us (24958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760671.316213:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 281 00000100:00100000:1.0:1789760671.317340:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:2.0:1789760671.317641:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.317659:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.317669:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.317678:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e541483800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760671.317697:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.317708:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.317732:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.317739:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071d16fb5/0xc2b9a3a73985776a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760671.317883:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777149184:12345-192.168.203.38@tcp:3:dd.500 Request processed in 29491us (201867us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760671.317894:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:2.0:1789760671.317904:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347472391029 time 347472572103 state 0x2 ref 0 00000100:00100000:3.0:1789760671.318926:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777149824 00000100:00100000:3.0:1789760671.318941:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777149824 00000100:00100000:3.0:1789760671.319029:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 282 00000100:00100000:3.0:1789760671.319041:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777149824:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760671.319236:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777149824:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 197us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.319244:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 282 00000100:00080000:2.0:1789760671.321603:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760671.324519:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760671.324706:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777150080 00000100:00100000:3.0:1789760671.324720:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777150080 00000100:00100000:3.0:1789760671.324826:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347472391029 time 347472572103 state 0x0 ref 1 00000100:00100000:3.0:1789760671.324843:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347672572103 time 347472572103 state 0x1 ref 1 00000100:00100000:3.0:1789760671.488668:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347672572103 time 347672784664 state 0x0 ref 1 00000100:00100000:3.0:1789760671.488914:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777150080:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760671.488971:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.488991:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760671.489012:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760671.489021:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.489037:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.554065:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.554086:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.554096:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.554104:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f6d3c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760671.554126:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.554136:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.554156:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.554164:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e5701b5/0xc2b9a3a739857771 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760671.554261:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777150080:12345-192.168.203.38@tcp:3:dd.500 Request processed in 65566us (229753us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760671.554271:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:2.0:1789760671.554279:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347672572103 time 347672784664 state 0x2 ref 0 00000100:00100000:3.0:1789760671.570937:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760671.571112:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777150208 00000100:00100000:0.0:1789760671.571125:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777150208 00000100:00100000:0.0:1789760671.571208:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347672572103 time 347672784664 state 0x0 ref 1 00000100:00100000:0.0:1789760671.571224:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347872784664 time 347672784664 state 0x1 ref 1 00000100:00100000:1.0:1789760671.688778:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347872784664 time 347872973740 state 0x0 ref 1 00000100:00100000:1.0:1789760671.688855:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777150208:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760671.688923:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.688944:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760671.688949:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760671.688956:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.688972:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.708403:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.708429:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.708438:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.708446:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac35200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760671.708655:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.708696:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.708722:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.708731:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857778 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760671.708912:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777150208:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20076us (137981us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760671.708924:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:1.0:1789760671.708935:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347872784664 time 347872973740 state 0x2 ref 0 00000100:00100000:3.0:1789760671.726077:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760671.727413:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777150336 00000100:00100000:0.0:1789760671.727430:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777150336 00000100:00100000:1.0:1789760671.728021:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 347872784664 time 347872973740 state 0x0 ref 1 00000100:00100000:1.0:1789760671.728038:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348072973740 time 347872973740 state 0x1 ref 1 00000100:00100000:0.0:1789760671.888997:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348072973740 time 348073195885 state 0x0 ref 1 00000100:00100000:0.0:1789760671.889031:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777150336:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760671.889252:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.889268:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760671.889272:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760671.889278:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.889295:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.903292:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.903315:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.903325:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.903355:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f0800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760671.903360:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.903369:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.903390:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760671.903398:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985777f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760671.903507:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777150336:12345-192.168.203.38@tcp:3:dd.500 Request processed in 14488us (177441us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760671.903874:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:0.0:1789760671.903882:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348072973740 time 348073195885 state 0x2 ref 0 00000100:00100000:0.0:1789760671.911429:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760671.912047:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777150464 00000100:00100000:2.0:1789760671.912070:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777150464 00000100:00100000:2.0:1789760671.912127:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348072973740 time 348073195885 state 0x0 ref 1 00000100:00100000:2.0:1789760671.912296:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348273195885 time 348073195885 state 0x1 ref 1 00000100:00100000:1.0:1789760672.090168:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348273195885 time 348274363964 state 0x0 ref 1 00000100:00100000:1.0:1789760672.090231:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777150464:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760672.090775:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.090834:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760672.090839:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760672.090868:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.090886:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.114753:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.114782:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.114830:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.114840:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac35200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760672.114846:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.114857:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.114884:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.114892:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857786 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760672.115596:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777150464:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25397us (204166us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760672.115611:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:1.0:1789760672.115631:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348273195885 time 348274363964 state 0x2 ref 0 00000100:00100000:2.0:1789760672.126606:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760672.127113:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777150592 00000100:00100000:3.0:1789760672.127128:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777150592 00000100:00100000:3.0:1789760672.127219:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348273195885 time 348274363964 state 0x0 ref 1 00000100:00100000:3.0:1789760672.127238:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348474363964 time 348274363964 state 0x1 ref 1 00010000:00010000:2.0:1789760672.267598:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760672.290391:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348474363964 time 348474586078 state 0x0 ref 1 00000100:00100000:2.0:1789760672.290439:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777150592:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760672.290520:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.290543:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760672.290549:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760672.290556:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.290573:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.335777:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.335829:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.335839:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.335866:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542e15a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760672.335872:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.335883:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.335910:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.335918:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e20d9654/0xc2b9a3a73985778d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760672.336062:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777150592:12345-192.168.203.38@tcp:3:dd.500 Request processed in 45629us (209453us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760672.336076:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:0.0:1789760672.336087:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348474363964 time 348474586078 state 0x2 ref 0 00000100:00100000:2.0:1789760672.350184:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760672.354430:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777150720 00000100:00100000:1.0:1789760672.354451:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777150720 00000100:00100000:1.0:1789760672.354535:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348474363964 time 348474586078 state 0x0 ref 1 00000100:00100000:1.0:1789760672.354556:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348674586078 time 348474586078 state 0x1 ref 1 00000100:00100000:1.0:1789760672.491050:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348674586078 time 348675243286 state 0x0 ref 1 00000100:00100000:1.0:1789760672.491097:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777150720:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760672.491163:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.491185:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760672.491190:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760672.491198:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.491215:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.510908:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.510957:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.510978:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.510988:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac35200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760672.510994:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.511005:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.511030:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.511038:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000786b2a4/0xc2b9a3a739857794 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760672.511167:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777150720:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20088us (160990us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760672.511180:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:1.0:1789760672.511190:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348674586078 time 348675243286 state 0x2 ref 0 00000100:00100000:2.0:1789760672.517240:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760672.517360:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777150848 00000100:00100000:0.0:1789760672.517374:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777150848 00000100:00100000:0.0:1789760672.517449:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348674586078 time 348675243286 state 0x0 ref 1 00000100:00100000:0.0:1789760672.517466:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348875243286 time 348675243286 state 0x1 ref 1 00000100:00100000:2.0:1789760672.692267:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348875243286 time 348876463090 state 0x0 ref 1 00000100:00100000:2.0:1789760672.692325:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777150848:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760672.692381:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.692403:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760672.692407:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760672.692415:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.692431:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.728761:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.728821:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.728832:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.728841:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c6000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760672.728846:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.728856:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.728880:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760672.728888:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8326e36/0xc2b9a3a73985779b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760672.730623:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777150848:12345-192.168.203.38@tcp:3:dd.500 Request processed in 38297us (213371us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760672.730642:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:1.0:1789760672.730654:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348875243286 time 348876463090 state 0x2 ref 0 00000100:00100000:3.0:1789760672.741760:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760672.744444:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777150976 00000100:00100000:1.0:1789760672.744486:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777150976 00000100:00100000:1.0:1789760672.744561:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 348875243286 time 348876463090 state 0x0 ref 1 00000100:00100000:1.0:1789760672.744578:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349076463090 time 348876463090 state 0x1 ref 1 00000100:00100000:0.0:1789760672.892534:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349076463090 time 349076728909 state 0x0 ref 1 00000100:00100000:0.0:1789760672.892588:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777150976:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760672.892706:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.892728:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760672.892733:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760672.892739:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760672.892760:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.916755:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.916784:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.916820:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.916830:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f1600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760672.916836:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.916847:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.916872:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760672.916881:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b4c3626/0xc2b9a3a7398577a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760672.917191:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777150976:12345-192.168.203.38@tcp:3:dd.500 Request processed in 24626us (175440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760672.917204:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:2.0:1789760672.917232:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349076463090 time 349076728909 state 0x2 ref 0 00000100:00100000:3.0:1789760672.923922:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760672.924035:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777151104 00000100:00100000:0.0:1789760672.924049:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777151104 00000100:00100000:0.0:1789760672.924131:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349076463090 time 349076728909 state 0x0 ref 1 00000100:00100000:0.0:1789760672.924148:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349276728909 time 349076728909 state 0x1 ref 1 00000001:00100000:2.0:1789760673.025682:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:2.0:1789760673.025689:0:9084:0:(genops.c:885:class_export_put()) final put ffff97e543267000/ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:2.0:1789760673.025717:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97e543267000/ac82f857-edfe-4201-bbe8-4599ba569acb for lustre-OST0001 00000020:00000080:2.0:1789760673.025763:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e543261000 for lustre-OST0001 00000001:00080000:1.0:1789760673.030501:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967331 is committed 00000100:00100000:1.0:1789760673.095921:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349276728909 time 349280119540 state 0x0 ref 1 00000100:00100000:2.0:1789760673.097763:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777151104:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760673.097843:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760673.097863:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760673.097869:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760673.097876:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760673.097890:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760673.099372:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760673.111122:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760673.111144:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760673.111154:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760673.111182:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760673.111188:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760673.111198:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760673.111218:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760673.111225:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760673.111338:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777151104:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15393us (187426us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760673.111350:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1789760673.111359:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349276728909 time 349280119540 state 0x2 ref 0 00000100:00100000:3.0:1789760673.122944:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760673.123050:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777151232 00000100:00100000:1.0:1789760673.123060:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777151232 00000100:00100000:1.0:1789760673.123125:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349276728909 time 349280119540 state 0x0 ref 1 00000100:00100000:1.0:1789760673.123138:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349480119540 time 349280119540 state 0x1 ref 1 00010000:00010000:0.0:1789760673.287124:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760673.297861:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349480119540 time 349482059132 state 0x0 ref 1 00000100:00100000:3.0:1789760673.297896:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777151232:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760673.297940:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.297956:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760673.297960:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760673.297966:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.297998:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.318316:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.318335:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.318344:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.318351:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760673.318356:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.318365:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.318386:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.318393:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760673.318489:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777151232:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20606us (195554us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760673.318498:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:3.0:1789760673.318505:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349480119540 time 349482059132 state 0x2 ref 0 00000100:00100000:3.0:1789760673.324437:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760673.324652:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777151360 00000100:00100000:2.0:1789760673.324662:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777151360 00000100:00100000:2.0:1789760673.324717:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349480119540 time 349482059132 state 0x0 ref 1 00000100:00100000:2.0:1789760673.324730:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349682059132 time 349482059132 state 0x1 ref 1 00000100:00100000:0.0:1789760673.479110:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760673.479132:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798179328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760673.479211:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760673.479333:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798179328 00000100:00100000:3.0:1789760673.479342:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798179328 00000100:00100000:3.0:1789760673.479401:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760673.479411:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798179328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760673.479443:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760673.479489:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798179328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760673.479496:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760673.479559:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798179328:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789760673.479740:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760673.479955:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760673.479966:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798179456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760673.480001:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760673.480037:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798179456 00000100:00100000:0.0:1789760673.480041:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798179456 00000100:00100000:0.0:1789760673.480071:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789760673.480090:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798179456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760673.480103:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760673.480136:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798179456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760673.480142:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1789760673.480156:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760673.480178:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798179456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760673.485653:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798179584:0@lo:400:kworker.0 00000100:00100000:0.0:1789760673.485738:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760673.486065:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798179712:0@lo:400:kworker.0 00000100:00100000:3.0:1789760673.486101:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760673.486132:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798180224:0@lo:400:kworker.0 00000100:00100000:3.0:1789760673.486154:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760673.486197:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798180736:0@lo:400:kworker.0 00000100:00100000:3.0:1789760673.486219:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760673.486248:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789760673.486254:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798180096:0@lo:400:kworker.0 00000100:00100000:3.0:1789760673.486314:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760673.486350:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798180608:0@lo:400:kworker.0 00000100:00100000:3.0:1789760673.486376:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760673.486406:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798179712 00000100:00100000:3.0:1789760673.486414:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798179712 00000100:00100000:3.0:1789760673.486457:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798180224 00000100:00100000:3.0:1789760673.486460:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798180224 00000100:00100000:3.0:1789760673.486485:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798180736 00000100:00100000:3.0:1789760673.486488:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798180736 00000100:00100000:3.0:1789760673.486505:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789760673.486513:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798179712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760673.486580:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798179712:12345-0@lo:400:kworker.0 Request processed in 68us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760673.486587:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789760673.486603:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789760673.486620:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798180224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760673.486649:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798180224:12345-0@lo:400:kworker.0 Request processed in 40us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760673.486655:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789760673.486666:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789760673.486672:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798180736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760673.486699:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798180736:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760673.486705:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789760673.486725:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798180096 00000100:00100000:3.0:1789760673.486729:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798180096 00000100:00100000:1.0:1789760673.488054:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798180608 00000100:00100000:1.0:1789760673.488068:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798180608 00000100:00100000:1.0:1789760673.488131:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789760673.488141:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798180608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488208:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798180608:12345-0@lo:400:kworker.0 Request processed in 68us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760673.488216:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1789760673.488242:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760673.488247:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760673.488276:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798179840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488314:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760673.488342:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798180352:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488367:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760673.488385:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798180864:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488407:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760673.488445:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789760673.488452:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798179968:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488476:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760673.488493:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798180480:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488518:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760673.488557:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798179840 00000100:00100000:1.0:1789760673.488561:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798179840 00000100:00100000:1.0:1789760673.488582:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789760673.488590:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798180096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488639:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798180096:12345-0@lo:400:kworker.0 Request processed in 50us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760673.488645:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789760673.488658:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789760673.488663:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798179840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488693:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798179840:12345-0@lo:400:kworker.0 Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760673.488699:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789760673.488715:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798180352 00000100:00100000:1.0:1789760673.488718:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798180352 00000100:00100000:1.0:1789760673.488739:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798180864 00000100:00100000:1.0:1789760673.488742:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798180864 00000100:00100000:1.0:1789760673.488753:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798179968 00000100:00100000:1.0:1789760673.488755:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798179968 00000100:00100000:1.0:1789760673.488767:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789760673.488772:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798180352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488832:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798180352:12345-0@lo:400:kworker.0 Request processed in 59us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760673.488838:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789760673.488857:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789760673.488863:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798180864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488891:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798180864:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760673.488897:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789760673.488907:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789760673.488912:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798179968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.488939:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798179968:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760673.488945:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1789760673.488959:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760673.488992:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798179968:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489002:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798179840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489012:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798180352:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489021:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798180864:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489086:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798180096:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489097:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798180608:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489108:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798179712:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489119:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798180224:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489130:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798180736:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489180:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798180480 00000100:00100000:1.0:1789760673.489183:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798180480 00000100:00100000:1.0:1789760673.489220:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789760673.489226:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798180480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.489259:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798180480:12345-0@lo:400:kworker.0 Request processed in 34us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760673.489265:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1789760673.489281:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760673.489297:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798180480:0@lo:400:kworker.0 00000100:00100000:2.0:1789760673.489897:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798179584 00000100:00100000:2.0:1789760673.489905:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798179584 00000100:00100000:2.0:1789760673.489986:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789760673.490003:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798179584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760673.490060:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798179584:12345-0@lo:400:kworker.0 Request processed in 59us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760673.490066:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789760673.490148:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798179584:0@lo:400:kworker.0 00000100:00100000:1.0:1789760673.498856:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349682059132 time 349682729846 state 0x0 ref 1 00000100:00100000:1.0:1789760673.498893:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777151360:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760673.498940:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.499340:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760673.499346:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760673.499354:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.499371:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.530356:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.530378:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.530409:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.530418:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8e200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760673.530423:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.530433:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.530454:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760673.530464:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398577b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760673.530569:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777151360:12345-192.168.203.38@tcp:3:dd.500 Request processed in 31687us (206138us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760673.530580:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:1.0:1789760673.530589:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349682059132 time 349682729846 state 0x2 ref 0 00000100:00100000:1.0:1789760673.536126:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760673.536224:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777151488 00000100:00100000:2.0:1789760673.536234:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777151488 00000100:00100000:2.0:1789760673.536290:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349682059132 time 349682729846 state 0x0 ref 1 00000100:00100000:2.0:1789760673.536303:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349882729846 time 349682729846 state 0x1 ref 1 00000100:00100000:3.0:1789760673.701977:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349882729846 time 349885992448 state 0x0 ref 1 00000100:00100000:3.0:1789760673.702011:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777151488:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760673.702065:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.702082:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760673.702086:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760673.702092:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.702104:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.720722:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.720746:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.720754:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.720761:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760673.720767:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.720775:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.720846:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760673.720854:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398577be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760673.720950:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777151488:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18950us (184828us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760673.720959:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:3.0:1789760673.720968:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349882729846 time 349885992448 state 0x2 ref 0 00000100:00100000:1.0:1789760673.733143:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760673.739367:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777151616 00000100:00100000:2.0:1789760673.739383:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777151616 00000100:00100000:2.0:1789760673.739441:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 349882729846 time 349885992448 state 0x0 ref 1 00000100:00100000:2.0:1789760673.739453:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350085992448 time 349885992448 state 0x1 ref 1 00000100:00100000:0.0:1789760673.901974:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350085992448 time 350086173661 state 0x0 ref 1 00000100:00100000:0.0:1789760673.902009:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777151616:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760673.902052:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.902069:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760673.902073:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760673.902080:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.902096:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.911870:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.911902:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.911911:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.911920:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760673.911934:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.911945:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.911965:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760673.911972:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760673.912059:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777151616:12345-192.168.203.38@tcp:3:dd.500 Request processed in 10062us (178922us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760673.912069:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:0.0:1789760673.912077:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350085992448 time 350086173661 state 0x2 ref 0 00000100:00100000:1.0:1789760673.921879:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760673.922064:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777151744 00000100:00100000:3.0:1789760673.922074:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777151744 00000100:00100000:3.0:1789760673.922134:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350085992448 time 350086173661 state 0x0 ref 1 00000100:00100000:3.0:1789760673.922147:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350286173661 time 350086173661 state 0x1 ref 1 00000100:00100000:1.0:1789760673.994012:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798180992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760673.994114:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760673.994345:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798180992 00000100:00100000:2.0:1789760673.994354:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798180992 00000100:00100000:2.0:1789760673.994403:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789760673.994412:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565e38c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798180992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760673.994451:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760673.994516:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565e38c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798180992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760673.994523:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789760673.994847:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798180992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760674.102153:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350286173661 time 350286350559 state 0x0 ref 1 00000100:00100000:2.0:1789760674.102197:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777151744:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760674.102251:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.102284:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760674.102289:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760674.102296:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.102313:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.113507:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.113528:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.113538:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.113546:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760674.113552:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.113564:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.113584:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.113623:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a7398577cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760674.113763:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777151744:12345-192.168.203.38@tcp:3:dd.500 Request processed in 11586us (191888us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760674.113773:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 165 00000100:00100000:2.0:1789760674.113782:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350286173661 time 350286350559 state 0x2 ref 0 00000100:00100000:2.0:1789760674.125475:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760674.125585:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777151872 00000100:00100000:1.0:1789760674.125595:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777151872 00000100:00100000:1.0:1789760674.125654:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350286173661 time 350286350559 state 0x0 ref 1 00000100:00100000:1.0:1789760674.125668:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350486350559 time 350286350559 state 0x1 ref 1 00000100:00100000:0.0:1789760674.303069:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350486350559 time 350487267629 state 0x0 ref 1 00000100:00100000:0.0:1789760674.303103:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777151872:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760674.303143:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.303159:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760674.303164:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760674.303170:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.303183:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.312286:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760674.333650:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.333672:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.333681:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.333688:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760674.333693:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.333721:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.333740:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.333747:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a7398577d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760674.333866:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777151872:12345-192.168.203.38@tcp:3:dd.500 Request processed in 30774us (208396us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760674.333875:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:0.0:1789760674.333883:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350486350559 time 350487267629 state 0x2 ref 0 00000100:00100000:1.0:1789760674.350963:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760674.351123:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777152000 00000100:00100000:3.0:1789760674.351134:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777152000 00000100:00100000:3.0:1789760674.351188:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350486350559 time 350487267629 state 0x0 ref 1 00000100:00100000:3.0:1789760674.351201:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350687267629 time 350487267629 state 0x1 ref 1 00000100:00100000:1.0:1789760674.503043:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760674.503079:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798181120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760674.503146:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760674.503325:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798181120 00000100:00100000:3.0:1789760674.503334:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798181120 00000100:00100000:3.0:1789760674.503399:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789760674.503409:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798181120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760674.503451:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760674.503533:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798181120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760674.503541:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789760674.503754:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798181120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760674.503837:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350687267629 time 350688042840 state 0x0 ref 1 00000100:00100000:1.0:1789760674.503855:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777152000:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760674.503887:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760674.503903:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760674.503907:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760674.503913:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760674.503926:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.535850:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.535876:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.535884:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.535892:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5821c4400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760674.535896:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.535906:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.535925:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.535933:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97af399/0xc2b9a3a7398577da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760674.536025:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777152000:12345-192.168.203.38@tcp:3:dd.500 Request processed in 32170us (185079us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760674.536055:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 167 00000100:00100000:3.0:1789760674.536063:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350687267629 time 350688042840 state 0x2 ref 0 00000100:00100000:2.0:1789760674.543923:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760674.544053:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777152128 00000100:00100000:0.0:1789760674.544063:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777152128 00000100:00100000:0.0:1789760674.544128:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350687267629 time 350688042840 state 0x0 ref 1 00000100:00100000:0.0:1789760674.544141:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350888042840 time 350688042840 state 0x1 ref 1 00000100:00100000:2.0:1789760674.703988:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350888042840 time 350888189918 state 0x0 ref 1 00000100:00100000:2.0:1789760674.704017:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777152128:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760674.704056:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.704073:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760674.704078:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760674.704084:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.704097:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.719058:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.719078:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.719227:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.719236:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadc800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760674.719241:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.719251:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.719273:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760674.719280:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398577e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760674.720029:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777152128:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15355us (175447us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760674.720054:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:3.0:1789760674.720062:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350888042840 time 350888189918 state 0x2 ref 0 00000100:00100000:1.0:1789760674.730682:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760674.730898:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777152256 00000100:00100000:2.0:1789760674.730918:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777152256 00000100:00100000:2.0:1789760674.730974:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 350888042840 time 350888189918 state 0x0 ref 1 00000100:00100000:2.0:1789760674.730987:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351088189918 time 350888189918 state 0x1 ref 1 00000100:00100000:2.0:1789760674.904093:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351088189918 time 351088292876 state 0x0 ref 1 00000100:00100000:2.0:1789760674.904125:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777152256:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760674.904165:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.904182:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760674.904186:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760674.904192:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760674.904209:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.918235:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.918260:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.918290:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.918298:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760674.918303:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.918312:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.918341:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760674.918350:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0bcb419/0xc2b9a3a7398577e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760674.918482:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777152256:12345-192.168.203.38@tcp:3:dd.500 Request processed in 14358us (187795us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760674.918493:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:0.0:1789760674.918501:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351088189918 time 351088292876 state 0x2 ref 0 00000100:00100000:1.0:1789760674.928141:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760674.928213:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777152384 00000100:00100000:0.0:1789760674.928222:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777152384 00000100:00100000:0.0:1789760674.928278:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351088189918 time 351088292876 state 0x0 ref 1 00000100:00100000:0.0:1789760674.928290:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351288292876 time 351088292876 state 0x1 ref 1 00000100:00100000:0.0:1789760675.015068:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798181376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760675.015141:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760675.015360:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798181376 00000100:00100000:3.0:1789760675.015369:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798181376 00000100:00100000:3.0:1789760675.015432:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789760675.015442:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798181376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760675.015475:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789760675.015528:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798181376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760675.015534:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789760675.015588:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798181376:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789760675.015652:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760675.015819:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798181248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760675.015865:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760675.016631:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798181248 00000100:00100000:3.0:1789760675.016638:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798181248 00000100:00100000:3.0:1789760675.016972:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789760675.016990:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798181248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760675.017007:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789760675.017069:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798181248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760675.017079:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789760675.017831:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798181248:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789760675.019526:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760675.104332:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351288292876 time 351288532550 state 0x0 ref 1 00000100:00100000:2.0:1789760675.104382:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777152384:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760675.104426:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.104443:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760675.104458:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760675.104465:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.104479:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760675.105389:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760675.137511:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.137532:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.137556:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.137563:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadca00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760675.137568:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.137577:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.137608:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.137616:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f420ce/0xc2b9a3a7398577ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760675.137732:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777152384:12345-192.168.203.38@tcp:3:dd.500 Request processed in 33378us (209594us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760675.137743:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:2.0:1789760675.137751:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351288292876 time 351288532550 state 0x2 ref 0 00000100:00100000:2.0:1789760675.154443:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760675.154710:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777152512 00000100:00100000:3.0:1789760675.154721:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777152512 00000100:00100000:3.0:1789760675.154775:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351288292876 time 351288532550 state 0x0 ref 1 00000100:00100000:3.0:1789760675.154833:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351488532550 time 351288532550 state 0x1 ref 1 00000100:00100000:3.0:1789760675.306866:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351488532550 time 351491065683 state 0x0 ref 1 00000100:00100000:3.0:1789760675.306914:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777152512:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760675.306958:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.306976:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760675.306980:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760675.306986:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.306999:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.325297:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.325316:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.325326:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.325334:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e550f0fc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760675.325339:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.325348:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.325381:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.325389:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005485738/0xc2b9a3a7398577f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760675.325482:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777152512:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18578us (171045us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760675.325491:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:3.0:1789760675.325500:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351488532550 time 351491065683 state 0x2 ref 0 00000100:00100000:1.0:1789760675.335485:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760675.335890:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777152640 00000100:00100000:3.0:1789760675.335900:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777152640 00000100:00100000:3.0:1789760675.335958:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351488532550 time 351491065683 state 0x0 ref 1 00000100:00100000:3.0:1789760675.335971:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351691065683 time 351491065683 state 0x1 ref 1 00010000:00010000:2.0:1789760675.336623:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760675.507025:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351691065683 time 351691223940 state 0x0 ref 1 00000100:00100000:1.0:1789760675.507058:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777152640:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760675.507182:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760675.507200:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760675.507205:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760675.507211:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760675.507236:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.533019:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.533040:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.533050:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.533058:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e558263000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760675.533063:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.533082:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.533103:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.533111:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098082559/0xc2b9a3a7398577fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760675.533237:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777152640:12345-192.168.203.38@tcp:3:dd.500 Request processed in 26179us (197745us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760675.533256:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:0.0:1789760675.533265:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351691065683 time 351691223940 state 0x2 ref 0 00000100:00100000:1.0:1789760675.545749:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760675.551832:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777152768 00000100:00100000:0.0:1789760675.551847:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777152768 00000100:00100000:0.0:1789760675.551911:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351691065683 time 351691223940 state 0x0 ref 1 00000100:00100000:0.0:1789760675.551957:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351891223940 time 351691223940 state 0x1 ref 1 00000100:00100000:3.0:1789760675.707450:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351891223940 time 351891648926 state 0x0 ref 1 00000100:00100000:3.0:1789760675.707494:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777152768:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760675.707541:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.707559:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760675.707563:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760675.707569:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760675.707610:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.735563:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.735586:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.735606:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.735614:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760675.735620:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.735632:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.735653:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760675.735679:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739857804 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760675.736863:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777152768:12345-192.168.203.38@tcp:3:dd.500 Request processed in 29383us (191114us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760675.736874:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:2.0:1789760675.736884:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351891223940 time 351891648926 state 0x2 ref 0 00000100:00100000:3.0:1789760675.756358:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760675.756876:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777152896 00000100:00100000:2.0:1789760675.756887:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777152896 00000100:00100000:2.0:1789760675.756941:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 351891223940 time 351891648926 state 0x0 ref 1 00000100:00100000:2.0:1789760675.756953:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352091648926 time 351891648926 state 0x1 ref 1 00000100:00100000:0.0:1789760675.907629:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352091648926 time 352091829659 state 0x0 ref 1 00000100:00100000:0.0:1789760675.907664:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777152896:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760675.907716:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.907733:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760675.907737:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760675.907744:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.907761:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.927341:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.927393:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.927402:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.927410:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760675.927414:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.927422:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.927443:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760675.927451:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a73985780b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760675.927537:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777152896:12345-192.168.203.38@tcp:3:dd.500 Request processed in 19886us (171184us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760675.927547:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:0.0:1789760675.927556:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352091648926 time 352091829659 state 0x2 ref 0 00000100:00100000:1.0:1789760675.933888:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760675.933978:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777153024 00000100:00100000:3.0:1789760675.933989:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777153024 00000100:00100000:3.0:1789760675.934041:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352091648926 time 352091829659 state 0x0 ref 1 00000100:00100000:3.0:1789760675.934054:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352291829659 time 352091829659 state 0x1 ref 1 00000100:00100000:1.0:1789760676.114241:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352291829659 time 352298435455 state 0x0 ref 1 00000100:00100000:1.0:1789760676.114355:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777153024:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760676.114412:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.114431:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760676.114436:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760676.114443:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.114477:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.127750:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.127770:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.127778:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.127828:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dca00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760676.127833:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.127865:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.127888:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.127895:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a6d02bb/0xc2b9a3a739857812 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760676.127993:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777153024:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13658us (194112us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760676.128005:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 175 00000100:00100000:2.0:1789760676.128013:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352291829659 time 352298435455 state 0x2 ref 0 00000100:00100000:3.0:1789760676.134985:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760676.135104:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777153152 00000100:00100000:0.0:1789760676.135129:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777153152 00000100:00100000:0.0:1789760676.135178:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352291829659 time 352298435455 state 0x0 ref 1 00000100:00100000:0.0:1789760676.135190:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352498435455 time 352298435455 state 0x1 ref 1 00000100:00100000:0.0:1789760676.315941:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352498435455 time 352500138514 state 0x0 ref 1 00000100:00100000:0.0:1789760676.315980:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777153152:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760676.316025:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.316054:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760676.316059:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760676.316065:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.316087:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.331821:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.331843:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.331853:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.331883:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760676.331888:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.331897:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.331919:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.331927:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c84b5d0/0xc2b9a3a739857819 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760676.332160:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777153152:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16194us (197177us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760676.332171:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:0.0:1789760676.332179:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352498435455 time 352500138514 state 0x2 ref 0 00000100:00100000:1.0:1789760676.350858:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760676.350955:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777153280 00000100:00100000:2.0:1789760676.350965:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777153280 00000100:00100000:2.0:1789760676.351018:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352498435455 time 352500138514 state 0x0 ref 1 00000100:00100000:2.0:1789760676.351030:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352700138514 time 352500138514 state 0x1 ref 1 00010000:00010000:0.0:1789760676.360738:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760676.398164:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760676.398213:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760676.398398:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777153536 00000100:00100000:1.0:1789760676.398408:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777153536 00000100:00100000:1.0:1789760676.398475:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777153792 00000100:00100000:1.0:1789760676.398478:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777153792 00000100:00100000:1.0:1789760676.398504:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 289 00000100:00100000:1.0:1789760676.398514:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2405:x1876699777153536:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760676.398622:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:2.0:1789760676.398633:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777153792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:0.0:1789760676.398714:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760676.399736:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2405:x1876699777153536:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1217us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760676.399745:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 289 00000100:00100000:2.0:1789760676.400403:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777153792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1768us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760676.400413:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:3.0:1789760676.400639:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760676.401017:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760676.401039:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760676.402505:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777153664 00000100:00100000:1.0:1789760676.402517:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777153664 00000100:00100000:1.0:1789760676.402595:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777153920 00000100:00100000:1.0:1789760676.402599:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777153920 00000100:00100000:1.0:1789760676.402625:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 291 00000100:00100000:1.0:1789760676.402635:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777153664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760676.402708:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777153664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760676.402715:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 291 00000100:00100000:1.0:1789760676.402731:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 292 00000100:00100000:1.0:1789760676.402738:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777153920:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760676.402764:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777153920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760676.402782:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 292 00000100:00080000:3.0:1789760676.403701:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760676.403906:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777153408 00000100:00100000:0.0:1789760676.403915:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777153408 00000100:00100000:0.0:1789760676.403960:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 352 00000100:00100000:0.0:1789760676.403969:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777153408:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760676.404026:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777153408:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 59us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760676.404042:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 352 00000100:00100000:3.0:1789760676.520862:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352700138514 time 352705061215 state 0x0 ref 1 00000100:00100000:3.0:1789760676.520898:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777153280:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760676.520943:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.520960:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760676.520965:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760676.520971:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.521000:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.535678:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.535698:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.535708:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.535716:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760676.535722:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.535731:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.535751:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.535760:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857820 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760676.535893:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777153280:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15008us (185042us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760676.535903:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:3.0:1789760676.535912:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352700138514 time 352705061215 state 0x2 ref 0 00000100:00100000:1.0:1789760676.547882:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760676.547946:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777154048 00000100:00100000:0.0:1789760676.547956:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777154048 00000100:00100000:0.0:1789760676.548004:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352700138514 time 352705061215 state 0x0 ref 1 00000100:00100000:0.0:1789760676.548016:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352905061215 time 352705061215 state 0x1 ref 1 00000100:00100000:3.0:1789760676.721011:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352905061215 time 352905212712 state 0x0 ref 1 00000100:00100000:3.0:1789760676.721043:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777154048:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760676.721083:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.721099:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760676.721103:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760676.721109:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.721123:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.737826:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.737846:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.737874:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.737882:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760676.737887:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.737897:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.737917:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.737924:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038f20357/0xc2b9a3a739857827 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760676.738013:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777154048:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16980us (190135us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760676.738022:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:3.0:1789760676.738692:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352905061215 time 352905212712 state 0x2 ref 0 00000100:00100000:1.0:1789760676.752396:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760676.752511:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777154176 00000100:00100000:3.0:1789760676.752522:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777154176 00000100:00100000:3.0:1789760676.752657:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 352905061215 time 352905212712 state 0x0 ref 1 00000100:00100000:3.0:1789760676.752738:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353105212712 time 352905212712 state 0x1 ref 1 00000100:00100000:0.0:1789760676.921862:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353105212712 time 353106059436 state 0x0 ref 1 00000100:00100000:0.0:1789760676.921901:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777154176:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760676.921950:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.921969:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760676.921973:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760676.921980:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.921995:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.936558:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.936597:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.936631:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.936640:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac34200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760676.936646:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.936656:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.936682:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760676.936692:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a73985782e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760676.937049:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777154176:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15161us (184657us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760676.937060:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:0.0:1789760676.937080:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353105212712 time 353106059436 state 0x2 ref 0 00000100:00100000:0.0:1789760676.951673:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760676.951829:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777154304 00000100:00100000:2.0:1789760676.951843:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777154304 00000100:00100000:2.0:1789760676.951920:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353105212712 time 353106059436 state 0x0 ref 1 00000100:00100000:2.0:1789760676.951949:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353306059436 time 353106059436 state 0x1 ref 1 00000100:00100000:0.0:1789760677.123864:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353306059436 time 353308058373 state 0x0 ref 1 00000100:00100000:0.0:1789760677.123941:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777154304:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760677.124043:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.124067:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760677.124073:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760677.124080:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.124099:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760677.125178:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760677.132474:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.132502:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.132513:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.132521:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac34200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760677.132526:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.132537:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.132562:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.132571:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011fd565/0xc2b9a3a739857835 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760677.132691:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777154304:12345-192.168.203.38@tcp:3:dd.500 Request processed in 8786us (181028us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760677.132722:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1789760677.132732:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353306059436 time 353308058373 state 0x2 ref 0 00000100:00100000:0.0:1789760677.144723:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760677.144875:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777154432 00000100:00100000:3.0:1789760677.144889:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777154432 00000100:00100000:3.0:1789760677.144960:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353306059436 time 353308058373 state 0x0 ref 1 00000100:00100000:3.0:1789760677.144977:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353508058373 time 353308058373 state 0x1 ref 1 00000100:00100000:2.0:1789760677.329493:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353508058373 time 353513685853 state 0x0 ref 1 00000100:00100000:2.0:1789760677.329542:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777154432:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760677.329613:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.329636:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760677.329642:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760677.329649:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.329666:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.342129:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.342157:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.342167:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.342202:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f0800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760677.342208:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.342231:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.342258:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.342267:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf293ceb/0xc2b9a3a73985783c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760677.342375:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777154432:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12851us (197660us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760677.342388:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:2.0:1789760677.342398:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353508058373 time 353513685853 state 0x2 ref 0 00000100:00100000:0.0:1789760677.348921:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760677.349157:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777154560 00000100:00100000:3.0:1789760677.349170:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777154560 00000100:00100000:3.0:1789760677.349302:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353508058373 time 353513685853 state 0x0 ref 1 00000100:00100000:3.0:1789760677.349321:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353713685853 time 353513685853 state 0x1 ref 1 00010000:00010000:0.0:1789760677.383337:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760677.529704:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353713685853 time 353713898084 state 0x0 ref 1 00000100:00100000:3.0:1789760677.529752:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777154560:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760677.529867:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.529889:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760677.529894:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760677.529903:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.529919:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.541871:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.541913:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.541920:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.541927:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542e15000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760677.541932:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.541940:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.542751:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.542764:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a739857843 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760677.544828:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777154560:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15089us (195912us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760677.544842:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:3.0:1789760677.544850:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353713685853 time 353713898084 state 0x2 ref 0 00000100:00100000:0.0:1789760677.559432:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760677.559524:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777154688 00000100:00100000:1.0:1789760677.559541:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777154688 00000100:00100000:1.0:1789760677.559597:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353713685853 time 353713898084 state 0x0 ref 1 00000100:00100000:1.0:1789760677.559609:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353913898084 time 353713898084 state 0x1 ref 1 00000100:00100000:3.0:1789760677.729914:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353913898084 time 353914116068 state 0x0 ref 1 00000100:00100000:3.0:1789760677.729956:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777154688:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760677.729993:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.730011:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760677.730015:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760677.730020:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.730034:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.742864:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.742884:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.742892:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.742915:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542e15000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760677.742919:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.742928:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.742948:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.742956:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006949481b/0xc2b9a3a73985784a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760677.743047:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777154688:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13098us (183620us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760677.743057:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:2.0:1789760677.743066:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353913898084 time 353914116068 state 0x2 ref 0 00000100:00100000:3.0:1789760677.747589:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760677.747686:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777154816 00000100:00100000:2.0:1789760677.747697:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777154816 00000100:00100000:2.0:1789760677.747759:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 353913898084 time 353914116068 state 0x0 ref 1 00000100:00100000:2.0:1789760677.747772:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354114116068 time 353914116068 state 0x1 ref 1 00000100:00100000:0.0:1789760677.930083:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354114116068 time 354114282681 state 0x0 ref 1 00000100:00100000:0.0:1789760677.930118:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777154816:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760677.930289:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.930308:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760677.930312:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760677.930318:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.930336:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.952688:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.952708:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.952717:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.952725:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac35e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760677.952730:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.952738:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.952759:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.952805:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025bb346e/0xc2b9a3a739857851 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760677.952889:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777154816:12345-192.168.203.38@tcp:3:dd.500 Request processed in 22786us (205315us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760677.952898:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:1.0:1789760677.952906:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354114116068 time 354114282681 state 0x2 ref 0 00000100:00100000:3.0:1789760677.961069:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760677.961139:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777154944 00000100:00100000:2.0:1789760677.961150:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777154944 00000100:00100000:2.0:1789760677.961200:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354114116068 time 354114282681 state 0x0 ref 1 00000100:00100000:2.0:1789760677.961223:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354314282681 time 354114282681 state 0x1 ref 1 00000100:00100000:3.0:1789760678.130745:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354314282681 time 354314943569 state 0x0 ref 1 00000100:00100000:3.0:1789760678.130780:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777154944:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760678.130871:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760678.130890:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760678.130896:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760678.130903:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760678.130920:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.152843:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.152863:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.152872:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.152881:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f8f8e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760678.152885:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.152895:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.152916:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.152925:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857858 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760678.153013:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777154944:12345-192.168.203.38@tcp:3:dd.500 Request processed in 22245us (191961us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760678.153023:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:2.0:1789760678.153039:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354314282681 time 354314943569 state 0x2 ref 0 00000100:00100000:3.0:1789760678.160521:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760678.162199:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777155072 00000100:00100000:2.0:1789760678.162332:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777155072 00000100:00100000:2.0:1789760678.162392:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354314282681 time 354314943569 state 0x0 ref 1 00000100:00100000:2.0:1789760678.162405:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354514943569 time 354314943569 state 0x1 ref 1 00000100:00100000:1.0:1789760678.331621:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354514943569 time 354515820614 state 0x0 ref 1 00000100:00100000:1.0:1789760678.331654:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777155072:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760678.331698:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760678.331717:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760678.331721:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760678.331727:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760678.331761:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.344487:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.344508:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.344517:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.344524:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760678.344528:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.344537:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.344556:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.344564:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a73985785f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760678.344666:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777155072:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13023us (184149us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760678.344676:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:0.0:1789760678.344698:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354514943569 time 354515820614 state 0x2 ref 0 00000100:00100000:3.0:1789760678.352736:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760678.352866:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777155200 00000100:00100000:2.0:1789760678.352877:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777155200 00000100:00100000:2.0:1789760678.352935:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354514943569 time 354515820614 state 0x0 ref 1 00000100:00100000:2.0:1789760678.352951:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354715820614 time 354515820614 state 0x1 ref 1 00010000:00010000:2.0:1789760678.409394:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760678.531696:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354715820614 time 354715895480 state 0x0 ref 1 00000100:00100000:2.0:1789760678.531728:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777155200:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760678.531776:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.531829:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760678.531834:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760678.531841:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.531855:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.551394:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.551428:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.551437:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.551445:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f1000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760678.551450:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.551460:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.551481:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.551489:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbe3f159/0xc2b9a3a739857866 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760678.553137:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777155200:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21418us (200405us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760678.553148:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:2.0:1789760678.553156:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354715820614 time 354715895480 state 0x2 ref 0 00000100:00100000:3.0:1789760678.564928:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760678.565188:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777155328 00000100:00100000:1.0:1789760678.565199:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777155328 00000100:00100000:1.0:1789760678.565265:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354715820614 time 354715895480 state 0x0 ref 1 00000100:00100000:1.0:1789760678.565294:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354915895480 time 354715895480 state 0x1 ref 1 00000100:00100000:0.0:1789760678.599234:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798181632:0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.599236:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798181760:0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.599344:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798181504:0@lo:400:kworker.0 00000100:00100000:1.0:1789760678.599775:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798181888:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.604944:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760678.604945:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760678.605073:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798181760 00000100:00100000:2.0:1789760678.605083:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798181760 00000100:00100000:2.0:1789760678.605142:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789760678.605302:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798181760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.605395:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760678.605440:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798182016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760678.605478:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760678.605497:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798182528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760678.605519:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760678.605536:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798183040:0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.605921:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798181760:12345-0@lo:400:kworker.0 Request processed in 769us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760678.605930:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789760678.605977:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798181760:0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.605985:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798182272:0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.606031:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798181504 00000100:00100000:2.0:1789760678.606036:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798181504 00000100:00100000:2.0:1789760678.606066:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789760678.606072:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798181504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.606104:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798181504:12345-0@lo:400:kworker.0 Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760678.606110:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789760678.606144:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798182016 00000100:00100000:2.0:1789760678.606148:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798182016 00000100:00100000:2.0:1789760678.606259:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798182528 00000100:00100000:2.0:1789760678.606263:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798182528 00000100:00100000:2.0:1789760678.606279:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789760678.606284:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798182016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760678.606311:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760678.606311:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760678.606354:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798181504:0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.606385:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798181632 00000100:00100000:3.0:1789760678.606389:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798181632 00000100:00100000:3.0:1789760678.606416:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798183040 00000100:00100000:3.0:1789760678.606419:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798183040 00000100:00100000:3.0:1789760678.606440:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789760678.606446:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798181632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.606490:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798182016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760678.606512:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789760678.606525:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789760678.606531:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798182528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760678.606671:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760678.606699:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798182528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 168us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760678.606706:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789760678.606983:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789760678.606994:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798183040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.607029:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798183040:12345-0@lo:400:kworker.0 Request processed in 39us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760678.607036:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1789760678.607055:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760678.607060:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760678.607072:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760678.607096:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798182784:0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.607126:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760678.607146:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798183296:0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.607304:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798181632:12345-0@lo:400:kworker.0 Request processed in 857us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760678.607312:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789760678.607325:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798182272 00000100:00100000:3.0:1789760678.607330:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798182272 00000100:00100000:3.0:1789760678.607358:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789760678.607374:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798182272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.607407:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798182272:12345-0@lo:400:kworker.0 Request processed in 34us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760678.607413:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:3.0:1789760678.607432:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760678.607463:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798182016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760678.607476:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798182528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760678.607486:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798183040:0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.607509:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760678.607748:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798182272:0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.608175:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798182784 00000100:00100000:3.0:1789760678.608181:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798182784 00000100:00100000:3.0:1789760678.608213:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798183296 00000100:00100000:3.0:1789760678.608216:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798183296 00000100:00100000:3.0:1789760678.608234:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789760678.608241:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798182784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.608300:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798182784:12345-0@lo:400:kworker.0 Request processed in 59us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760678.608307:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789760678.608320:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789760678.608325:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798183296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.608353:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798183296:12345-0@lo:400:kworker.0 Request processed in 28us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760678.608359:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1789760678.608379:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760678.608404:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798182784:0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.608416:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798183296:0@lo:400:kworker.0 00000100:00100000:1.0:1789760678.609286:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760678.609335:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798182400:0@lo:400:kworker.0 00000100:00100000:1.0:1789760678.609368:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760678.609387:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798182912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760678.609408:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760678.609662:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798181888 00000100:00100000:3.0:1789760678.609670:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798181888 00000100:00100000:3.0:1789760678.609715:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798182400 00000100:00100000:3.0:1789760678.609718:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798182400 00000100:00100000:3.0:1789760678.609744:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798182912 00000100:00100000:3.0:1789760678.609746:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798182912 00000100:00100000:3.0:1789760678.609762:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789760678.609770:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798181888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.609844:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798181888:12345-0@lo:400:kworker.0 Request processed in 74us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760678.609851:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789760678.609867:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789760678.609873:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798182400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.609899:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798182400:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760678.609905:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789760678.609914:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789760678.609920:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798182912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.609948:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798182912:12345-0@lo:400:kworker.0 Request processed in 29us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760678.609954:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:3.0:1789760678.609976:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760678.609979:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760678.610006:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798181888:0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.610018:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798182400:0@lo:400:kworker.0 00000100:00100000:3.0:1789760678.610027:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798182912:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.610286:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798181632:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.610295:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798182144:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.610325:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760678.610350:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798182656:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.610369:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760678.610392:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798183168:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.610413:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760678.610435:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798182656 00000100:00100000:0.0:1789760678.610440:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798182656 00000100:00100000:0.0:1789760678.610477:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798183168 00000100:00100000:0.0:1789760678.610480:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798183168 00000100:00100000:0.0:1789760678.610496:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789760678.610503:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798182656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.610772:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798182144 00000100:00100000:2.0:1789760678.610777:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798182144 00000100:00100000:2.0:1789760678.610824:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789760678.610832:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798182144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.610876:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798182144:12345-0@lo:400:kworker.0 Request processed in 44us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760678.610893:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789760678.610933:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789760678.610940:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798183168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760678.610971:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798183168:12345-0@lo:400:kworker.0 Request processed in 32us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760678.610977:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1789760678.610993:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760678.614905:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798182656:12345-0@lo:400:kworker.0 Request processed in 4397us (4529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760678.614917:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789760678.615002:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798183168:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.615043:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798182144:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.615053:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798182656:0@lo:400:kworker.0 00000100:00100000:0.0:1789760678.732272:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354915895480 time 354916470466 state 0x0 ref 1 00000100:00100000:0.0:1789760678.732346:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777155328:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760678.732389:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.732410:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760678.732415:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760678.732422:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.732438:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.749845:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.749866:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.749875:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.749883:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760678.749888:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.749897:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.749918:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760678.749954:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985786d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760678.750035:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777155328:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17712us (185113us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760678.750045:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:2.0:1789760678.750487:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354915895480 time 354916470466 state 0x2 ref 0 00000100:00100000:3.0:1789760678.765735:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760678.765861:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777155456 00000100:00100000:2.0:1789760678.765870:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777155456 00000100:00100000:2.0:1789760678.765921:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 354915895480 time 354916470466 state 0x0 ref 1 00000100:00100000:2.0:1789760678.765932:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355116470466 time 354916470466 state 0x1 ref 1 00000100:00100000:0.0:1789760678.932504:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355116470466 time 355116703926 state 0x0 ref 1 00000100:00100000:0.0:1789760678.932537:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777155456:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760678.932589:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.932606:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760678.932611:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760678.932616:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.932633:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.943719:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.943739:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.943748:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.943756:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760678.943760:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.943770:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.943802:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760678.943811:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a739857874 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760678.943909:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777155456:12345-192.168.203.38@tcp:3:dd.500 Request processed in 11383us (178178us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760678.943920:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:0.0:1789760678.943941:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355116470466 time 355116703926 state 0x2 ref 0 00000100:00100000:3.0:1789760678.952013:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760678.952126:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777155584 00000100:00100000:0.0:1789760678.952135:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777155584 00000100:00100000:0.0:1789760678.952188:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355116470466 time 355116703926 state 0x0 ref 1 00000100:00100000:0.0:1789760678.952201:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355316703926 time 355116703926 state 0x1 ref 1 00000100:00100000:3.0:1789760679.114600:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798183424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760679.114669:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760679.114782:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798183424 00000100:00100000:2.0:1789760679.114816:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798183424 00000100:00100000:2.0:1789760679.114867:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789760679.114877:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798183424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760679.114915:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760679.114970:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798183424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760679.114977:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789760679.115168:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798183424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760679.132629:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355316703926 time 355316829059 state 0x0 ref 1 00000100:00100000:0.0:1789760679.132680:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777155584:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760679.132722:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.132740:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760679.132745:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760679.132751:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.132769:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760679.133171:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760679.148655:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.148676:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.148685:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.148706:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760679.148712:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.148722:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.148741:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.148750:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a73985787b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760679.148883:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777155584:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16231us (196874us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760679.148894:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:0.0:1789760679.148902:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355316703926 time 355316829059 state 0x2 ref 0 00000100:00100000:2.0:1789760679.161778:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760679.165823:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777155712 00000100:00100000:1.0:1789760679.165837:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777155712 00000100:00100000:1.0:1789760679.165897:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355316703926 time 355316829059 state 0x0 ref 1 00000100:00100000:1.0:1789760679.165910:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355516829059 time 355316829059 state 0x1 ref 1 00000100:00100000:2.0:1789760679.332859:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355516829059 time 355517059093 state 0x0 ref 1 00000100:00100000:2.0:1789760679.332891:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777155712:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760679.332970:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.332989:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760679.332994:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760679.333000:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.333015:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.345038:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.345061:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.345071:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.345096:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760679.345102:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.345113:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.345348:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760679.345357:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a739857882 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760679.345450:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777155712:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12569us (183676us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760679.345461:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:0.0:1789760679.345469:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355516829059 time 355517059093 state 0x2 ref 0 00000100:00100000:3.0:1789760679.354424:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760679.354765:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777155840 00000100:00100000:2.0:1789760679.354776:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777155840 00000100:00100000:2.0:1789760679.354928:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355516829059 time 355517059093 state 0x0 ref 1 00000100:00100000:2.0:1789760679.355390:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355717059093 time 355517059093 state 0x1 ref 1 00010000:00010000:0.0:1789760679.431088:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760679.533032:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355717059093 time 355717226177 state 0x0 ref 1 00000100:00100000:3.0:1789760679.533082:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777155840:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760679.533150:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760679.533168:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760679.533172:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760679.533179:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760679.533196:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.558404:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.558423:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.558432:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.558440:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760679.558445:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.558468:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.558490:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.558497:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc38276/0xc2b9a3a739857889 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760679.558595:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777155840:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25532us (204177us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760679.558605:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:2.0:1789760679.558613:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355717059093 time 355717226177 state 0x2 ref 0 00000100:00100000:3.0:1789760679.572002:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760679.573508:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777155968 00000100:00100000:0.0:1789760679.573522:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777155968 00000100:00100000:0.0:1789760679.573599:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355717059093 time 355717226177 state 0x0 ref 1 00000100:00100000:0.0:1789760679.573611:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355917226177 time 355717226177 state 0x1 ref 1 00000100:00100000:1.0:1789760679.624918:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760679.628805:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798183552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760679.628882:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760679.635909:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798183552 00000100:00100000:2.0:1789760679.635925:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798183552 00000100:00100000:2.0:1789760679.635995:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789760679.636006:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798183552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760679.636430:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760679.636995:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798183552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 988us (8108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760679.637004:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789760679.644236:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798183552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760679.733201:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355917226177 time 355917401678 state 0x0 ref 1 00000100:00100000:2.0:1789760679.733244:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777155968:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760679.733417:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.733435:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760679.733440:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760679.733446:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760679.733459:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.780141:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.780164:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.780174:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.780204:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760679.780210:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.780399:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.780421:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.780429:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857890 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760679.780528:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777155968:12345-192.168.203.38@tcp:3:dd.500 Request processed in 47295us (208530us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760679.780538:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:1.0:1789760679.780547:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355917226177 time 355917401678 state 0x2 ref 0 00000100:00100000:2.0:1789760679.799494:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760679.799603:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777156096 00000100:00100000:0.0:1789760679.799625:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777156096 00000100:00100000:0.0:1789760679.799681:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 355917226177 time 355917401678 state 0x0 ref 1 00000100:00100000:0.0:1789760679.799694:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356117401678 time 355917401678 state 0x1 ref 1 00000100:00100000:1.0:1789760679.933500:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356117401678 time 356117701004 state 0x0 ref 1 00000100:00100000:1.0:1789760679.933533:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777156096:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760679.933586:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.933602:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760679.933620:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760679.933628:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.933645:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.960961:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.960981:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.960991:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.960998:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760679.961003:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.961012:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.961031:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760679.961039:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739857897 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760679.961127:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777156096:12345-192.168.203.38@tcp:3:dd.500 Request processed in 27605us (161639us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760679.961136:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:1.0:1789760679.961145:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356117401678 time 356117701004 state 0x2 ref 0 00000100:00100000:3.0:1789760679.969542:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760679.969652:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777156224 00000100:00100000:0.0:1789760679.969661:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777156224 00000100:00100000:0.0:1789760679.969714:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356117401678 time 356117701004 state 0x0 ref 1 00000100:00100000:0.0:1789760679.969727:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356317701004 time 356117701004 state 0x1 ref 1 00000100:00100000:3.0:1789760680.134623:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356317701004 time 356318821617 state 0x0 ref 1 00000100:00100000:3.0:1789760680.134660:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777156224:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760680.134740:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760680.134757:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760680.134761:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760680.134767:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760680.134781:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760680.135981:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760680.136000:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798183680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760680.136064:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760680.136129:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798183680 00000100:00100000:2.0:1789760680.136137:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798183680 00000100:00100000:2.0:1789760680.136185:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789760680.136193:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798183680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760680.136223:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789760680.136269:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798183680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760680.136276:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1789760680.136296:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760680.136330:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798183680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760680.136467:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760680.136476:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798183808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760680.136508:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760680.136539:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798183808 00000100:00100000:0.0:1789760680.136543:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798183808 00000100:00100000:0.0:1789760680.136587:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789760680.136593:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798183808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789760680.136603:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789760680.136634:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798183808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760680.136640:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1789760680.136656:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760680.136684:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798183808:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789760680.190499:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.190517:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.190547:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.190555:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760680.190571:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.190580:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.190600:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.190608:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985789e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760680.190715:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777156224:12345-192.168.203.38@tcp:3:dd.500 Request processed in 56068us (221761us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760680.190725:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:0.0:1789760680.190733:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356317701004 time 356318821617 state 0x2 ref 0 00000100:00100000:2.0:1789760680.201631:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760680.202445:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777156352 00000100:00100000:3.0:1789760680.202456:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777156352 00000100:00100000:3.0:1789760680.202512:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356317701004 time 356318821617 state 0x0 ref 1 00000100:00100000:3.0:1789760680.202525:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356518821617 time 356318821617 state 0x1 ref 1 00000100:00100000:1.0:1789760680.338100:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356518821617 time 356522299636 state 0x0 ref 1 00000100:00100000:1.0:1789760680.338137:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777156352:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760680.338180:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760680.338197:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760680.338202:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760680.338219:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760680.338236:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.348478:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.348499:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.348524:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.348532:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e558263a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760680.348536:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.348546:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.348584:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.348592:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060505e39/0xc2b9a3a7398578a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760680.348682:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777156352:12345-192.168.203.38@tcp:3:dd.500 Request processed in 10558us (147058us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760680.348693:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:0.0:1789760680.348702:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356518821617 time 356522299636 state 0x2 ref 0 00000100:00100000:2.0:1789760680.360688:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760680.360913:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777156480 00000100:00100000:1.0:1789760680.360925:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777156480 00000100:00100000:1.0:1789760680.360982:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356518821617 time 356522299636 state 0x0 ref 1 00000100:00100000:1.0:1789760680.360995:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356722299636 time 356522299636 state 0x1 ref 1 00010000:00010000:0.0:1789760680.455073:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760680.538780:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356722299636 time 356722978835 state 0x0 ref 1 00000100:00100000:0.0:1789760680.538846:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777156480:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760680.538908:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.538937:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760680.538941:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760680.538948:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.538961:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.559626:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.559655:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.559665:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.559672:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760680.559677:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.559685:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.559725:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.559744:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0b6608/0xc2b9a3a7398578ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760680.559957:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777156480:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21123us (199276us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760680.559968:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:0.0:1789760680.559976:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356722299636 time 356722978835 state 0x2 ref 0 00000100:00100000:1.0:1789760680.565354:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760680.565631:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777156608 00000100:00100000:2.0:1789760680.565641:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777156608 00000100:00100000:2.0:1789760680.565954:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356722299636 time 356722978835 state 0x0 ref 1 00000100:00100000:2.0:1789760680.565967:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356922978835 time 356722978835 state 0x1 ref 1 00000100:00100000:2.0:1789760680.738834:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356922978835 time 356923033881 state 0x0 ref 1 00000100:00100000:2.0:1789760680.738866:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777156608:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760680.738909:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.738926:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760680.738931:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760680.738937:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.738951:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.756751:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.756773:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.756782:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.756834:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760680.756839:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.756848:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.756868:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.756876:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760680.756961:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777156608:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18105us (191610us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760680.756972:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:2.0:1789760680.756980:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356922978835 time 356923033881 state 0x2 ref 0 00000100:00100000:3.0:1789760680.767900:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760680.767999:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777156736 00000100:00100000:0.0:1789760680.768009:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777156736 00000100:00100000:0.0:1789760680.768139:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 356922978835 time 356923033881 state 0x0 ref 1 00000100:00100000:0.0:1789760680.768152:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357123033881 time 356923033881 state 0x1 ref 1 00000100:00100000:0.0:1789760680.938958:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357123033881 time 357123156730 state 0x0 ref 1 00000100:00100000:0.0:1789760680.938992:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777156736:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760680.939179:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.939196:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760680.939200:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760680.939334:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760680.939364:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.977082:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.977103:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.977122:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.977146:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadde00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760680.977151:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.977159:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.977177:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760680.977185:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a7398578ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760680.977441:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777156736:12345-192.168.203.38@tcp:3:dd.500 Request processed in 38292us (209377us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760680.977451:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:2.0:1789760680.977460:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357123033881 time 357123156730 state 0x2 ref 0 00000100:00100000:3.0:1789760680.984331:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760680.984407:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777156864 00000100:00100000:0.0:1789760680.984418:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777156864 00000100:00100000:0.0:1789760680.984480:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357123033881 time 357123156730 state 0x0 ref 1 00000100:00100000:0.0:1789760680.984493:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357323156730 time 357123156730 state 0x1 ref 1 00000100:00100000:0.0:1789760681.139388:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357323156730 time 357323590346 state 0x0 ref 1 00000100:00100000:0.0:1789760681.139445:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777156864:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760681.139498:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.139516:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760681.139521:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760681.139526:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.139541:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760681.141640:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760681.177336:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.177373:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.177381:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.177387:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadd600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760681.177392:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.177401:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.177422:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.177430:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.177516:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777156864:12345-192.168.203.38@tcp:3:dd.500 Request processed in 38106us (193189us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760681.177527:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:0.0:1789760681.177534:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357323156730 time 357323590346 state 0x2 ref 0 00000100:00100000:3.0:1789760681.183908:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760681.184024:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777156992 00000100:00100000:0.0:1789760681.184047:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777156992 00000100:00100000:0.0:1789760681.184098:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357323156730 time 357323590346 state 0x0 ref 1 00000100:00100000:0.0:1789760681.184110:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357523590346 time 357323590346 state 0x1 ref 1 00000100:00100000:2.0:1789760681.339577:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357523590346 time 357523776283 state 0x0 ref 1 00000100:00100000:2.0:1789760681.339623:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777156992:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760681.339667:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.339704:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760681.339708:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760681.339715:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.339730:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.358372:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.358392:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.358401:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.358408:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760681.358413:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.358421:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.358440:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.358467:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760681.359873:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777156992:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20268us (175965us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760681.359885:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:2.0:1789760681.359894:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357523590346 time 357523776283 state 0x2 ref 0 00000100:00100000:1.0:1789760681.366971:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760681.368759:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777157120 00000100:00100000:2.0:1789760681.368772:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777157120 00000100:00100000:2.0:1789760681.368849:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357523590346 time 357523776283 state 0x0 ref 1 00000100:00100000:2.0:1789760681.368862:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357723776283 time 357523776283 state 0x1 ref 1 00010000:00010000:0.0:1789760681.479108:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760681.521236:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760681.521286:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760681.521322:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760681.521355:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760681.521383:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777157376 00000100:00100000:3.0:1789760681.521393:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777157376 00000100:00100000:3.0:1789760681.521449:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777157632 00000100:00100000:3.0:1789760681.521453:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777157632 00000100:00100000:3.0:1789760681.521472:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777157504 00000100:00100000:3.0:1789760681.521487:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777157504 00000100:00100000:3.0:1789760681.521509:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 299 00000100:00100000:3.0:1789760681.521519:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777157376:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760681.521611:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777157376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 93us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760681.521618:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 299 00000100:00100000:3.0:1789760681.521637:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00100000:3.0:1789760681.521644:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777157632:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760681.521670:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777157632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760681.521676:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00100000:3.0:1789760681.521688:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 301 00000100:00100000:3.0:1789760681.521694:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777157504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760681.521717:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777157504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760681.521723:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 301 00000100:00080000:3.0:1789760681.521749:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760681.521753:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760681.521780:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760681.521924:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777157760 00000100:00100000:3.0:1789760681.521928:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777157760 00000100:00100000:3.0:1789760681.521959:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 302 00000100:00100000:3.0:1789760681.521966:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777157760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760681.521996:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777157760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760681.522015:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 302 00000100:00080000:3.0:1789760681.522032:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760681.522272:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777157248 00000100:00100000:0.0:1789760681.522278:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777157248 00000100:00100000:0.0:1789760681.522317:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 354 00000100:00100000:0.0:1789760681.522325:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777157248:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760681.522372:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777157248:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760681.522378:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 354 00000100:00100000:3.0:1789760681.539848:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357723776283 time 357724047894 state 0x0 ref 1 00000100:00100000:3.0:1789760681.539881:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777157120:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760681.539921:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.539938:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760681.539942:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760681.539948:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.539962:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.566491:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.566512:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.566521:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.566529:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e558263400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760681.566534:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.566569:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.566589:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.566597:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ea6d33c/0xc2b9a3a7398578cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760681.566686:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777157120:12345-192.168.203.38@tcp:3:dd.500 Request processed in 26816us (199721us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760681.566696:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:2.0:1789760681.566705:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357723776283 time 357724047894 state 0x2 ref 0 00000100:00100000:1.0:1789760681.576373:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760681.576456:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777157888 00000100:00100000:2.0:1789760681.576465:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777157888 00000100:00100000:2.0:1789760681.576516:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357723776283 time 357724047894 state 0x0 ref 1 00000100:00100000:2.0:1789760681.576528:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357924047894 time 357724047894 state 0x1 ref 1 00000100:00100000:1.0:1789760681.740316:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357924047894 time 357924516270 state 0x0 ref 1 00000100:00100000:1.0:1789760681.740352:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777157888:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760681.740397:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.740414:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760681.740419:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760681.740425:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.740440:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.771138:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.771157:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.771166:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.771174:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5821c4000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760681.771178:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.771214:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.771236:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760681.771244:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069991bdc/0xc2b9a3a7398578d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760681.771333:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777157888:12345-192.168.203.38@tcp:3:dd.500 Request processed in 30994us (194965us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760681.771344:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:1.0:1789760681.771352:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357924047894 time 357924516270 state 0x2 ref 0 00000100:00100000:0.0:1789760681.786196:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760681.786453:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777158016 00000100:00100000:1.0:1789760681.786463:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777158016 00000100:00100000:1.0:1789760681.786515:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 357924047894 time 357924516270 state 0x0 ref 1 00000100:00100000:1.0:1789760681.786527:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358124516270 time 357924516270 state 0x1 ref 1 00000100:00100000:2.0:1789760681.944102:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358124516270 time 358128301710 state 0x0 ref 1 00000100:00100000:2.0:1789760681.944138:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777158016:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760681.944185:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.944231:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760681.944235:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760681.944242:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.944259:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.021489:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.021509:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.021517:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.021525:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760682.021554:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.021565:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.021585:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.021592:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a7398578dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760682.021672:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777158016:12345-192.168.203.38@tcp:3:dd.500 Request processed in 77548us (235483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760682.021682:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:3.0:1789760682.021691:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358124516270 time 358128301710 state 0x2 ref 0 00000100:00100000:0.0:1789760682.032382:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760682.032483:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777158144 00000100:00100000:2.0:1789760682.032494:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777158144 00000100:00100000:2.0:1789760682.032557:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358124516270 time 358128301710 state 0x0 ref 1 00000100:00100000:2.0:1789760682.032571:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358328301710 time 358128301710 state 0x1 ref 1 00000100:00100000:0.0:1789760682.144264:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358328301710 time 358328463691 state 0x0 ref 1 00000100:00100000:0.0:1789760682.144301:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777158144:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760682.144346:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.144364:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.144368:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.144374:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.144387:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.163694:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.163714:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.163723:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.163730:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadd600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760682.163749:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.163758:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.163779:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.163824:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760682.163935:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777158144:12345-192.168.203.38@tcp:3:dd.500 Request processed in 19647us (131559us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760682.163945:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:3.0:1789760682.163953:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358328301710 time 358328463691 state 0x2 ref 0 00000100:00100000:0.0:1789760682.175525:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760682.175694:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777158272 00000100:00100000:2.0:1789760682.175704:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777158272 00000100:00100000:2.0:1789760682.175759:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358328301710 time 358328463691 state 0x0 ref 1 00000100:00100000:2.0:1789760682.175773:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358528463691 time 358328463691 state 0x1 ref 1 00000100:00100000:0.0:1789760682.345187:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358528463691 time 358529379312 state 0x0 ref 1 00000100:00100000:0.0:1789760682.345225:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777158272:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760682.345276:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.345293:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.345297:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.345302:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.345316:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.372625:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.372648:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.372657:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.372685:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadc800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760682.372691:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.372700:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.372721:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.372730:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760682.372893:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777158272:12345-192.168.203.38@tcp:3:dd.500 Request processed in 27676us (197370us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760682.372903:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:2.0:1789760682.372913:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358528463691 time 358529379312 state 0x2 ref 0 00000100:00100000:0.0:1789760682.384572:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760682.384740:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777158400 00000100:00100000:1.0:1789760682.384749:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777158400 00000100:00100000:1.0:1789760682.384877:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358528463691 time 358529379312 state 0x0 ref 1 00000100:00100000:1.0:1789760682.384889:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358729379312 time 358529379312 state 0x1 ref 1 00010000:00010000:0.0:1789760682.503226:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760682.546556:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358729379312 time 358730742616 state 0x0 ref 1 00000100:00100000:0.0:1789760682.546590:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777158400:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760682.546632:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.546649:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.546653:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.546675:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.546690:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.564156:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.564176:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.564183:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.564205:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadc800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760682.564210:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.564220:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.564242:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.564250:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001383ec03/0xc2b9a3a7398578f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760682.564350:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777158400:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17773us (179785us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760682.564360:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 207 00000100:00100000:2.0:1789760682.564368:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358729379312 time 358730742616 state 0x2 ref 0 00000100:00100000:3.0:1789760682.571691:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760682.572747:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777158528 00000100:00100000:2.0:1789760682.572758:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777158528 00000100:00100000:2.0:1789760682.572843:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358729379312 time 358730742616 state 0x0 ref 1 00000100:00100000:2.0:1789760682.572858:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358930742616 time 358730742616 state 0x1 ref 1 00000100:00100000:0.0:1789760682.746675:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358930742616 time 358930873917 state 0x0 ref 1 00000100:00100000:0.0:1789760682.746709:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777158528:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760682.746757:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.746775:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.746779:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.746816:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.746832:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.771464:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.771487:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.771497:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.771519:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadd600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760682.771524:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.771533:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.771566:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.771574:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a7398578f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760682.771666:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777158528:12345-192.168.203.38@tcp:3:dd.500 Request processed in 24967us (199979us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760682.771678:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:0.0:1789760682.771687:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358930742616 time 358930873917 state 0x2 ref 0 00000100:00100000:1.0:1789760682.779340:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760682.782744:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777158656 00000100:00100000:3.0:1789760682.782760:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777158656 00000100:00100000:2.0:1789760682.782919:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 358930742616 time 358930873917 state 0x0 ref 1 00000100:00100000:2.0:1789760682.782934:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359130873917 time 358930873917 state 0x1 ref 1 00000100:00100000:1.0:1789760682.947233:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359130873917 time 359131431146 state 0x0 ref 1 00000100:00100000:1.0:1789760682.947288:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777158656:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760682.947350:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.947368:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760682.947373:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760682.947380:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.947398:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.968681:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.968703:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.968712:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.968720:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fa00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760682.968725:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.968734:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.968754:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.968762:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739857900 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760682.968906:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777158656:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21630us (189570us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760682.968917:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:2.0:1789760682.968926:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359130873917 time 359131431146 state 0x2 ref 0 00000100:00100000:3.0:1789760682.975627:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760682.975722:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777158784 00000100:00100000:2.0:1789760682.975732:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777158784 00000100:00100000:2.0:1789760682.975805:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359130873917 time 359131431146 state 0x0 ref 1 00000100:00100000:2.0:1789760682.975817:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359331431146 time 359131431146 state 0x1 ref 1 00000100:00100000:0.0:1789760683.148090:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359331431146 time 359332291077 state 0x0 ref 1 00000100:00100000:0.0:1789760683.148144:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777158784:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760683.148200:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760683.148218:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760683.148235:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760683.148242:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760683.148256:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760683.150259:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760683.161512:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.161531:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.161552:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.161559:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadd600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760683.161565:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.161573:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.161620:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.161634:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94fe751/0xc2b9a3a739857907 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760683.161735:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777158784:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13617us (186108us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760683.161744:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:1.0:1789760683.161753:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359331431146 time 359332291077 state 0x2 ref 0 00000100:00100000:3.0:1789760683.171970:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760683.172594:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777158912 00000100:00100000:2.0:1789760683.172604:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777158912 00000100:00100000:2.0:1789760683.172669:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359331431146 time 359332291077 state 0x0 ref 1 00000100:00100000:2.0:1789760683.172681:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359532291077 time 359332291077 state 0x1 ref 1 00000100:00100000:1.0:1789760683.349771:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359532291077 time 359533968323 state 0x0 ref 1 00000100:00100000:1.0:1789760683.349855:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777158912:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760683.349900:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.349917:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760683.349922:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760683.349928:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.349942:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.367278:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.367298:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.367307:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.367314:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e44c686e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760683.367318:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.367327:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.367348:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.367355:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098700ed2/0xc2b9a3a73985790e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760683.367444:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777158912:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17651us (195481us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760683.367454:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:1.0:1789760683.367478:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359532291077 time 359533968323 state 0x2 ref 0 00000100:00100000:0.0:1789760683.377880:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760683.377945:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777159040 00000100:00100000:2.0:1789760683.377956:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777159040 00000100:00100000:2.0:1789760683.378011:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359532291077 time 359533968323 state 0x0 ref 1 00000100:00100000:2.0:1789760683.378024:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359733968323 time 359533968323 state 0x1 ref 1 00010000:00010000:0.0:1789760683.527693:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760683.550032:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359733968323 time 359734231709 state 0x0 ref 1 00000100:00100000:3.0:1789760683.550066:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777159040:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760683.550195:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.550228:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760683.550233:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760683.550244:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.550387:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.569879:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.569900:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.569909:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.569916:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e550f0ee00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760683.569921:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.569930:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.569949:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.569978:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857915 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760683.570065:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777159040:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20012us (192191us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760683.570075:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:3.0:1789760683.570095:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359733968323 time 359734231709 state 0x2 ref 0 00000100:00100000:0.0:1789760683.580897:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760683.581344:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777159168 00000100:00100000:2.0:1789760683.581355:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777159168 00000100:00100000:2.0:1789760683.581408:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359733968323 time 359734231709 state 0x0 ref 1 00000100:00100000:2.0:1789760683.581421:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359934231709 time 359734231709 state 0x1 ref 1 00000100:00100000:0.0:1789760683.719592:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760683.719613:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798183936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760683.719685:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760683.719755:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798183936 00000100:00100000:0.0:1789760683.719762:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798183936 00000100:00100000:0.0:1789760683.719838:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789760683.719848:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798183936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760683.719887:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760683.719930:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798183936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760683.719936:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789760683.719955:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760683.720009:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798183936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760683.720370:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760683.720382:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798184064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760683.720414:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760683.720487:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798184064 00000100:00100000:1.0:1789760683.720492:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798184064 00000100:00100000:1.0:1789760683.720529:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789760683.720546:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798184064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760683.720557:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760683.720592:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798184064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760683.720598:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789760683.720630:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798184064:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789760683.720774:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760683.721394:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798184576:0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721434:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760683.721457:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798185088:0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721480:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760683.721501:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789760683.721507:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798184448:0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721542:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760683.721559:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798184960:0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721581:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760683.721598:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798185472:0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721619:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760683.721645:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798184576 00000100:00100000:3.0:1789760683.721662:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798184576 00000100:00100000:3.0:1789760683.721692:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798184960 00000100:00100000:3.0:1789760683.721695:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798184960 00000100:00100000:3.0:1789760683.721718:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798185472 00000100:00100000:3.0:1789760683.721720:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798185472 00000100:00100000:3.0:1789760683.721735:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789760683.721741:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798184576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721783:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798184576:12345-0@lo:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760683.721807:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789760683.721821:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789760683.721826:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798184960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721855:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798184960:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760683.721861:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789760683.721870:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789760683.721875:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798185472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721900:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798185472:12345-0@lo:400:kworker.0 Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760683.721906:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:3.0:1789760683.721926:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760683.721949:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798184960:0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721958:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798185472:0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.721966:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798184576:0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.722344:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798184192:0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.722387:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760683.722414:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798184704:0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.722449:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760683.722470:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798185216:0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.722493:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760683.722515:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789760683.722521:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f88df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798184320:0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.722557:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760683.722575:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798184832:0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.722594:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760683.722610:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798185344:0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.722630:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760683.722654:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798184448 00000100:00100000:0.0:1789760683.722659:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798184448 00000100:00100000:0.0:1789760683.722687:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798184704 00000100:00100000:0.0:1789760683.722690:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798184704 00000100:00100000:0.0:1789760683.722705:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789760683.722711:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798184448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.722746:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798184448:12345-0@lo:400:kworker.0 Request processed in 36us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760683.722753:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789760683.722765:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789760683.722771:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798184704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760683.723163:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798185088 00000100:00100000:2.0:1789760683.723168:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798185088 00000100:00100000:2.0:1789760683.723280:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798185216 00000100:00100000:2.0:1789760683.723284:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798185216 00000100:00100000:2.0:1789760683.723308:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789760683.723315:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798185088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760683.723354:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798185088:12345-0@lo:400:kworker.0 Request processed in 39us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.723369:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789760683.723383:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789760683.723389:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798185216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760683.723425:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798185216:12345-0@lo:400:kworker.0 Request processed in 36us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.723431:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789760683.723449:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798184192 00000100:00100000:2.0:1789760683.723453:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798184192 00000100:00100000:2.0:1789760683.723475:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789760683.723481:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798184192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760683.723511:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798184192:12345-0@lo:400:kworker.0 Request processed in 29us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.723517:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789760683.723561:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798184320 00000100:00100000:2.0:1789760683.723564:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798184320 00000100:00100000:2.0:1789760683.723581:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798184832 00000100:00100000:2.0:1789760683.723583:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798184832 00000100:00100000:2.0:1789760683.723594:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798185344 00000100:00100000:2.0:1789760683.723597:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798185344 00000100:00100000:2.0:1789760683.723612:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789760683.723618:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798184320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760683.723647:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798184320:12345-0@lo:400:kworker.0 Request processed in 29us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.723653:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789760683.723663:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789760683.723669:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798184832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760683.723707:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798184832:12345-0@lo:400:kworker.0 Request processed in 38us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.723713:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789760683.723725:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789760683.723731:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798185344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760683.723759:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798185344:12345-0@lo:400:kworker.0 Request processed in 28us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.723764:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789760683.724304:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f88df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798184320:0@lo:400:kworker.0 00000100:00100000:1.0:1789760683.724318:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798184832:0@lo:400:kworker.0 00000100:00100000:1.0:1789760683.724328:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798185344:0@lo:400:kworker.0 00000100:00100000:1.0:1789760683.724337:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798184192:0@lo:400:kworker.0 00000100:00100000:1.0:1789760683.724348:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798185216:0@lo:400:kworker.0 00000100:00100000:0.0:1789760683.726434:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798184704:12345-0@lo:400:kworker.0 Request processed in 3654us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760683.726447:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789760683.729002:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798184704:0@lo:400:kworker.0 00000100:00080000:1.0:1789760683.729086:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760683.729091:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760683.730021:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798184448:0@lo:400:kworker.0 00000100:00100000:3.0:1789760683.730061:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798185088:0@lo:400:kworker.0 00000100:00100000:1.0:1789760683.750253:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359934231709 time 359934454023 state 0x0 ref 1 00000100:00100000:1.0:1789760683.750289:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777159168:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760683.750333:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.750369:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760683.750374:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760683.750381:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.750395:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.771113:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.771133:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.771143:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.771150:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c7a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760683.771156:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.771176:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.771208:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.771236:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a73985791c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760683.771324:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777159168:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21047us (190431us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760683.771335:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:2.0:1789760683.771343:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359934231709 time 359934454023 state 0x2 ref 0 00000100:00100000:0.0:1789760683.782090:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760683.782373:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777159296 00000100:00100000:1.0:1789760683.782384:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777159296 00000100:00100000:1.0:1789760683.782438:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 359934231709 time 359934454023 state 0x0 ref 1 00000100:00100000:1.0:1789760683.782450:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360134454023 time 359934454023 state 0x1 ref 1 00000100:00100000:3.0:1789760683.950497:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360134454023 time 360134700149 state 0x0 ref 1 00000100:00100000:3.0:1789760683.950523:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777159296:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760683.950734:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.950751:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760683.950756:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760683.950761:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.950778:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.960511:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.960546:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.960556:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.960563:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e550f0ee00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760683.960568:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.960595:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.960615:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.960623:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338c60b5/0xc2b9a3a739857923 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760683.961498:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777159296:12345-192.168.203.38@tcp:3:dd.500 Request processed in 10979us (179409us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760683.961510:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:3.0:1789760683.961517:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360134454023 time 360134700149 state 0x2 ref 0 00000100:00100000:2.0:1789760683.969642:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760683.970565:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777159424 00000100:00100000:1.0:1789760683.970577:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777159424 00000100:00100000:1.0:1789760683.970631:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360134454023 time 360134700149 state 0x0 ref 1 00000100:00100000:1.0:1789760683.970643:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360334700149 time 360134700149 state 0x1 ref 1 00000100:00100000:0.0:1789760684.153075:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360334700149 time 360337274720 state 0x0 ref 1 00000100:00100000:0.0:1789760684.153122:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777159424:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760684.153163:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760684.153180:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760684.153391:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760684.153399:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760684.153415:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.171614:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.171634:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.171643:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.171650:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadde00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760684.171655:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.171663:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.171683:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.171703:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cedc0082/0xc2b9a3a73985792a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760684.171833:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777159424:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18677us (202153us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760684.171843:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 215 00000100:00100000:2.0:1789760684.171851:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360334700149 time 360337274720 state 0x2 ref 0 00000100:00100000:0.0:1789760684.178275:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760684.178492:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777159552 00000100:00100000:3.0:1789760684.178502:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777159552 00000100:00100000:3.0:1789760684.178567:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360334700149 time 360337274720 state 0x0 ref 1 00000100:00100000:3.0:1789760684.178580:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360537274720 time 360337274720 state 0x1 ref 1 00000100:00100000:3.0:1789760684.231460:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798185600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760684.231549:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760684.231621:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798185600 00000100:00100000:1.0:1789760684.231707:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798185600 00000100:00100000:1.0:1789760684.231873:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789760684.231883:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798185600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760684.231929:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760684.232029:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798185600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760684.232038:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789760684.232149:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798185600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760684.353213:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360537274720 time 360537413229 state 0x0 ref 1 00000100:00100000:0.0:1789760684.353249:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777159552:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760684.353292:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760684.353311:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760684.353315:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760684.353321:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760684.353335:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.378650:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.378669:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.378679:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.378688:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fadc200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760684.378693:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.378702:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.378722:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.378743:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f8c1907/0xc2b9a3a739857931 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760684.378868:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777159552:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25633us (200599us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760684.378878:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:2.0:1789760684.378886:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360537274720 time 360537413229 state 0x2 ref 0 00000100:00100000:3.0:1789760684.385998:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760684.386089:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777159680 00000100:00100000:2.0:1789760684.386100:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777159680 00000100:00100000:2.0:1789760684.386208:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360537274720 time 360537413229 state 0x0 ref 1 00000100:00100000:2.0:1789760684.386221:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360737413229 time 360537413229 state 0x1 ref 1 00010000:00010000:0.0:1789760684.551466:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760684.553340:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360737413229 time 360737541934 state 0x0 ref 1 00000100:00100000:2.0:1789760684.553373:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777159680:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760684.553414:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.553430:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760684.553433:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760684.553439:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.553452:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.570812:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.570831:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.570840:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.570847:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f8f8e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760684.570852:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.570861:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.570879:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.570887:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857938 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760684.571014:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777159680:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17652us (185024us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760684.571024:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 217 00000100:00100000:2.0:1789760684.571044:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360737413229 time 360737541934 state 0x2 ref 0 00000100:00100000:3.0:1789760684.597886:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760684.598497:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777159808 00000100:00100000:2.0:1789760684.598780:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777159808 00000100:00100000:2.0:1789760684.598859:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360737413229 time 360737541934 state 0x0 ref 1 00000100:00100000:2.0:1789760684.598871:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360937541934 time 360737541934 state 0x1 ref 1 00000100:00100000:1.0:1789760684.744165:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798185728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760684.744231:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760684.744386:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798185728 00000100:00100000:0.0:1789760684.744395:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798185728 00000100:00100000:0.0:1789760684.744445:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789760684.744454:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798185728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760684.744495:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760684.744954:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798185728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 500us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760684.744962:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789760684.745053:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798185728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760684.753504:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360937541934 time 360937704855 state 0x0 ref 1 00000100:00100000:2.0:1789760684.753550:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777159808:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760684.753592:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.753621:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760684.753625:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760684.753631:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.753644:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.769572:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.769592:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.769600:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.769621:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f8f8e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760684.769626:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.769634:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.769654:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.769661:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a73985793f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760684.769761:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777159808:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16237us (171880us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760684.769771:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:2.0:1789760684.769779:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360937541934 time 360937704855 state 0x2 ref 0 00000100:00100000:3.0:1789760684.782638:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760684.784363:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777159936 00000100:00100000:2.0:1789760684.784376:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777159936 00000100:00100000:2.0:1789760684.784433:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 360937541934 time 360937704855 state 0x0 ref 1 00000100:00100000:2.0:1789760684.784447:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361137704855 time 360937704855 state 0x1 ref 1 00000100:00100000:2.0:1789760684.954393:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361137704855 time 361138592521 state 0x0 ref 1 00000100:00100000:2.0:1789760684.954424:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777159936:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760684.954488:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.954515:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760684.954520:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760684.954534:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.954550:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.972287:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.972308:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.972317:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.972325:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f8f8e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760684.972329:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.972338:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.972377:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760684.972391:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f980adcf/0xc2b9a3a739857946 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760684.972542:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777159936:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18126us (189908us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760684.972553:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:2.0:1789760684.972568:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361137704855 time 361138592521 state 0x2 ref 0 00000100:00100000:3.0:1789760684.987491:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760684.987591:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777160064 00000100:00100000:2.0:1789760684.987603:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777160064 00000100:00100000:2.0:1789760684.987659:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361137704855 time 361138592521 state 0x0 ref 1 00000100:00100000:2.0:1789760684.987673:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361338592521 time 361138592521 state 0x1 ref 1 00000100:00100000:1.0:1789760685.154581:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361338592521 time 361338779576 state 0x0 ref 1 00000100:00100000:1.0:1789760685.154642:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777160064:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760685.154685:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.154704:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.154709:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00000100:00080000:3.0:1789760685.154715:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760685.154717:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.154735:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.165039:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.165058:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.165068:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.165077:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542e14600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760685.165094:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.165104:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.165123:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.165130:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a73985794d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760685.165346:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777160064:12345-192.168.203.38@tcp:3:dd.500 Request processed in 10743us (177861us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760685.165357:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:1.0:1789760685.165365:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361338592521 time 361338779576 state 0x2 ref 0 00000100:00100000:3.0:1789760685.178192:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760685.178498:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777160192 00000100:00100000:2.0:1789760685.178508:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777160192 00000100:00100000:2.0:1789760685.178577:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361338592521 time 361338779576 state 0x0 ref 1 00000100:00100000:2.0:1789760685.178589:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361538779576 time 361338779576 state 0x1 ref 1 00000100:00100000:1.0:1789760685.255225:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760685.255247:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798185856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760685.255311:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760685.255550:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798185856 00000100:00100000:0.0:1789760685.255559:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798185856 00000100:00100000:0.0:1789760685.255629:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789760685.255638:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798185856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789760685.255677:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789760685.255726:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798185856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760685.255733:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789760685.255777:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798185856:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789760685.255937:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760685.256497:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760685.256511:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798185984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760685.256565:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760685.256803:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798185984 00000100:00100000:2.0:1789760685.256810:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798185984 00000100:00100000:2.0:1789760685.256904:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789760685.256912:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798185984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760685.256926:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789760685.256985:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798185984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760685.256992:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789760685.258210:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798185984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789760685.260417:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760685.358075:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361538779576 time 361542275723 state 0x0 ref 1 00000100:00100000:1.0:1789760685.358110:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777160192:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760685.358148:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.358165:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.358315:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.358322:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.358336:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.381876:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.381897:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.381905:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.381912:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542e14600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760685.381917:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.381925:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.381943:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.381951:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857954 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760685.382064:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777160192:12345-192.168.203.38@tcp:3:dd.500 Request processed in 23966us (203884us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760685.382074:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:1.0:1789760685.382081:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361538779576 time 361542275723 state 0x2 ref 0 00000100:00100000:3.0:1789760685.399366:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760685.399575:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777160320 00000100:00100000:2.0:1789760685.399585:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777160320 00000100:00100000:2.0:1789760685.399637:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361538779576 time 361542275723 state 0x0 ref 1 00000100:00100000:2.0:1789760685.399650:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361742275723 time 361542275723 state 0x1 ref 1 00000100:00100000:3.0:1789760685.558709:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361742275723 time 361742908556 state 0x0 ref 1 00000100:00100000:3.0:1789760685.558743:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777160320:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760685.558831:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.559086:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760685.559091:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760685.559097:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.559112:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.574004:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.574033:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.574043:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.574081:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e58217e800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760685.574087:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.574104:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.574128:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.574135:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a73985795b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760685.574241:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777160320:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15506us (174876us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760685.574253:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:3.0:1789760685.574263:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361742275723 time 361742908556 state 0x2 ref 0 00010000:00010000:0.0:1789760685.575213:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760685.587571:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760685.587652:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777160448 00000100:00100000:2.0:1789760685.587662:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777160448 00000100:00100000:2.0:1789760685.587708:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361742275723 time 361742908556 state 0x0 ref 1 00000100:00100000:2.0:1789760685.587719:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361942908556 time 361742908556 state 0x1 ref 1 00000100:00100000:1.0:1789760685.759932:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361942908556 time 361944127478 state 0x0 ref 1 00000100:00100000:1.0:1789760685.759992:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777160448:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760685.760062:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.760083:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.760097:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.760105:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.760122:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.792096:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.792116:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.792147:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.792154:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542e14600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760685.792159:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.792168:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.792187:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.792195:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c13ad193/0xc2b9a3a739857962 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760685.792295:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777160448:12345-192.168.203.38@tcp:3:dd.500 Request processed in 32326us (204729us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760685.792305:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 223 00000100:00100000:1.0:1789760685.792314:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361942908556 time 361944127478 state 0x2 ref 0 00000100:00100000:3.0:1789760685.801660:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760685.801874:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777160576 00000100:00100000:1.0:1789760685.801884:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777160576 00000100:00100000:1.0:1789760685.801936:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 361942908556 time 361944127478 state 0x0 ref 1 00000100:00100000:1.0:1789760685.801949:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362144127478 time 361944127478 state 0x1 ref 1 00000100:00100000:3.0:1789760685.960104:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362144127478 time 362144304078 state 0x0 ref 1 00000100:00100000:3.0:1789760685.960138:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777160576:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760685.960252:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.960289:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760685.960294:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760685.960301:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.960364:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.980115:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.980133:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.980141:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.980148:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e58217e800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760685.980153:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.980162:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.980205:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.980212:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009be4a7f/0xc2b9a3a739857969 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760685.980287:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777160576:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20161us (178632us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760685.980297:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 224 00000100:00100000:2.0:1789760685.980305:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362144127478 time 362144304078 state 0x2 ref 0 00000100:00100000:3.0:1789760685.986296:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760685.987039:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777160704 00000100:00100000:1.0:1789760685.987050:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777160704 00000100:00100000:1.0:1789760685.987109:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362144127478 time 362144304078 state 0x0 ref 1 00000100:00100000:1.0:1789760685.987123:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362344304078 time 362144304078 state 0x1 ref 1 00000100:00100000:0.0:1789760686.160307:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362344304078 time 362344506675 state 0x0 ref 1 00000100:00100000:0.0:1789760686.160354:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777160704:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760686.160395:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.160411:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760686.160415:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760686.160421:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.160434:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.182350:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.182370:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.182379:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.182386:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760686.182391:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.182401:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.182437:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.182445:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857970 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760686.182538:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777160704:12345-192.168.203.38@tcp:3:dd.500 Request processed in 22193us (196246us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760686.182549:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 225 00000100:00100000:0.0:1789760686.182557:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362344304078 time 362344506675 state 0x2 ref 0 00000100:00100000:3.0:1789760686.189530:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760686.189628:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777160832 00000100:00100000:2.0:1789760686.189638:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777160832 00000100:00100000:2.0:1789760686.189691:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362344304078 time 362344506675 state 0x0 ref 1 00000100:00100000:2.0:1789760686.189703:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362544506675 time 362344506675 state 0x1 ref 1 00000100:00100000:0.0:1789760686.363156:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362544506675 time 362547355861 state 0x0 ref 1 00000100:00100000:0.0:1789760686.363196:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777160832:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760686.363242:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.363260:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760686.363264:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760686.363270:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.363284:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.396750:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.396769:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.396778:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.396814:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760686.396820:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.396829:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.396849:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.396857:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857977 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760686.396960:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777160832:12345-192.168.203.38@tcp:3:dd.500 Request processed in 33774us (207444us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760686.396970:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 226 00000100:00100000:0.0:1789760686.396992:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362544506675 time 362547355861 state 0x2 ref 0 00000100:00100000:3.0:1789760686.409025:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760686.409093:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777160960 00000100:00100000:1.0:1789760686.409104:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777160960 00000100:00100000:1.0:1789760686.409155:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362544506675 time 362547355861 state 0x0 ref 1 00000100:00100000:1.0:1789760686.409167:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362747355861 time 362547355861 state 0x1 ref 1 00000100:00100000:2.0:1789760686.565075:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362747355861 time 362749274395 state 0x0 ref 1 00000100:00100000:2.0:1789760686.565108:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777160960:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760686.565149:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.565177:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760686.565181:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760686.565187:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.565224:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.592474:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.592495:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.592503:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.592521:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760686.592526:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.592535:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.592554:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.592562:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a73985797e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760686.592676:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777160960:12345-192.168.203.38@tcp:3:dd.500 Request processed in 27579us (183655us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760686.592687:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 227 00000100:00100000:0.0:1789760686.592712:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362747355861 time 362749274395 state 0x2 ref 0 00010000:00010000:0.0:1789760686.599375:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760686.606987:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760686.607135:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777161088 00000100:00100000:2.0:1789760686.607145:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777161088 00000100:00100000:2.0:1789760686.607212:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362747355861 time 362749274395 state 0x0 ref 1 00000100:00100000:2.0:1789760686.607226:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362949274395 time 362749274395 state 0x1 ref 1 00000100:00100000:3.0:1789760686.636651:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760686.637242:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760686.637321:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777161216 00000100:00100000:0.0:1789760686.637332:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777161472 00000100:00100000:2.0:1789760686.637336:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777161216 00000100:00100000:0.0:1789760686.637350:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777161472 00000100:00100000:2.0:1789760686.637432:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 356 00000100:00100000:0.0:1789760686.637452:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 309 00000100:00100000:2.0:1789760686.637452:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777161216:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760686.637473:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777161472:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:3.0:1789760686.637502:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760686.637828:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777161216:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 298us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760686.637841:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 356 00000100:00100000:0.0:1789760686.638544:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777161472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1071us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760686.638555:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 309 00000100:00100000:1.0:1789760686.641270:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760686.641310:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760686.641342:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760686.641375:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777161728 00000100:00100000:1.0:1789760686.641383:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777161728 00000100:00100000:1.0:1789760686.641439:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777161344 00000100:00100000:1.0:1789760686.641443:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777161344 00000100:00100000:1.0:1789760686.641463:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777161600 00000100:00100000:1.0:1789760686.641466:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777161600 00000100:00100000:1.0:1789760686.641482:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:1.0:1789760686.641490:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777161728:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760686.641565:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777161728:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760686.641573:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:1.0:1789760686.641589:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 311 00000100:00100000:1.0:1789760686.641595:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777161344:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760686.641631:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777161344:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760686.641636:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 311 00000100:00080000:2.0:1789760686.642038:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760686.642043:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760686.644008:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 312 00000100:00100000:0.0:1789760686.644032:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777161600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760686.644103:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777161600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (2759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760686.644110:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 312 00000100:00100000:2.0:1789760686.765178:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362949274395 time 362949377766 state 0x0 ref 1 00000100:00100000:2.0:1789760686.765210:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777161088:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760686.765251:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.765270:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760686.765275:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760686.765295:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.765311:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.783934:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.783955:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.783964:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.783972:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760686.783977:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.784003:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.784023:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.784031:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857985 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760686.784127:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777161088:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18927us (177144us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760686.784137:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:0.0:1789760686.784147:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362949274395 time 362949377766 state 0x2 ref 0 00000100:00100000:1.0:1789760686.792781:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760686.792923:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777161856 00000100:00100000:0.0:1789760686.792936:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777161856 00000100:00100000:0.0:1789760686.793018:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 362949274395 time 362949377766 state 0x0 ref 1 00000100:00100000:0.0:1789760686.793034:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363149377766 time 362949377766 state 0x1 ref 1 00000100:00100000:1.0:1789760686.967701:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363149377766 time 363151892581 state 0x0 ref 1 00000100:00100000:1.0:1789760686.967751:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777161856:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760686.967851:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760686.967875:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760686.967881:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760686.967888:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760686.967910:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.981750:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.981779:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.981886:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.981895:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760686.981901:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.981913:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.981941:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.981949:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e46e366b/0xc2b9a3a73985798c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760686.982235:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777161856:12345-192.168.203.38@tcp:3:dd.500 Request processed in 14505us (189464us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760686.982248:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:2.0:1789760686.982259:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363149377766 time 363151892581 state 0x2 ref 0 00000100:00100000:1.0:1789760686.986048:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760686.986315:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777161984 00000100:00100000:0.0:1789760686.986328:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777161984 00000100:00100000:0.0:1789760686.986404:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363149377766 time 363151892581 state 0x0 ref 1 00000100:00100000:0.0:1789760686.986421:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363351892581 time 363151892581 state 0x1 ref 1 00000100:00100000:0.0:1789760687.168073:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363351892581 time 363352267499 state 0x0 ref 1 00000100:00100000:0.0:1789760687.168178:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777161984:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760687.168238:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.168260:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760687.168265:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760687.168272:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.168288:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760687.169534:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760687.200263:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.200291:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.200302:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.200332:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dc600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760687.200338:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.200350:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.200379:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.200388:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b9c4f2/0xc2b9a3a739857993 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.200530:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777161984:12345-192.168.203.38@tcp:3:dd.500 Request processed in 32399us (214488us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760687.200542:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:1.0:1789760687.200554:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363351892581 time 363352267499 state 0x2 ref 0 00000100:00100000:3.0:1789760687.205928:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760687.206122:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777162112 00000100:00100000:0.0:1789760687.206136:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777162112 00000100:00100000:0.0:1789760687.206207:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363351892581 time 363352267499 state 0x0 ref 1 00000100:00100000:0.0:1789760687.206223:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363552267499 time 363352267499 state 0x1 ref 1 00000100:00100000:2.0:1789760687.369959:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363552267499 time 363554159133 state 0x0 ref 1 00000100:00100000:2.0:1789760687.369994:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777162112:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760687.370038:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.370058:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760687.370063:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760687.370069:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.370083:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.395033:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.395053:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.395079:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.395087:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760687.395092:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.395101:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.395122:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.395129:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a73985799a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.395216:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777162112:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25235us (189297us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760687.395226:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:2.0:1789760687.395235:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363552267499 time 363554159133 state 0x2 ref 0 00000100:00100000:0.0:1789760687.406544:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760687.407105:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777162240 00000100:00100000:2.0:1789760687.407115:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777162240 00000100:00100000:2.0:1789760687.407747:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363552267499 time 363554159133 state 0x0 ref 1 00000100:00100000:2.0:1789760687.407760:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363754159133 time 363554159133 state 0x1 ref 1 00000100:00100000:2.0:1789760687.570072:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363754159133 time 363754271422 state 0x0 ref 1 00000100:00100000:2.0:1789760687.570110:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777162240:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760687.570155:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.570172:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760687.570177:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760687.570183:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.570198:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.591153:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.591174:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.591183:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.591190:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760687.591194:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.591222:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.591253:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.591262:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a7398579a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.591761:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777162240:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21666us (185220us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760687.591772:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:2.0:1789760687.591781:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363754159133 time 363754271422 state 0x2 ref 0 00000100:00100000:3.0:1789760687.606621:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760687.606722:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777162368 00000100:00100000:2.0:1789760687.606732:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777162368 00000100:00100000:2.0:1789760687.606783:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363754159133 time 363754271422 state 0x0 ref 1 00000100:00100000:2.0:1789760687.606822:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363954271422 time 363754271422 state 0x1 ref 1 00010000:00010000:0.0:1789760687.626854:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760687.770602:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363954271422 time 363954801987 state 0x0 ref 1 00000100:00100000:1.0:1789760687.770637:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777162368:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760687.770677:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.770694:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760687.770710:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760687.770716:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.770731:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.788263:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.788282:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.788292:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.788299:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760687.788304:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.788313:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.788333:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.788340:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e35f967/0xc2b9a3a7398579a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.788560:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777162368:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17935us (181943us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760687.788572:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 233 00000100:00100000:1.0:1789760687.788582:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363954271422 time 363954801987 state 0x2 ref 0 00000100:00100000:3.0:1789760687.797136:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760687.797598:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777162624 00000100:00100000:2.0:1789760687.797609:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777162624 00000100:00100000:2.0:1789760687.797670:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1789760687.797680:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565dd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:11493:x1876699777162624:12345-192.168.203.38@tcp:35:dd.500 00000100:00100000:2.0:1789760687.798064:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565dd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11493:x1876699777162624:12345-192.168.203.38@tcp:35:dd.500 Request processed in 375us (927us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789760687.798086:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1789760687.883865:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760687.884029:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777162752 00000100:00100000:2.0:1789760687.884039:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777162752 00000100:00100000:2.0:1789760687.884116:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1789760687.884126:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:10517:x1876699777162752:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760687.884142:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760687.884194:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398576ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a2f expref: 6 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.884222:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760687.884275:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:10517:x1876699777162752:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 151us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760687.884281:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1789760687.911006:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760687.911108:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777162880 00000100:00100000:0.0:1789760687.911118:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777162880 00000100:00100000:0.0:1789760687.911202:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:0.0:1789760687.911213:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11161:x1876699777162880:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1789760687.911237:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760687.911254:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a7398579af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a36 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.911336:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543200/0xc2b9a3a7398579b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.911350:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543200/0xc2b9a3a7398579b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.911365:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543200/0xc2b9a3a7398579b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760687.911399:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00000004:00200000:0.0:1789760687.911403:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760687.911423:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543200/0xc2b9a3a7398579b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.911448:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a7398579af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a36 expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.911467:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543200/0xc2b9a3a7398579b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a36 expref: 11 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.911476:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:0.0:1789760687.911478:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760687.911482:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548543200, rc 0) 00000100:00100000:0.0:1789760687.911549:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11161:x1876699777162880:12345-192.168.203.38@tcp:101:bash.0 Request processed in 337us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760687.911556:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:3.0:1789760687.924221:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760687.924591:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777163136 00000100:00100000:0.0:1789760687.924601:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777163136 00000100:00100000:0.0:1789760687.924671:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:0.0:1789760687.924683:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11508:x1876699777163136:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1789760687.924703:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760687.924723:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a7398579bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a3d expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760687.924836:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00010000:00010000:0.0:1789760687.924965:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a7398579bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a3d expref: 13 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.924981:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760687.924984:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760687.924990:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a7398579bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a3d expref: 13 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.925004:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548543a00, rc 0) 00000100:00100000:0.0:1789760687.925064:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11508:x1876699777163136:12345-192.168.203.38@tcp:101:rm.0 Request processed in 383us (853us total) trans 4294967333 rc 301/301 00000100:00100000:0.0:1789760687.925071:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:3.0:1789760687.928911:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760687.929525:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777163264 00000100:00100000:2.0:1789760687.929536:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777163264 00000100:00100000:2.0:1789760687.929595:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:2.0:1789760687.929605:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11508:x1876699777163264:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:2.0:1789760687.935667:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11508:x1876699777163264:12345-192.168.203.38@tcp:37:rm.0 Request processed in 6053us (6756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760687.935682:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:3.0:1789760687.941387:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760687.941464:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777163520 00000100:00100000:0.0:1789760687.941473:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777163520 00000100:00100000:0.0:1789760687.941540:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:0.0:1789760687.941552:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11508:x1876699777163520:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:0.0:1789760687.941971:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11508:x1876699777163520:12345-192.168.203.38@tcp:35:rm.0 Request processed in 420us (591us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789760687.941979:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1789760687.944461:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760687.944811:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777163776 00000100:00100000:2.0:1789760687.944820:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777163776 00000100:00100000:2.0:1789760687.944872:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:2.0:1789760687.944880:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11508:x1876699777163776:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1789760687.944900:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760687.944930:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a44 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.945398:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031c00/0xc2b9a3a7398579d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.945413:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031c00/0xc2b9a3a7398579d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.945425:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031c00/0xc2b9a3a7398579d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760687.945436:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00010000:00010000:2.0:1789760687.945754:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a44 expref: 16 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.945773:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031c00/0xc2b9a3a7398579d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a44 expref: 15 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.945781:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:2.0:1789760687.945784:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789760687.945830:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540031c00, rc 0) 00000100:00100000:2.0:1789760687.945886:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11508:x1876699777163776:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1007us (1432us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789760687.945894:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:1.0:1789760687.948547:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760687.948644:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777163904 00000100:00100000:0.0:1789760687.948665:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777163904 00000100:00100000:0.0:1789760687.948728:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:0.0:1789760687.948738:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11508:x1876699777163904:12345-192.168.203.38@tcp:41:rm.0 00000004:00000024:0.0:1789760687.948827:0:9081:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7610564608 00000100:00100000:0.0:1789760687.948889:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11508:x1876699777163904:12345-192.168.203.38@tcp:41:rm.0 Request processed in 153us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760687.948897:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:3.0:1789760687.952208:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760687.952284:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777164160 00000100:00100000:1.0:1789760687.952292:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777164160 00000100:00100000:1.0:1789760687.952343:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:1.0:1789760687.952351:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11508:x1876699777164160:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1789760687.952395:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789760687.952418:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dde00/0xc2b9a3a7398576de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a28 expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952442:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e4486dd000/0xc2b9a3a73985738f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a05 expref: 14 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952453:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e544c16d00) 00010000:00010000:1.0:1789760687.952465:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543200/0xc2b9a3a7398579b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a36 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952473:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:1.0:1789760687.952476:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760687.952494:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952531:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952541:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952556:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952563:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952571:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952982:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952991:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.952999:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789760687.954127:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789760687.954139:0:6465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364138350572ns, next at 365138347802ns, rc = 0 00010000:00010000:1.0:1789760687.954212:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954225:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954244:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954253:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954258:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954263:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954281:0:6465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789760687.954300:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954306:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954311:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954317:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760687.954321:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954327:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954336:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:1.0:1789760687.954339:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789760687.954351:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954357:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4e00/0xc2b9a3a7398579ee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954374:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954380:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954386:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954391:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760687.954393:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954398:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954406:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:1.0:1789760687.954408:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760687.954410:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954415:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a7398579e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760687.954424:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3572f49 reply state 000000003b7ec9ca transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954444:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.954450:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x4009f790 (ffff97e5461f2e00) 00010000:00010000:1.0:1789760687.954452:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760687.954455:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760687.954539:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11508:x1876699777164160:12345-192.168.203.38@tcp:36:rm.0 Request processed in 2185us (2334us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789760687.954547:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 103 00010000:00010000:3.0:1789760687.955637:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760687.955646:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.955662:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760687.955665:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.955673:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.955685:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:3.0:1789760687.955687:0:6454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789760687.955691:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.955695:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a7398579f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.955711:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760687.955713:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760687.955714:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760687.958761:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760687.959205:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777164416 00000100:00100000:2.0:1789760687.959219:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777164416 00000100:00100000:2.0:1789760687.959311:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1789760687.959321:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11508:x1876699777164416:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:2.0:1789760687.959590:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11508:x1876699777164416:12345-192.168.203.38@tcp:35:rm.0 Request processed in 269us (837us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789760687.959598:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1789760687.962585:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760687.962970:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777164672 00000100:00100000:2.0:1789760687.962979:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777164672 00000100:00100000:2.0:1789760687.963041:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:2.0:1789760687.963060:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11508:x1876699777164672:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1789760687.963118:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789760687.963150:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031c00/0xc2b9a3a7398579d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a44 expref: 15 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963173:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00a00/0xc2b9a3a73985735e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119f7 expref: 14 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963182:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e5820ee300) 00010000:00010000:2.0:1789760687.963198:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398572fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e652119e2 expref: 13 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963205:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760687.963208:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760687.963226:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963239:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963248:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963277:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963285:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963292:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963640:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963650:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.963657:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760687.966212:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 16384 00010000:00010000:2.0:1789760687.966235:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966243:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966255:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966262:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760687.966267:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966287:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966304:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff97e543c0ab00) 00010000:00010000:2.0:1789760687.966307:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789760687.966311:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966317:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a0a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966342:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966349:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966355:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966360:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760687.966363:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966368:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966376:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760687.966378:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760687.966381:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966396:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a7398579fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760687.966408:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f84ae57 reply state 0000000074c9ea1c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966419:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.966426:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e543c0a300) 00010000:00010000:2.0:1789760687.966428:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760687.966431:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760687.966530:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11508:x1876699777164672:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3475us (3948us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789760687.966539:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 104 00000001:00080000:2.0:1789760688.360646:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967334 is committed 00000001:00080000:2.0:1789760688.360689:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:2.0:1789760688.360699:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789760688.360736:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00010000:00010000:3.0:1789760688.361101:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760688.361110:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798186112:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789760688.361115:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361122:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361129:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540031a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760688.361134:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361164:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361184:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e543c0a300) 00010000:00010000:3.0:1789760688.361187:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760688.361192:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760688.361199:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760688.361199:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a03 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760688.361243:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798186112 00000100:00100000:3.0:1789760688.361253:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798186112 00000100:00100000:3.0:1789760688.361326:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789760688.361337:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798186112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789760688.361370:0:9533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789760688.361406:0:9533:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 104857600, mtime: 0x6aad949b, atime: 0x6aad9487, ctime: 0x6aad949b, blocks: 0x3200b 00010000:00010000:3.0:1789760688.361414:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361431:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1789760688.361436:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760688.361444:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361458:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361477:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361485:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760688.361523:0:9533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760688.361570:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760688.361577:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760688.361585:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760688.361589:0:6453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760688.361597:0:6453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760688.361621:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760688.361628:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739857a11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760688.361656:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760688.361658:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760688.361660:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760688.362283:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3462:x1876699798186112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 943us (1078us total) trans 4294967426 rc 0/0 00000100:00100000:3.0:1789760688.362292:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789760688.362322:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789760688.362341:0:3462:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e57fab6d80/2, rc 0, transno 4294967426 00000100:00100000:0.0:1789760688.362349:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798186112:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789760688.365451:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.365469:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.365477:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.365484:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760688.365489:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.365509:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.365529:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x4009f790 (ffff97e5461f2e00) 00010000:00010000:1.0:1789760688.365532:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760688.365537:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.365738:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a7398579e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760688.648416:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760688.840097:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760688.840121:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798186368:0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.840212:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760688.840237:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798186496:0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.840277:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760688.840290:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798186240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760688.840302:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798187008:0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.840330:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760688.840344:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798187520:0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.840445:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760688.840473:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798186880:0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.840863:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760688.840890:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798187392:0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.840931:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760688.840954:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798187904:0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.840975:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760688.840995:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789760688.841002:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798186752:0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.841111:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760688.841317:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798186496 00000100:00100000:2.0:1789760688.841325:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798186496 00000100:00100000:2.0:1789760688.841374:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798187008 00000100:00100000:2.0:1789760688.841378:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798187008 00000100:00100000:2.0:1789760688.841404:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798187520 00000100:00100000:2.0:1789760688.841407:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798187520 00000100:00100000:2.0:1789760688.841424:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789760688.841432:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798186496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.841550:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798186496:12345-0@lo:400:kworker.0 Request processed in 117us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760688.841560:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789760688.841581:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789760688.841585:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798186624:0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.841591:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798187008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.841632:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798187008:12345-0@lo:400:kworker.0 Request processed in 43us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760688.841635:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760688.841644:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789760688.841660:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789760688.841664:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798187136:0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.841670:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798187520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760688.841709:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760688.841711:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798187520:12345-0@lo:400:kworker.0 Request processed in 42us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760688.841719:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789760688.841728:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798187648:0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.841732:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798187136 00000100:00100000:0.0:1789760688.841751:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760688.841774:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798187648 00000100:00100000:0.0:1789760688.841778:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798187648 00000100:00100000:0.0:1789760688.841815:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789760688.841822:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798187648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.841854:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798187136 00000100:00100000:0.0:1789760688.841865:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798187648:12345-0@lo:400:kworker.0 Request processed in 43us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760688.841875:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789760688.841881:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789760688.841888:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798187136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.841916:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798187136:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760688.841922:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789760688.842003:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798187520:0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.842038:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798186496:0@lo:400:kworker.0 00000100:00100000:2.0:1789760688.842048:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798187008:0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.842176:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760688.842191:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798186880 00000100:00100000:0.0:1789760688.842196:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798186880 00000100:00100000:3.0:1789760688.842208:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798187264:0@lo:400:kworker.0 00000100:00100000:0.0:1789760688.842226:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798186624 00000100:00100000:0.0:1789760688.842231:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798186624 00000100:00100000:3.0:1789760688.842253:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760688.842257:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789760688.842267:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798186880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760688.842317:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798186880:12345-0@lo:400:kworker.0 Request processed in 51us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760688.842353:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789760688.842365:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798186624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760688.842407:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798186624:12345-0@lo:400:kworker.0 Request processed in 46us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760688.842413:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789760688.842430:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789760688.842436:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798186752 00000100:00100000:1.0:1789760688.842441:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798186752 00000100:00100000:1.0:1789760688.842476:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789760688.842486:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798186624:0@lo:400:kworker.0 00000100:00100000:1.0:1789760688.842487:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798186752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760688.842516:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798187136:0@lo:400:kworker.0 00000100:00100000:0.0:1789760688.842532:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798187648:0@lo:400:kworker.0 00000100:00100000:1.0:1789760688.842554:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798186752:12345-0@lo:400:kworker.0 Request processed in 70us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760688.842558:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760688.842562:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789760688.842567:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798188032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760688.842603:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760688.842641:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798186240 00000100:00100000:0.0:1789760688.842645:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798186240 00000100:00100000:0.0:1789760688.842671:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798188032 00000100:00100000:0.0:1789760688.842673:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798188032 00000100:00100000:0.0:1789760688.842689:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789760688.842698:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798186240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760688.842727:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760688.842760:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798186240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760688.842767:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789760688.842780:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789760688.842802:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798188032:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760688.842812:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798187776:0@lo:400:kworker.0 00002000:00000024:0.0:1789760688.842813:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760688.843001:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760688.843044:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798186880:0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.843067:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798186240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760688.843109:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798186752:0@lo:400:kworker.0 00000100:00100000:0.0:1789760688.843142:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798188032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 354us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760688.843151:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798186368 00000100:00100000:0.0:1789760688.843152:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789760688.843157:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798186368 00000100:00100000:3.0:1789760688.843203:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789760688.843212:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798186368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.843263:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798186368:12345-0@lo:400:kworker.0 Request processed in 52us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760688.843271:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789760688.843293:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798186368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760688.843622:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798188032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760688.843969:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798187392 00000100:00100000:3.0:1789760688.843975:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798187392 00000100:00100000:3.0:1789760688.844020:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798187904 00000100:00100000:3.0:1789760688.844024:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798187904 00000100:00100000:3.0:1789760688.844045:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798187264 00000100:00100000:3.0:1789760688.844049:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798187264 00000100:00100000:3.0:1789760688.844071:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798187776 00000100:00100000:3.0:1789760688.844074:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798187776 00000100:00100000:3.0:1789760688.844097:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760688.844105:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3464:x1876699798187392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.844171:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3464:x1876699798187392:12345-0@lo:400:kworker.0 Request processed in 67us (3239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760688.844185:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760688.844202:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789760688.844209:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798187904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760688.845535:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798187392:0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.845670:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798187904:12345-0@lo:400:kworker.0 Request processed in 1459us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760688.845679:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789760688.845705:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789760688.845717:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798187264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.845759:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798187264:12345-0@lo:400:kworker.0 Request processed in 47us (3507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760688.845768:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789760688.845804:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789760688.845815:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798187776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760688.845848:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798187776:12345-0@lo:400:kworker.0 Request processed in 36us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760688.845855:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1789760688.845881:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760688.845886:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760688.845889:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760688.845892:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760688.846190:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798187264:0@lo:400:kworker.0 00000100:00100000:1.0:1789760688.846209:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798187776:0@lo:400:kworker.0 00000100:00100000:1.0:1789760688.846237:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798187904:0@lo:400:kworker.0 00000100:00100000:3.0:1789760689.351073:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760689.351094:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798188160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760689.351160:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760689.351391:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798188160 00000100:00100000:3.0:1789760689.351398:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798188160 00000100:00100000:3.0:1789760689.351452:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789760689.351470:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798188160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789760689.351521:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789760689.351568:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798188160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760689.351575:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789760689.351617:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798188160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789760689.673180:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760689.865335:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760689.865358:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798188288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760689.865428:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760689.865526:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798188288 00000100:00100000:0.0:1789760689.865534:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798188288 00000100:00100000:0.0:1789760689.865591:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789760689.865601:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798188288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760689.865640:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760689.865702:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798188288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760689.865710:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789760689.865759:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798188288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760690.377760:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760690.377797:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798188416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760690.377870:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760690.378355:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798188416 00000100:00100000:3.0:1789760690.378364:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798188416 00000100:00100000:3.0:1789760690.378418:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789760690.378427:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3463:x1876699798188416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760690.378460:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789760690.378524:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3463:x1876699798188416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760690.378530:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789760690.378562:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760690.378780:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798188416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760690.379466:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798188544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760690.379520:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760690.379564:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798188544 00000100:00100000:1.0:1789760690.379575:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798188544 00000100:00100000:1.0:1789760690.379613:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789760690.379620:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a7db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798188544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760690.379635:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:1.0:1789760690.379668:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a7db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798188544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760690.379675:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789760690.379895:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760690.379918:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798188544:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789760690.695285:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789760690.881416:0:13580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367065625701ns, next at 365138347802ns, rc = 0 00000004:00080000:1.0:1789760690.881655:0:13580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 367065865828ns, next at 326600540545ns, rc = 0 00000004:00080000:1.0:1789760690.881734:0:13580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367065945170ns, next at 314405594137ns, rc = 0 00000004:00080000:1.0:1789760690.881825:0:13580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 367066036568ns, next at 325063677458ns, rc = 0 00000004:00080000:3.0:1789760690.888677:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00000004:00080000:3.0:1789760690.888707:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00000004:00080000:2.0:1789760690.891723:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1789760690.891744:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:0.0:1789760691.724991:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760691.757307:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760691.757344:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760691.757380:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760691.757404:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760691.757428:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760691.757449:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760691.757483:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777165056 00000100:00100000:2.0:1789760691.757492:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777165056 00000100:00100000:2.0:1789760691.757543:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777165312 00000100:00100000:2.0:1789760691.757547:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777165312 00000100:00100000:2.0:1789760691.757560:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777164928 00000100:00100000:2.0:1789760691.757562:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777164928 00000100:00100000:2.0:1789760691.757575:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777165440 00000100:00100000:2.0:1789760691.757578:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777165440 00000100:00100000:2.0:1789760691.757592:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00100000:2.0:1789760691.757601:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777165056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760691.757671:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777165056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760691.757679:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00100000:2.0:1789760691.757696:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 320 00000100:00100000:2.0:1789760691.757703:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777165312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760691.757745:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777165312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760691.757751:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 320 00000100:00100000:2.0:1789760691.757767:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 321 00000100:00100000:2.0:1789760691.757772:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777164928:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760691.757829:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777164928:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760691.757835:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 321 00000100:00100000:2.0:1789760691.757848:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 322 00000100:00100000:2.0:1789760691.757854:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777165440:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760691.757875:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777165440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760691.757881:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 322 00000100:00080000:2.0:1789760691.757899:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760691.757903:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760691.758430:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777164800 00000100:00100000:3.0:1789760691.758436:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777164800 00000100:00100000:3.0:1789760691.758489:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 358 00000100:00100000:3.0:1789760691.758497:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777164800:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760691.758643:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777164800:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 146us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760691.758659:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 358 00000100:00100000:3.0:1789760691.758691:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777165184 00000100:00100000:3.0:1789760691.758695:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777165184 00000100:00100000:3.0:1789760691.758739:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:3.0:1789760691.758746:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777165184:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760691.758774:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777165184:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760691.758780:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00080000:2.0:1789760691.759627:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760692.744119:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760693.567124:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967426 is committed 00010000:00010000:2.0:1789760693.771388:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760693.959054:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798188672:0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.959081:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798188800:0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.959656:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760693.959656:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760693.959701:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798189184:0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.959701:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798189312:0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.959727:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760693.959728:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760693.959742:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798189824:0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.959758:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798189696:0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.959762:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760693.959776:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798189184 00000100:00100000:1.0:1789760693.959782:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760693.959783:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789760693.959785:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798189184 00000100:00100000:2.0:1789760693.959825:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798188928:0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.959829:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798190208:0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.959853:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760693.959868:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789760693.959874:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789760693.959881:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798189184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.959884:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798189056:0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.959912:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760693.959925:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798188672 00000100:00100000:3.0:1789760693.959930:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798188672 00000100:00100000:1.0:1789760693.959932:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798189568:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.959951:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798189184:12345-0@lo:400:kworker.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760693.959961:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789760693.959965:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789760693.959967:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760693.959974:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798188672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.959987:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798190080:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.960006:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798188800 00000100:00100000:1.0:1789760693.960010:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760693.960013:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798188800 00000100:00100000:3.0:1789760693.960013:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798188672:12345-0@lo:400:kworker.0 Request processed in 40us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760693.960022:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789760693.960043:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798188672:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.960051:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798189312 00000100:00100000:3.0:1789760693.960055:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798189824 00000100:00100000:0.0:1789760693.960057:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798189312 00000100:00100000:1.0:1789760693.960059:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798189184:0@lo:400:kworker.0 00000100:00100000:3.0:1789760693.960060:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798189824 00000100:00100000:3.0:1789760693.960092:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798189056 00000100:00100000:0.0:1789760693.960097:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789760693.960097:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798189056 00000100:00100000:0.0:1789760693.960109:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798188800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760693.960120:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789760693.960126:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789760693.960128:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798189824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.960134:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798189312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.960170:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798188800:12345-0@lo:400:kworker.0 Request processed in 64us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760693.960177:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798189312:12345-0@lo:400:kworker.0 Request processed in 42us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760693.960182:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789760693.960191:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789760693.960195:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760693.960206:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789760693.960216:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798189056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.960231:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798189440:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.960275:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798189056:12345-0@lo:400:kworker.0 Request processed in 58us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760693.960275:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760693.960285:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789760693.960300:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798189440 00000100:00100000:2.0:1789760693.960302:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798189952:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.960305:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798189440 00000100:00100000:0.0:1789760693.960334:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789760693.960335:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760693.960347:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798189440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.960361:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798188800:0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.960373:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798189312:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.960391:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798189440:12345-0@lo:400:kworker.0 Request processed in 47us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760693.960396:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798190336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760693.960402:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789760693.960418:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798189952 00000100:00100000:0.0:1789760693.960422:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798189952 00000100:00100000:2.0:1789760693.960430:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760693.960446:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789760693.960466:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798189952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.960473:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798189440:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.960500:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798189952:12345-0@lo:400:kworker.0 Request processed in 46us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760693.960506:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789760693.960592:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798189952:0@lo:400:kworker.0 00000100:00100000:2.0:1789760693.960600:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760693.960606:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798190464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760693.960628:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760693.960661:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798190336 00000100:00100000:2.0:1789760693.960665:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798190336 00000100:00100000:2.0:1789760693.960684:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798190464 00000100:00100000:2.0:1789760693.960685:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798190464 00000100:00100000:2.0:1789760693.960697:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789760693.960703:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798190336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760693.960729:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760693.960764:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798190336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760693.960780:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789760693.960816:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789760693.960822:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798190464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760693.960845:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760693.960871:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798190464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760693.960876:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789760693.960910:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798190464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760693.960922:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798190336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760693.961051:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798188928 00000100:00100000:0.0:1789760693.961056:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798188928 00000100:00100000:0.0:1789760693.961084:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789760693.961100:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798188928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.961145:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798188928:12345-0@lo:400:kworker.0 Request processed in 47us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760693.961152:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789760693.961178:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798189696 00000100:00100000:1.0:1789760693.961179:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798188928:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.961184:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798189696 00000100:00100000:1.0:1789760693.961227:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798190208 00000100:00100000:0.0:1789760693.961229:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798189568 00000100:00100000:1.0:1789760693.961233:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798190208 00000100:00100000:0.0:1789760693.961241:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798189568 00000100:00100000:1.0:1789760693.961259:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798190080 00000100:00100000:1.0:1789760693.961264:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798190080 00000100:00100000:3.0:1789760693.961267:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798189824:12345-0@lo:400:kworker.0 Request processed in 1140us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760693.961274:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789760693.961279:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789760693.961293:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798189696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760693.961298:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789760693.961306:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798190208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760693.961308:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789760693.961316:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798189568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.961343:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798189696:12345-0@lo:400:kworker.0 Request processed in 59us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760693.961352:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789760693.961356:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798190208:12345-0@lo:400:kworker.0 Request processed in 48us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760693.961356:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798189568:12345-0@lo:400:kworker.0 Request processed in 40us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760693.961365:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789760693.961375:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789760693.961381:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789760693.961387:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798190080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789760693.961406:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760693.961410:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760693.961412:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760693.961415:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760693.961416:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798190080:12345-0@lo:400:kworker.0 Request processed in 29us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760693.961431:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789760693.961439:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798189824:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.965136:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798189056:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.965155:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798189568:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.965178:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798190080:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.965190:0:3462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967426 gen 2 00000004:00080000:0.0:1789760693.965194:0:3462:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e57fab6d80, transno 4294967426 00000100:00100000:0.0:1789760693.965213:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798189696:0@lo:400:kworker.0 00000100:00100000:0.0:1789760693.965227:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798190208:0@lo:400:kworker.0 00000100:00100000:1.0:1789760694.471204:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798190592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760694.471283:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760694.471482:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798190592 00000100:00100000:0.0:1789760694.471490:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798190592 00000100:00100000:1.0:1789760694.472063:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789760694.472076:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798190592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760694.472113:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760694.472214:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798190592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760694.472221:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789760694.472485:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798190592:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789760694.791329:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760694.985761:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798190720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760694.985858:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760694.986234:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798190720 00000100:00100000:3.0:1789760694.986243:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798190720 00000100:00100000:3.0:1789760694.986323:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789760694.986333:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798190720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760694.986372:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760694.986426:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798190720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760694.986433:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789760694.986575:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798190720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760695.495070:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798190848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760695.495153:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760695.495228:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760695.495235:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798190976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760695.495279:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760695.495406:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798190848 00000100:00100000:3.0:1789760695.495406:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798190976 00000100:00100000:1.0:1789760695.495413:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798190848 00000100:00100000:3.0:1789760695.495413:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798190976 00000100:00100000:3.0:1789760695.495777:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1789760695.495851:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760695.502770:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798190976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760695.502832:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760695.502940:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798190976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7154us (7659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760695.502949:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789760695.502979:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789760695.503002:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798190848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760695.503014:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760695.503042:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798190848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (7890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760695.503048:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789760695.503439:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798190976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760695.503468:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798190848:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789760695.815133:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760696.839205:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760696.879297:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760696.879379:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760696.879405:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760696.879468:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777165952 00000100:00100000:3.0:1789760696.879477:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777165952 00000100:00100000:3.0:1789760696.879550:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:3.0:1789760696.879559:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777165952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760696.879637:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777165952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760696.879644:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00080000:1.0:1789760696.880034:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760696.880385:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760696.880400:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760696.880478:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777165568 00000100:00100000:3.0:1789760696.880483:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777165568 00000100:00100000:3.0:1789760696.880510:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 360 00000100:00100000:3.0:1789760696.880516:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777165568:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760696.880559:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777165568:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 43us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760696.880566:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 360 00000100:00100000:2.0:1789760696.881725:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760696.881837:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777166208 00000100:00100000:2.0:1789760696.881845:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777166208 00000100:00100000:3.0:1789760696.881855:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777165824 00000100:00100000:3.0:1789760696.881861:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777165824 00000100:00100000:2.0:1789760696.881892:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777166080 00000100:00100000:2.0:1789760696.881896:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777166080 00000100:00100000:0.0:1789760696.882376:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777165696 00000100:00100000:0.0:1789760696.882382:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777165696 00000100:00100000:1.0:1789760696.882482:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 329 00000100:00100000:1.0:1789760696.882493:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777166208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760696.885491:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 330 00000100:00100000:2.0:1789760696.885512:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777165824:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760696.885595:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777165824:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 93us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760696.885602:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 330 00000100:00100000:2.0:1789760696.885620:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 331 00000100:00100000:2.0:1789760696.885626:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777166080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760696.885647:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777166080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760696.885652:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 331 00000100:00100000:2.0:1789760696.885663:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 332 00000100:00100000:2.0:1789760696.885669:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777165696:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760696.885690:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777165696:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (6405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760696.885695:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 332 00000100:00080000:2.0:1789760696.885716:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760696.885721:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760696.886743:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777166208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 4248us (7332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760696.886753:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 329 00010000:00010000:0.0:1789760697.863025:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760698.887074:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760699.079534:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798191232:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.079619:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.079691:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798191744:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.079719:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.079743:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798192256:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.079767:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.079818:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789760699.079825:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798191104:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.079867:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.079887:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798191616:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.079913:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.079928:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798192128:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.079952:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.079968:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798192640:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.079990:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.080016:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798191488:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080040:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.080055:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798192000:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080077:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.080090:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798192512:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080110:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.080125:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789760699.080130:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798191360:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080151:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.080164:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798191872:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080209:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.080224:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798192384:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080244:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.080266:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798191232 00000100:00100000:2.0:1789760699.080274:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798191232 00000100:00100000:2.0:1789760699.080307:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798191744 00000100:00100000:2.0:1789760699.080311:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798191744 00000100:00100000:2.0:1789760699.080332:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798192256 00000100:00100000:2.0:1789760699.080336:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798192256 00000100:00100000:2.0:1789760699.080348:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798191488 00000100:00100000:2.0:1789760699.080350:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798191488 00000100:00100000:2.0:1789760699.080358:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798191872 00000100:00100000:2.0:1789760699.080360:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798191872 00000100:00100000:2.0:1789760699.080372:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798192384 00000100:00100000:2.0:1789760699.080374:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798192384 00000100:00100000:2.0:1789760699.080388:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789760699.080396:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798191232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080460:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798191232:12345-0@lo:400:kworker.0 Request processed in 65us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760699.080468:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789760699.080484:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789760699.080490:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798191744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080517:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798191744:12345-0@lo:400:kworker.0 Request processed in 27us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760699.080523:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789760699.080534:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789760699.080539:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798192256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080564:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798192256:12345-0@lo:400:kworker.0 Request processed in 26us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760699.080576:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789760699.080589:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789760699.080594:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798191488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080627:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798191488:12345-0@lo:400:kworker.0 Request processed in 34us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760699.080633:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789760699.080643:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789760699.080649:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798191872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080674:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798191872:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760699.080679:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789760699.080689:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789760699.080695:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f88f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798192384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080719:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f88f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798192384:12345-0@lo:400:kworker.0 Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760699.080724:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:2.0:1789760699.080737:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760699.080741:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760699.080767:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798191872:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080776:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798192384:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080785:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798191488:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080836:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798191232:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080845:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798191744:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.080862:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798192256:0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.080997:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798191616 00000100:00100000:1.0:1789760699.081001:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798191616 00000100:00100000:1.0:1789760699.081026:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798191360 00000100:00100000:1.0:1789760699.081029:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798191360 00000100:00100000:1.0:1789760699.081042:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789760699.081049:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798191616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.081084:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798191616:12345-0@lo:400:kworker.0 Request processed in 36us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760699.081090:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789760699.081110:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789760699.081116:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798191360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.081150:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798191360:12345-0@lo:400:kworker.0 Request processed in 35us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760699.081156:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789760699.081174:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798192128 00000100:00100000:1.0:1789760699.081178:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798192128 00000100:00100000:1.0:1789760699.081205:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798192640 00000100:00100000:1.0:1789760699.081207:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798192640 00000100:00100000:1.0:1789760699.081218:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798192000 00000100:00100000:1.0:1789760699.081220:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798192000 00000100:00100000:1.0:1789760699.081230:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798192512 00000100:00100000:1.0:1789760699.081231:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798192512 00000100:00100000:1.0:1789760699.081244:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789760699.081249:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798192128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.081278:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798192128:12345-0@lo:400:kworker.0 Request processed in 29us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760699.081283:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789760699.081295:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789760699.081300:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798192640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.081340:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798192640:12345-0@lo:400:kworker.0 Request processed in 39us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760699.081345:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789760699.081356:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789760699.081362:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798192000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.081390:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798192000:12345-0@lo:400:kworker.0 Request processed in 28us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760699.081404:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789760699.081427:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789760699.081433:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798192512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.081462:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798192512:12345-0@lo:400:kworker.0 Request processed in 30us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760699.081467:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1789760699.081485:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760699.081488:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760699.081509:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798191360:0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.081519:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798192000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760699.081528:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798192512:0@lo:400:kworker.0 00000100:00100000:3.0:1789760699.081884:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760699.081896:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798192768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760699.081931:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760699.081979:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798191104 00000100:00100000:3.0:1789760699.081984:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798191104 00000100:00100000:3.0:1789760699.082012:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789760699.082018:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798191104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760699.082049:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798191104:12345-0@lo:400:kworker.0 Request processed in 32us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760699.082055:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789760699.082211:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798192896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760699.082241:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760699.082358:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798192768 00000100:00100000:1.0:1789760699.082363:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798192768 00000100:00100000:1.0:1789760699.082382:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798192896 00000100:00100000:1.0:1789760699.082384:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798192896 00000100:00100000:1.0:1789760699.082397:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789760699.082403:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798192768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760699.082436:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760699.082482:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798192768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760699.082489:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789760699.082502:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789760699.082508:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798192896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789760699.082518:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760699.082543:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798192896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760699.082554:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789760699.082831:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798192896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760699.082861:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798192768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760699.087385:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798191104:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.087407:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798191616:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.087430:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798192128:0@lo:400:kworker.0 00000100:00100000:2.0:1789760699.087443:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798192640:0@lo:400:kworker.0 00000100:00100000:0.0:1789760699.591379:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798193024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760699.591472:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760699.591705:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798193024 00000100:00100000:2.0:1789760699.591713:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798193024 00000100:00100000:2.0:1789760699.591769:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789760699.591780:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798193024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760699.591835:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760699.591887:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798193024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760699.591894:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789760699.592231:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798193024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760699.911033:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760700.103341:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798193152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760700.103419:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760700.103830:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798193152 00000100:00100000:3.0:1789760700.103838:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798193152 00000100:00100000:3.0:1789760700.103975:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789760700.103996:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798193152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760700.104033:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760700.104086:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798193152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760700.104092:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789760700.104176:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798193152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760700.615371:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798193280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760700.615463:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760700.615567:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798193408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760700.615599:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760700.615642:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798193280 00000100:00100000:0.0:1789760700.615650:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798193280 00000100:00100000:0.0:1789760700.615686:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798193408 00000100:00100000:0.0:1789760700.615688:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798193408 00000100:00100000:0.0:1789760700.615705:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789760700.615713:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798193280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789760700.615747:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760700.618354:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798193280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2633us (2882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760700.618388:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789760700.618562:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789760700.618577:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798193408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760700.618601:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760700.618735:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798193408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760700.618741:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789760700.618776:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798193408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760700.618939:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798193280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789760700.935223:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760701.960365:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760702.002091:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760702.002137:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760702.002173:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760702.002203:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760702.002224:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760702.002248:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760702.002295:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777166592 00000100:00100000:2.0:1789760702.002304:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777166592 00000100:00100000:2.0:1789760702.002351:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777166848 00000100:00100000:2.0:1789760702.002353:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777166848 00000100:00100000:2.0:1789760702.002366:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777166464 00000100:00100000:2.0:1789760702.002368:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777166464 00000100:00100000:2.0:1789760702.002378:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777166976 00000100:00100000:2.0:1789760702.002381:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777166976 00000100:00100000:2.0:1789760702.002405:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 339 00000100:00100000:3.0:1789760702.002446:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777166336 00000100:00100000:3.0:1789760702.002450:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777166336 00000100:00100000:2.0:1789760702.002479:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777166592:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760702.002549:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777166592:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 135us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760702.002598:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 362 00000100:00100000:3.0:1789760702.002605:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777166336:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760702.002633:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777166336:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760702.002639:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 362 00000100:00100000:3.0:1789760702.002835:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777166720 00000100:00100000:3.0:1789760702.002840:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777166720 00000100:00100000:3.0:1789760702.002873:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:3.0:1789760702.002892:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777166720:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760702.002946:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777166720:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 56us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760702.002953:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:1.0:1789760702.005114:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 340 00000100:00100000:1.0:1789760702.005143:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777166848:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760702.005232:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777166848:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 105us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760702.005240:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 340 00000100:00100000:1.0:1789760702.005269:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 341 00000100:00100000:1.0:1789760702.005277:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777166464:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760702.005303:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777166464:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (3100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760702.005309:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 341 00000100:00100000:1.0:1789760702.005320:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:1.0:1789760702.005327:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777166976:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760702.005348:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777166976:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (3100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760702.005353:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00080000:1.0:1789760702.005375:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760702.005379:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760702.005382:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760702.011823:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 339 00010000:00010000:2.0:1789760702.983014:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760704.007368:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760704.199135:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798193664:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.199216:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760704.199273:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798194176:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.199303:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760704.199327:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798194688:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.199340:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760704.199356:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789760704.199360:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798193920:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.199362:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798193792:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.199400:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760704.199416:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798194304:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.199436:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760704.199455:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798194816:0@lo:400:kworker.0 00000100:00100000:2.0:1789760704.199478:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760704.199499:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798194432:0@lo:400:kworker.0 00000100:00100000:2.0:1789760704.199526:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760704.199544:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798194944:0@lo:400:kworker.0 00000100:00100000:2.0:1789760704.199564:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760704.199584:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789760704.199590:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798193536:0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.199631:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798193792 00000100:00100000:3.0:1789760704.199639:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798193792 00000100:00100000:3.0:1789760704.199685:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789760704.199690:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798193664 00000100:00100000:3.0:1789760704.199694:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798193792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760704.199695:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798193664 00000100:00100000:0.0:1789760704.199716:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798194176 00000100:00100000:0.0:1789760704.199719:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798194176 00000100:00100000:0.0:1789760704.199740:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798194688 00000100:00100000:0.0:1789760704.199741:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798194688 00000100:00100000:3.0:1789760704.199745:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798193792:12345-0@lo:400:kworker.0 Request processed in 53us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760704.199751:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789760704.199752:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798194304 00000100:00100000:0.0:1789760704.199755:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798194304 00000100:00100000:0.0:1789760704.199768:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798193920 00000100:00100000:0.0:1789760704.199770:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798193920 00000100:00100000:3.0:1789760704.199779:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789760704.199785:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789760704.199804:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798193664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760704.199810:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798194176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.199836:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798193664:12345-0@lo:400:kworker.0 Request processed in 50us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760704.199841:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789760704.199857:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798194176:12345-0@lo:400:kworker.0 Request processed in 48us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760704.199858:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789760704.199869:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789760704.199872:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798194688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760704.199887:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789760704.199896:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798194304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.199911:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798194688:12345-0@lo:400:kworker.0 Request processed in 42us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760704.199918:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789760704.199936:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798194304:12345-0@lo:400:kworker.0 Request processed in 41us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760704.199963:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760704.199989:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798194048:0@lo:400:kworker.0 00000100:00100000:2.0:1789760704.200012:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760704.200027:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798194560:0@lo:400:kworker.0 00000100:00100000:2.0:1789760704.200046:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760704.200071:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798195072:0@lo:400:kworker.0 00000100:00100000:2.0:1789760704.200091:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760704.200170:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789760704.200178:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789760704.200182:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798193920:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789760704.200196:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760704.200200:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760704.200225:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798193920:12345-0@lo:400:kworker.0 Request processed in 47us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760704.200234:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789760704.200248:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798194048 00000100:00100000:0.0:1789760704.200252:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798194048 00000100:00100000:3.0:1789760704.200269:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798194432 00000100:00100000:3.0:1789760704.200274:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798194432 00000100:00100000:0.0:1789760704.200284:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789760704.200290:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798194048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.200317:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798194944 00000100:00100000:0.0:1789760704.200320:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798194048:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760704.200322:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798194944 00000100:00100000:0.0:1789760704.200327:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789760704.200345:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798193536 00000100:00100000:3.0:1789760704.200346:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798194560 00000100:00100000:0.0:1789760704.200348:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798193536 00000100:00100000:3.0:1789760704.200351:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798194560 00000100:00100000:0.0:1789760704.200372:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789760704.200376:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798195072 00000100:00100000:3.0:1789760704.200389:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798195072 00000100:00100000:0.0:1789760704.200395:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798193536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.200410:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789760704.200419:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798194432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760704.200431:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798193536:12345-0@lo:400:kworker.0 Request processed in 52us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760704.200437:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789760704.200464:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798194432:12345-0@lo:400:kworker.0 Request processed in 47us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760704.200469:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789760704.200486:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798195328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760704.200512:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760704.200534:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760704.200540:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798195200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760704.200562:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760704.200588:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798195328 00000100:00100000:0.0:1789760704.200593:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798195328 00000100:00100000:1.0:1789760704.200601:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760704.200613:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798195200 00000100:00100000:0.0:1789760704.200618:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798195200 00000100:00100000:0.0:1789760704.200634:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789760704.200643:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798194688:0@lo:400:kworker.0 00000100:00100000:0.0:1789760704.200649:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3462:x1876699798195328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760704.200655:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798193664:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.200663:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798194176:0@lo:400:kworker.0 00002000:00000024:0.0:1789760704.200678:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760704.200686:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798193792:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.200694:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798194304:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.200711:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798194816 00000100:00100000:1.0:1789760704.200713:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798194816 00000100:00100000:0.0:1789760704.200725:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3462:x1876699798195328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760704.200733:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789760704.200739:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789760704.200745:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798194816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760704.200751:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789760704.200761:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798195200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760704.200774:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760704.200776:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798194816:12345-0@lo:400:kworker.0 Request processed in 31us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760704.200782:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789760704.201014:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798194816:0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.201082:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798195328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760704.201236:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789760704.201248:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798194944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.201337:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798194944:12345-0@lo:400:kworker.0 Request processed in 93us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760704.202326:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798195200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1563us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760704.202336:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789760704.202419:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798195200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760704.205397:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789760704.205411:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789760704.205428:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798194560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760704.205430:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798195072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.205759:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789760704.205876:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798193536:0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.205894:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798194048:0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.205907:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798193920:0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.205920:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798194432:0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.205932:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798194944:0@lo:400:kworker.0 00000100:00080000:3.0:1789760704.205978:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760704.205984:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760704.205986:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760704.217704:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798195072:12345-0@lo:400:kworker.0 Request processed in 12274us (17602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760704.217721:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789760704.221953:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798194560:12345-0@lo:400:kworker.0 Request processed in 16532us (21895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760704.221969:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789760704.223120:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798194560:0@lo:400:kworker.0 00000100:00100000:3.0:1789760704.223137:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798195072:0@lo:400:kworker.0 00000100:00100000:2.0:1789760704.713193:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760704.713216:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798195456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760704.713287:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760704.713347:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798195456 00000100:00100000:2.0:1789760704.713355:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798195456 00000100:00100000:2.0:1789760704.713415:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789760704.713423:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798195456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760704.713464:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760704.713509:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798195456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760704.713516:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789760704.713564:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798195456:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789760705.032114:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760705.228336:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760705.228359:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798195584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760705.228437:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760705.228516:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798195584 00000100:00100000:3.0:1789760705.228523:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798195584 00000100:00100000:3.0:1789760705.228567:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789760705.228576:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798195584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760705.228611:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760705.228666:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798195584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760705.228673:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789760705.228719:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798195584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760705.736599:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798195712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760705.736714:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760705.736779:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798195712 00000100:00100000:2.0:1789760705.736801:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798195712 00000100:00100000:2.0:1789760705.736845:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789760705.736855:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798195712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760705.736902:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760705.736959:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798195712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760705.736967:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789760705.737011:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798195712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760705.745053:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798195840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760705.745121:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760705.745204:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798195840 00000100:00100000:2.0:1789760705.745211:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798195840 00000100:00100000:2.0:1789760705.745253:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789760705.745261:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798195840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760705.745282:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760705.745320:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798195840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760705.745326:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789760705.745379:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798195840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760706.055209:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760707.078914:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760707.128436:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760707.128738:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777167104 00000100:00100000:3.0:1789760707.128749:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777167104 00000100:00100000:3.0:1789760707.128835:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 364 00000100:00100000:3.0:1789760707.128845:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777167104:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760707.128919:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777167104:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760707.128926:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 364 00000100:00100000:2.0:1789760707.138651:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760707.138777:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777167360 00000100:00100000:3.0:1789760707.138819:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777167360 00000100:00100000:3.0:1789760707.138887:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 349 00000100:00100000:3.0:1789760707.138898:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777167360:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760707.138989:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777167360:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 94us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760707.138997:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 349 00000100:00080000:0.0:1789760707.139380:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760707.147075:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760707.147140:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760707.147174:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760707.147278:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777167232 00000100:00100000:1.0:1789760707.147288:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777167232 00000100:00100000:1.0:1789760707.147353:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777167744 00000100:00100000:1.0:1789760707.147367:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777167744 00000100:00100000:1.0:1789760707.147397:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 350 00000100:00100000:1.0:1789760707.147417:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777167232:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760707.147502:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777167232:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 97us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760707.147510:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 350 00000100:00100000:1.0:1789760707.147528:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 351 00000100:00100000:1.0:1789760707.147535:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777167744:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760707.147559:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777167744:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760707.147565:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 351 00000100:00100000:3.0:1789760707.147762:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777167488 00000100:00100000:3.0:1789760707.147768:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777167488 00000100:00100000:3.0:1789760707.147836:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:3.0:1789760707.147844:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777167488:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760707.147885:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777167488:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760707.147891:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00080000:2.0:1789760707.148118:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760707.148122:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760707.148124:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760707.153384:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760707.156771:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777167616 00000100:00100000:2.0:1789760707.156827:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777167616 00000100:00100000:2.0:1789760707.156925:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 352 00000100:00100000:2.0:1789760707.156949:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777167616:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760707.157036:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777167616:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 90us (3662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760707.157043:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 352 00000100:00080000:0.0:1789760707.157139:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789760708.120506:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760709.128894:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760709.320117:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798195968:0@lo:400:kworker.0 00000100:00100000:0.0:1789760709.320190:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760709.320230:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798196480:0@lo:400:kworker.0 00000100:00100000:0.0:1789760709.320290:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760709.320306:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798196992:0@lo:400:kworker.0 00000100:00100000:0.0:1789760709.320337:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760709.320367:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798197504:0@lo:400:kworker.0 00000100:00100000:0.0:1789760709.320388:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760709.320409:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789760709.320415:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798196096:0@lo:400:kworker.0 00000100:00100000:0.0:1789760709.320437:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760709.320464:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798196608:0@lo:400:kworker.0 00000100:00100000:0.0:1789760709.320484:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760709.320496:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798197120:0@lo:400:kworker.0 00000100:00100000:0.0:1789760709.320512:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760709.320526:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798197632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760709.320545:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760709.320576:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798195968 00000100:00100000:0.0:1789760709.320583:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798195968 00000100:00100000:0.0:1789760709.320628:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789760709.320636:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798195968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760709.320680:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798195968:12345-0@lo:400:kworker.0 Request processed in 45us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760709.320687:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789760709.320719:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798196992 00000100:00100000:0.0:1789760709.320723:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798196992 00000100:00100000:0.0:1789760709.320753:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798197504 00000100:00100000:0.0:1789760709.320756:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798197504 00000100:00100000:0.0:1789760709.320775:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789760709.320781:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798196992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.321350:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789760709.321361:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798197504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.321474:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798196224:0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.324805:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798197504:12345-0@lo:400:kworker.0 Request processed in 3418us (4387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760709.324837:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789760709.324880:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798196096 00000100:00100000:1.0:1789760709.324888:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798196096 00000100:00100000:1.0:1789760709.324933:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798196608 00000100:00100000:1.0:1789760709.324936:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798196608 00000100:00100000:1.0:1789760709.324958:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798197120 00000100:00100000:1.0:1789760709.324961:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798197120 00000100:00100000:1.0:1789760709.324979:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789760709.324986:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798196096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.325054:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798196096:12345-0@lo:400:kworker.0 Request processed in 68us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760709.325061:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789760709.325074:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789760709.325080:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798196608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.325107:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798196608:12345-0@lo:400:kworker.0 Request processed in 28us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760709.325112:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789760709.325123:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789760709.325128:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798197120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.325152:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798197120:12345-0@lo:400:kworker.0 Request processed in 25us (4639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760709.325157:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789760709.330082:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760709.330131:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798196736:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.330179:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760709.330200:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798197248:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.330223:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760709.330251:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798197760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760709.330276:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760709.330294:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789760709.330301:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798196352:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.330321:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760709.330338:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798196864:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.330389:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760709.330411:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798197376:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.330436:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760709.330475:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798196480 00000100:00100000:2.0:1789760709.330485:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798196480 00000100:00100000:2.0:1789760709.330536:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798196224 00000100:00100000:2.0:1789760709.330539:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798196224 00000100:00100000:2.0:1789760709.330558:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789760709.330575:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798196480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.330642:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798196480:12345-0@lo:400:kworker.0 Request processed in 69us (10350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760709.330649:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789760709.330667:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789760709.330674:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798196224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.330707:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798196224:12345-0@lo:400:kworker.0 Request processed in 34us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760709.330713:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789760709.330732:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798197632 00000100:00100000:2.0:1789760709.330736:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798197632 00000100:00100000:2.0:1789760709.330760:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798197760 00000100:00100000:2.0:1789760709.330762:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798197760 00000100:00100000:2.0:1789760709.330774:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789760709.330779:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798197632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760709.332320:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760709.332406:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798197632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1622us (11855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760709.332414:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789760709.332438:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789760709.332448:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798197760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760709.332469:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760709.332496:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798197760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760709.332502:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789760709.332525:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798196864 00000100:00100000:2.0:1789760709.332541:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798196864 00000100:00100000:2.0:1789760709.332573:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798197376 00000100:00100000:2.0:1789760709.332576:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798197376 00000100:00100000:2.0:1789760709.332589:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789760709.332595:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798196864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.332630:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798196864:12345-0@lo:400:kworker.0 Request processed in 36us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760709.332636:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789760709.332647:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789760709.332653:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e581c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798197376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.332680:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e581c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798197376:12345-0@lo:400:kworker.0 Request processed in 27us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760709.332685:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789760709.333162:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760709.333167:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760709.333170:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760709.333215:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798196096:0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333243:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798196608:0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333256:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798197120:0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333271:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798197632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760709.333281:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798195968:0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333293:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798196480:0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333304:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798197504:0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333360:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798196736 00000100:00100000:1.0:1789760709.333365:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798196736 00000100:00100000:1.0:1789760709.333397:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798197248 00000100:00100000:1.0:1789760709.333400:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798197248 00000100:00100000:1.0:1789760709.333413:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798196352 00000100:00100000:1.0:1789760709.333416:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798196352 00000100:00100000:1.0:1789760709.333429:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789760709.333436:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798196736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333476:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798196736:12345-0@lo:400:kworker.0 Request processed in 41us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760709.333482:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789760709.333495:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789760709.333501:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798197248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333528:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798197248:12345-0@lo:400:kworker.0 Request processed in 28us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760709.333533:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789760709.333544:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789760709.333550:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798196352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760709.333587:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798196352:12345-0@lo:400:kworker.0 Request processed in 38us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760709.333594:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:1.0:1789760709.333668:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760709.333830:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798196992:12345-0@lo:400:kworker.0 Request processed in 13039us (13483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760709.333839:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789760709.334188:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798196992:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.334778:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798196352:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.334814:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798196864:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.334826:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798197376:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.334844:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798197760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760709.334855:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798196224:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.334865:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798196736:0@lo:400:kworker.0 00000100:00100000:2.0:1789760709.334876:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798197248:0@lo:400:kworker.0 00000100:00100000:3.0:1789760709.836099:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798197888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760709.836169:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760709.839353:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798197888 00000100:00100000:2.0:1789760709.839367:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798197888 00000100:00100000:2.0:1789760709.839431:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789760709.839442:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798197888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760709.839487:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760709.839608:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798197888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (3438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760709.839616:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789760709.839667:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798197888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760710.104250:0:13904:0:(nrs_tbf.c:480:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff97e57fcf2c00 key uid={500} rule@0xffff97e57f6bf900 gen 0 rate 5 depth 3 token 0 deadline 363954271422 time 363954801987 state 0x6 ref 0 00000100:00100000:3.0:1789760710.104268:0:13904:0:(nrs_tbf.c:480:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff97e545769a00 key uid={0} rule@0xffff97e57f6bf500 gen 0 rate 10000 depth 3 token 2 deadline 320797385182 time 322282916282 state 0x6 ref 0 00000100:00100000:3.0:1789760710.118107:0:13904:0:(nrs_tbf.c:480:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff97e545768400 key uid={0} rule@0xffff97e57f6bfa00 gen 0 rate 10000 depth 3 token 2 deadline 320526650005 time 320586189115 state 0x6 ref 0 00010000:00010000:1.0:1789760710.150898:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760710.343840:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760710.343863:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798198016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760710.343935:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760710.344010:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798198016 00000100:00100000:2.0:1789760710.344018:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798198016 00000100:00100000:2.0:1789760710.344067:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789760710.344076:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798198016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760710.344115:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760710.344160:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798198016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760710.344167:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789760710.344211:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798198016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760710.854996:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798198144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760710.855086:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760710.855229:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798198272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760710.855264:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760710.856268:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798198144 00000100:00100000:1.0:1789760710.856279:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798198144 00000100:00100000:1.0:1789760710.856321:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798198272 00000100:00100000:1.0:1789760710.856325:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798198272 00000100:00100000:1.0:1789760710.856357:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760710.856365:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798198144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760710.856922:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760710.857372:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798198144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1005us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760710.857392:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760710.857418:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789760710.857426:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798198272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760710.857757:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760710.858146:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798198272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 720us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760710.858153:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789760710.858230:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798198144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760710.858279:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798198272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789760711.175091:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760712.199542:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760712.240011:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760712.240056:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760712.240111:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760712.240180:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777168128 00000100:00100000:3.0:1789760712.240190:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777168128 00000100:00100000:1.0:1789760712.240201:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777168000 00000100:00100000:1.0:1789760712.240208:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777168000 00000100:00100000:0.0:1789760712.240262:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777167872 00000100:00100000:0.0:1789760712.240267:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777167872 00000100:00100000:0.0:1789760712.240316:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 366 00000100:00100000:3.0:1789760712.240330:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 359 00000100:00100000:0.0:1789760712.240342:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777167872:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760712.240355:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777168128:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760712.240422:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777167872:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 84us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760712.240430:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 366 00000100:00100000:1.0:1789760712.245048:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 360 00000100:00100000:1.0:1789760712.245067:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777168000:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:2.0:1789760712.245232:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760712.245238:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760712.245339:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777168128:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 4986us (5278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760712.245351:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 359 00000100:00100000:1.0:1789760712.245624:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777168000:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 562us (5511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760712.245829:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 360 00000100:00100000:2.0:1789760712.247504:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760712.247552:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760712.247637:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760712.247672:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777168384 00000100:00100000:2.0:1789760712.247681:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777168384 00000100:00100000:2.0:1789760712.247741:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777168512 00000100:00100000:2.0:1789760712.247745:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777168512 00000100:00100000:2.0:1789760712.247769:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 361 00000100:00100000:2.0:1789760712.247778:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777168384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760712.247818:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777168256 00000100:00100000:3.0:1789760712.247825:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777168256 00000100:00100000:2.0:1789760712.247861:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777168384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760712.247868:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 361 00000100:00100000:3.0:1789760712.247875:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1789760712.247886:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2402:x1876699777168256:12345-192.168.203.38@tcp:9:kworker.0 00000100:00100000:2.0:1789760712.247892:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 362 00000100:00100000:2.0:1789760712.247901:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777168512:12345-192.168.203.38@tcp:400:kworker.0 00000020:00000080:3.0:1789760712.247912:0:9533:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2b9a3a739857016 00000100:00080000:3.0:1789760712.247923:0:9533:0:(import.c:65:import_set_state_nolock()) ffff97e543262000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789760712.247929:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777168512:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760712.247937:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 362 00000100:00080000:2.0:1789760712.247954:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760712.247958:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:3.0:1789760712.247958:0:9533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967426 00000100:00080000:2.0:1789760712.247962:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760712.248175:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+2:2402:x1876699777168256:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 290us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760712.248182:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00010000:00010000:1.0:1789760712.250490:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760713.224833:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760714.249292:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760714.262371:0:13952:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e57f97d800 rate 10000 gen 0 00000100:00100000:2.0:1789760714.262418:0:13952:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e57f97dd00 rate 10000 gen 0 00000100:00100000:3.0:1789760714.263088:0:13952:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e547f42000 rate 5 gen 0 00000100:00100000:3.0:1789760714.263097:0:13952:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e547f42600 rate 5 gen 0 00000100:00100000:0.0:1789760714.323707:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.324257:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777168640 00000100:00100000:1.0:1789760714.324274:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777168640 00000100:00100000:1.0:1789760714.324511:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:1.0:1789760714.324525:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11896:x1876699777168640:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:1.0:1789760714.324554:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760714.324706:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a4b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760714.324762:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789760714.324827:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.324846:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.324873:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760714.324934:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789760714.324939:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789760714.324964:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.324994:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.325010:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 6 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.325031:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760714.325035:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789760714.325039:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f5800, rc 0) 00000100:00100000:1.0:1789760714.325120:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11896:x1876699777168640:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 599us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760714.325131:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:0.0:1789760714.330427:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.330503:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.330831:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777168768 00000100:00100000:2.0:1789760714.330841:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777168768 00000100:00100000:3.0:1789760714.330844:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777169024 00000100:00100000:3.0:1789760714.330851:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777169024 00000100:00080000:0.0:1789760714.330921:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760714.331205:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:2.0:1789760714.331218:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11896:x1876699777169024:12345-192.168.203.38@tcp:36:mkdir.0 00000100:00100000:3.0:1789760714.331225:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:3.0:1789760714.331237:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777168768:12345-192.168.203.38@tcp:41:mkdir.0 00000004:00000024:3.0:1789760714.331269:0:6465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760714.331348:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798198400:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789760714.331423:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.331446:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777168768:12345-192.168.203.38@tcp:41:mkdir.0 Request processed in 210us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.331454:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:2.0:1789760714.331478:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e55a360240 going to sleep for 11 seconds 00000100:00100000:0.0:1789760714.331566:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798198400 00000100:00100000:0.0:1789760714.331572:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798198400 00000100:00100000:0.0:1789760714.331610:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789760714.331618:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798198400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789760714.332553:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798198400:12345-0@lo:1000:mdt00_003.0 Request processed in 931us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.332561:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789760714.332674:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798198400:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789760714.332748:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798198528:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789760714.332780:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.333297:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e55a3603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760714.333357:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798198528 00000100:00100000:0.0:1789760714.333363:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798198528 00000100:00100000:0.0:1789760714.333405:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789760714.333414:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798198528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789760714.333692:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798198528:12345-0@lo:1000:mdt00_003.0 Request processed in 279us (911us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760714.333709:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789760714.333778:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798198528:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789760714.333866:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.333876:0:9081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.333885:0:9081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.333898:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798198656:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1789760714.333926:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.333946:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789760714.333970:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798198656 00000100:00100000:3.0:1789760714.333974:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798198656 00000100:00100000:3.0:1789760714.333999:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789760714.334005:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798198656:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1789760714.334015:0:7305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760714.334029:0:7305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857a2d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739857a26 expref: -99 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.334052:0:7305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 5 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.334062:0:7305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857a2d lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857a26 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.334087:0:7305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 5 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.335477:0:7305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 5 pid: 6466 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.335507:0:7305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798198784:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760714.335596:0:7305:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760714.338962:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.339048:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777169152 00000100:00100000:2.0:1789760714.339057:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777169152 00010000:00010000:2.0:1789760714.339097:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 6 pid: 6466 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760714.339142:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:2.0:1789760714.339152:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777169152:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760714.339166:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760714.339173:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 6 pid: 6466 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.339186:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 6 pid: 6466 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.339209:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760714.339216:0:6451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857a2d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857a26 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.339238:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857a2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xc2b9a3a739857a26 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.339247:0:6451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857a2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xc2b9a3a739857a26 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.339297:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857a2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857a26 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760714.339322:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6451:1876699798198912:0@lo:105: 00000100:00100000:2.0:1789760714.339383:0:6451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.339424:0:6451:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e55a3603c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789760714.339467:0:7305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5800/0xc2b9a3a739857a1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a4b expref: 6 pid: 6466 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.339484:0:7305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798198784:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760714.339506:0:7305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857a2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857a26 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.339515:0:7305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760714.339518:0:7305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760714.339521:0:7305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4a00, rc 0) 00000100:00100000:3.0:1789760714.339565:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798198656:12345-0@lo:101:mdt00_003.0 Request processed in 5559us (5637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.339572:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789760714.339640:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798198912 00000100:00100000:0.0:1789760714.339645:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798198912 00000100:00100000:2.0:1789760714.339651:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798198656:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789760714.339668:0:9081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.339680:0:9081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760714.339687:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789760714.339699:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6451:x1876699798198912:12345-0@lo:105: 00010000:00010000:0.0:1789760714.339710:0:6449:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.339719:0:6449:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.339726:0:6449:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.339733:0:6449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.339738:0:6449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.339746:0:6449:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.339771:0:6449:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97e57fcf4800) 00000100:00100000:0.0:1789760714.339831:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6451:x1876699798198912:12345-0@lo:105: Request processed in 133us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.339847:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789760714.339985:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6451:1876699798198912:0@lo:105: 00010000:00010000:2.0:1789760714.339996:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760714.340037:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777169152:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 887us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.340044:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00010000:00010000:2.0:1789760714.340064:0:9081:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.340072:0:9081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760714.340090:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789760714.340121:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.340145:0:9081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.340155:0:9081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760714.340170:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199040:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1789760714.340196:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.340213:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e55a3603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760714.340227:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798199040 00000100:00100000:2.0:1789760714.340230:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798199040 00000100:00100000:2.0:1789760714.340252:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789760714.340260:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9081:x1876699798199040:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789760714.340273:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.340344:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a3b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739857a34 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.340362:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857a34 expref: 8 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.340373:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857a34 expref: 8 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.340380:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e543c0a500) 00010000:00010000:2.0:1789760714.340384:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760714.340387:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540030c00, rc 0) 00000100:00100000:2.0:1789760714.340414:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199040:12345-0@lo:101:mdt00_003.0 Request processed in 156us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.340426:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789760714.340451:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199040:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789760714.340461:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.340470:0:9081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760714.340482:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1789760714.340509:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199168:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789760714.340534:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.340546:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e55a360240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760714.340882:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798199168 00000100:00100000:3.0:1789760714.340887:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798199168 00000100:00100000:3.0:1789760714.340912:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789760714.340918:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760714.340974:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199168:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.340980:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789760714.341017:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199168:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760714.341053:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199296:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760714.341078:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.341093:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760714.341103:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798199296 00000100:00100000:3.0:1789760714.341106:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798199296 00000100:00100000:2.0:1789760714.341455:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789760714.341464:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789760714.341687:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199296:12345-0@lo:1000:mdt00_003.0 Request processed in 225us (607us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760714.341694:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789760714.343568:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449748700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199296:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760714.343680:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199424:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789760714.343736:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760714.343772:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760714.343919:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798199424 00000100:00100000:3.0:1789760714.343926:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798199424 00000100:00100000:3.0:1789760714.344065:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789760714.344076:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199424:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760714.344342:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199424:12345-0@lo:1000:mdt00_003.0 Request processed in 268us (606us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760714.344350:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789760714.349030:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199424:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760714.349211:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6de300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199552:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760714.349278:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.350269:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760714.351025:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798199552 00000100:00100000:0.0:1789760714.351033:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798199552 00000100:00100000:0.0:1789760714.351097:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789760714.351106:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789760714.351341:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199552:12345-0@lo:1000:mdt00_003.0 Request processed in 236us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.351349:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789760714.352150:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6de300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199552:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789760714.352225:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199680:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789760714.352268:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.352471:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5602169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760714.352650:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798199680 00000100:00100000:0.0:1789760714.352661:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798199680 00000100:00100000:0.0:1789760714.353135:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789760714.353147:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789760714.353228:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199680:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.353235:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789760714.356933:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199680:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789760714.357100:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4499d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199808:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789760714.357359:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760714.357862:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760714.362467:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798199808 00000100:00100000:3.0:1789760714.362484:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798199808 00000100:00100000:3.0:1789760714.362642:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789760714.362663:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760714.362823:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:9081:x1876699798199808:12345-0@lo:1000:mdt00_003.0 Request processed in 162us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.362832:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789760714.362971:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4499d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798199808:0@lo:1000:mdt00_003.0 00000040:00080000:1.0:1789760714.365569:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].3, 984 off35160 00000040:00080000:1.0:1789760714.365752:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].3, 1136 off35544 00000004:00080000:1.0:1789760714.365760:0:9081:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e57fdc7540 with version 8 00000004:00080000:0.0:1789760714.365894:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 8 rpc_version 8 00000020:00100000:0.0:1789760714.365928:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789760714.365939:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e4499db480 x1876699798200064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789760714.366070:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4499db480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798200064:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789760714.366209:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760714.366243:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57f6e8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760714.366258:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798200064 00000100:00100000:1.0:1789760714.366266:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798200064 00000100:00100000:1.0:1789760714.366459:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789760714.366471:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7275:x1876699798200064:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789760714.372470:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7275:x1876699798200064:12345-0@lo:1000:osp_up0-1.0 Request processed in 5993us (6253us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1789760714.372485:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789760714.372645:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4499db480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798200064:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789760714.373054:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.373079:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.373102:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760714.373126:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7506605 reply state 00000000f6f38a01 transno 4294967333 ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.373136:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.373143:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:1.0:1789760714.373146:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760714.373149:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789760714.373154:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00000004:00080000:1.0:1789760714.373162:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760714.373172:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.373181:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.373188:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.373216:0:9081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789760714.373221:0:9081:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760714.373227:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.373234:0:9081:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760714.373350:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11896:x1876699777169024:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 42133us (42843us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789760714.373357:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 106 00010000:00010000:3.0:1789760714.374405:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760714.374422:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.374434:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4800 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:3.0:1789760714.374441:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760714.374450:0:7281:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.375277:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.375568:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789760714.375630:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798200192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760714.375700:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760714.375824:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798200192 00000100:00100000:1.0:1789760714.375832:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798200192 00010000:00010000:3.0:1789760714.375900:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.375911:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57fcf4800/0xc2b9a3a739857a26 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857a2d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.375929:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760714.375931:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760714.375933:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760714.375963:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760714.375974:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3462:x1876699798200192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760714.375989:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760714.376011:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4a00/0xc2b9a3a739857a2d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739857a26 expref: 9 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.376026:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760714.376031:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760714.379678:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3462:x1876699798200192:12345-0@lo:103:ldlm_bl.0 Request processed in 3697us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760714.379692:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760714.381341:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798200192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789760714.405997:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.406106:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777169280 00000100:00100000:0.0:1789760714.406115:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777169280 00000100:00100000:0.0:1789760714.407227:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:0.0:1789760714.407242:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11897:x1876699777169280:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1789760714.407263:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760714.407364:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542400/0xc2b9a3a739857a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a52 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.407429:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857a50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.407442:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857a50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.407454:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857a50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760714.407486:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760714.407490:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760714.407508:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857a50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.407533:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542400/0xc2b9a3a739857a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a52 expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.407549:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857a50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a52 expref: 6 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.407563:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760714.407565:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760714.407569:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548543c00, rc 0) 00000100:00100000:0.0:1789760714.409271:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11897:x1876699777169280:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2023us (3269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.409357:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:0.0:1789760714.422662:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.422732:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777169536 00000100:00100000:2.0:1789760714.422741:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777169536 00000100:00100000:3.0:1789760714.422818:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:3.0:1789760714.422897:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11897:x1876699777169536:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1789760714.422917:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760714.422920:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789760714.422946:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857a50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a52 expref: 6 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.422977:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760714.422982:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760714.422994:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4800/0xc2b9a3a739857a57 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a59 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.423111:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.423124:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.423134:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.423145:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.423154:0:12655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a3b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857a34 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.423163:0:12655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.423195:0:12655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739857a34 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.423209:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12655:1876699798200320:0@lo:104: 00000100:00100000:3.0:1789760714.423255:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.423311:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760714.426716:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798200320 00000100:00100000:0.0:1789760714.426733:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798200320 00000100:00100000:0.0:1789760714.426815:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789760714.426825:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:12655:x1876699798200320:12345-0@lo:104: 00010000:00010000:0.0:1789760714.426844:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.426934:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760714.426940:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:12655:x1876699798200320:12345-0@lo:104: Request processed in 118us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.426947:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1789760714.430945:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760714.430958:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.430972:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540031a00 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:3.0:1789760714.430978:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760714.430989:0:6454:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.431036:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.431043:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760714.431079:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.431087:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e540031a00/0xc2b9a3a739857a34 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739857a3b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.431110:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760714.431112:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760714.431113:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760714.431132:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798200448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760714.431200:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.431259:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798200448 00000100:00100000:3.0:1789760714.431266:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798200448 00010000:00010000:3.0:1789760714.431310:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a3b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc2b9a3a739857a34 expref: 8 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.431342:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789760714.431351:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3463:x1876699798200448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760714.431365:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789760714.432098:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12655:1876699798200320:0@lo:104: 00010000:00010000:3.0:1789760714.432123:0:12655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760714.441944:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798200576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760714.442015:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760714.442128:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798200576 00000100:00100000:0.0:1789760714.442136:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798200576 00000100:00100000:0.0:1789760714.442182:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789760714.442190:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798200576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760714.442196:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798200832:0@lo:400:kworker.0 00002000:00000024:0.0:1789760714.442219:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760714.442222:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.442240:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798201344:0@lo:400:kworker.0 00000100:00100000:0.0:1789760714.442257:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798200576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.442259:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760714.442263:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789760714.442273:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798201856:0@lo:400:kworker.0 00000100:00080000:0.0:1789760714.442289:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760714.442313:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.442333:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798200704:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.442343:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798200960:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.442365:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.442365:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.442380:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798201472:0@lo:400:kworker.0 00000100:00100000:3.0:1789760714.442395:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798201216:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.442400:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.442413:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.442415:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57a223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798201984:0@lo:400:kworker.0 00000100:00100000:3.0:1789760714.442422:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798201728:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.442432:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.442436:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760714.442447:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789760714.442452:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798201088:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.442475:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760714.442485:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798200832 00000100:00100000:0.0:1789760714.442489:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798200832 00000100:00100000:2.0:1789760714.442499:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798201600:0@lo:400:kworker.0 00000100:00100000:0.0:1789760714.442506:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789760714.442511:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798200832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.442518:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760714.442546:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798200832:12345-0@lo:400:kworker.0 Request processed in 35us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.442552:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789760714.442557:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798200576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760714.442562:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798201344 00000100:00100000:0.0:1789760714.442564:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798201344 00000100:00100000:2.0:1789760714.442580:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798201856 00000100:00100000:0.0:1789760714.442583:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798200960 00000100:00100000:2.0:1789760714.442583:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798201856 00000100:00100000:0.0:1789760714.442584:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798200960 00000100:00100000:0.0:1789760714.442593:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798201216 00000100:00100000:0.0:1789760714.442595:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798201216 00000100:00100000:2.0:1789760714.442597:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798201728 00000100:00100000:2.0:1789760714.442599:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798201728 00000100:00100000:0.0:1789760714.442607:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789760714.442612:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798201344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760714.442639:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798201344:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.442682:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798201088 00000100:00100000:3.0:1789760714.442686:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798201088 00000100:00100000:3.0:1789760714.442718:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789760714.442725:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798201088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760714.442731:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798200704 00000100:00100000:1.0:1789760714.442736:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798200704 00000100:00100000:3.0:1789760714.442769:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798201088:12345-0@lo:400:kworker.0 Request processed in 45us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760714.442774:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789760714.442780:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789760714.442810:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798200704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760714.442858:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798200704:12345-0@lo:400:kworker.0 Request processed in 76us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760714.442865:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789760714.442918:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798200704:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.443457:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789760714.443466:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798200960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.443514:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798200960:12345-0@lo:400:kworker.0 Request processed in 50us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.443521:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789760714.443536:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789760714.443549:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798201856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.443583:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798201856:12345-0@lo:400:kworker.0 Request processed in 37us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.443588:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789760714.443602:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789760714.443608:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798201216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.443659:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798201216:12345-0@lo:400:kworker.0 Request processed in 51us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.443664:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789760714.443676:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789760714.443683:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798201728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.443712:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798201728:12345-0@lo:400:kworker.0 Request processed in 30us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.443718:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789760714.443746:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798201472 00000100:00100000:2.0:1789760714.443750:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798201472 00000100:00100000:2.0:1789760714.443783:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798201984 00000100:00100000:2.0:1789760714.443806:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798201984 00000100:00100000:2.0:1789760714.443828:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798201600 00000100:00100000:2.0:1789760714.443831:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798201600 00000100:00100000:2.0:1789760714.443854:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789760714.443863:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798201472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.443911:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798201472:12345-0@lo:400:kworker.0 Request processed in 51us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.443917:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789760714.443930:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789760714.443936:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798201984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.443963:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798201984:12345-0@lo:400:kworker.0 Request processed in 28us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.443970:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789760714.443980:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789760714.443986:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798201600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.444018:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798201600:12345-0@lo:400:kworker.0 Request processed in 32us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.444023:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789760714.444063:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798200832:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.444075:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798201344:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.444098:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798201856:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.446487:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798201088:0@lo:400:kworker.0 00000100:00100000:0.0:1789760714.446753:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:0.0:1789760714.446814:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760714.446818:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760714.446822:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760714.446824:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760714.447436:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798201216:0@lo:400:kworker.0 00000100:00100000:3.0:1789760714.447486:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798201728:0@lo:400:kworker.0 00000100:00100000:3.0:1789760714.447957:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798202112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760714.448018:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760714.448132:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798202112 00000100:00100000:0.0:1789760714.448139:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798202112 00000100:00100000:0.0:1789760714.448184:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789760714.448194:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798202112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760714.448219:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760714.448268:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798202112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.448283:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789760714.448359:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798202112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760714.448924:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798201600:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.448938:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798200960:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.448949:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798201472:0@lo:400:kworker.0 00000100:00100000:2.0:1789760714.448959:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57a223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798201984:0@lo:400:kworker.0 00000001:00080000:0.0:1789760714.473441:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967339 is committed 00010000:00010000:0.0:1789760714.481134:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a3b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739857a34 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.481166:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e543c0a500) 00010000:00010000:0.0:1789760714.481173:0:6450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.481184:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.481194:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.481232:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760714.481350:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798200448:12345-0@lo:103:ldlm_bl.0 Request processed in 49998us (50147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.481362:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789760714.481474:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798200448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760714.481558:0:12655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.481568:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.481966:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12655:1876699798202240:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789760714.482023:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.482058:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760714.482175:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798202240 00000100:00100000:0.0:1789760714.482185:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798202240 00000100:00100000:0.0:1789760714.482238:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789760714.482248:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12655:x1876699798202240:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789760714.482422:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12655:x1876699798202240:12345-0@lo:1000:mdt00_004.0 Request processed in 175us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.482430:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789760714.482530:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12655:1876699798202240:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789760714.482584:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a6c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482598:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a6c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482609:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a6c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482624:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482631:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482638:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482645:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482652:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760714.482657:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482666:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482680:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760714.482683:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760714.482696:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482703:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5e00/0xc2b9a3a739857a5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482717:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482724:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482730:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482735:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760714.482738:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482744:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482753:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e543c0a500) 00010000:00010000:2.0:1789760714.482755:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760714.482758:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.482764:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5000/0xc2b9a3a739857a65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.483081:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4800/0xc2b9a3a739857a57 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a59 expref: 7 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.483113:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a6c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a59 expref: 6 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.483122:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e543c0a600) 00010000:00010000:2.0:1789760714.483124:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760714.483127:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540030a00, rc 0) 00000100:00100000:2.0:1789760714.483219:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11897:x1876699777169536:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 60327us (60565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.483226:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:3.0:1789760714.486167:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.486299:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777169792 00000100:00100000:2.0:1789760714.486321:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777169792 00000100:00100000:2.0:1789760714.486624:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:2.0:1789760714.486638:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11897:x1876699777169792:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760714.486669:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.486694:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e540031c00/0xc2b9a3a739857a73 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a60 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760714.486866:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00010000:00010000:2.0:1789760714.486900:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e540031c00/0xc2b9a3a739857a73 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a60 expref: 8 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.486916:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.486920:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760714.486925:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e540031c00/0xc2b9a3a739857a73 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a60 expref: 8 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.486975:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540031c00, rc 0) 00000100:00100000:2.0:1789760714.487048:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11897:x1876699777169792:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 414us (895us total) trans 0 rc 301/301 00000100:00100000:2.0:1789760714.487057:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:0.0:1789760714.490284:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.490410:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777169920 00000100:00100000:2.0:1789760714.490423:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777169920 00000100:00100000:2.0:1789760714.490499:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:2.0:1789760714.490510:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11897:x1876699777169920:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760714.490539:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.490564:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030400/0xc2b9a3a739857a7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a67 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.490654:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.490673:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.490688:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760714.490731:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760714.490736:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760714.490771:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.490839:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030400/0xc2b9a3a739857a7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.490888:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 7 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.490907:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760714.490910:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760714.490915:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540031400, rc 0) 00000100:00100000:2.0:1789760714.490983:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11897:x1876699777169920:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 475us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.490992:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:1.0:1789760714.494383:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.494529:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777170176 00000100:00100000:2.0:1789760714.494542:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777170176 00000100:00100000:2.0:1789760714.494622:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:2.0:1789760714.494633:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11897:x1876699777170176:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760714.494660:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.494685:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030600/0xc2b9a3a739857a88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a6e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.494776:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.494951:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.494968:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.494988:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.495016:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.495023:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.495324:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857a9d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496856:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857a9d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496873:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857a9d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496900:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496908:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496915:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496923:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496930:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760714.496935:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496944:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.496986:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760714.496990:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760714.496996:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497003:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030c00/0xc2b9a3a739857a8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497022:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497029:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497034:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497040:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540031a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760714.497042:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497049:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497057:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e543c0af00) 00010000:00010000:2.0:1789760714.497059:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760714.497062:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497069:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031a00/0xc2b9a3a739857a96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497153:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030600/0xc2b9a3a739857a88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a6e expref: 9 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497171:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857a9d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a6e expref: 8 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.497180:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e543c0a600) 00010000:00010000:2.0:1789760714.497182:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760714.497184:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3eda00, rc 0) 00000100:00100000:2.0:1789760714.497515:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11897:x1876699777170176:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2881us (3154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.497525:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:1.0:1789760714.517911:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.517999:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760714.518026:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777170560 00000100:00100000:3.0:1789760714.518040:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777170560 00000100:00100000:2.0:1789760714.518137:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777170432 00000100:00100000:2.0:1789760714.518142:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777170432 00000100:00100000:2.0:1789760714.518195:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:2.0:1789760714.518206:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11897:x1876699777170432:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760714.518230:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.518256:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857aa4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a75 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.518335:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:3.0:1789760714.518345:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2405:x1876699777170560:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760714.518358:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760714.518387:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857a9d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a6e expref: 8 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.518409:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e543c0a600) 00010000:00010000:3.0:1789760714.518414:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1789760714.518505:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00000100:00100000:3.0:1789760714.518534:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777170560:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 189us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.518555:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00010000:00010000:2.0:1789760714.518734:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857aa4 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a75 expref: 9 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.518746:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.518749:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760714.518761:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857aa4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a75 expref: 9 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.518773:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ec000, rc 0) 00000100:00100000:2.0:1789760714.518888:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11897:x1876699777170432:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 683us (890us total) trans 4294967334 rc 301/301 00000100:00100000:2.0:1789760714.518895:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:0.0:1789760714.524255:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.524734:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777170816 00000100:00100000:1.0:1789760714.524975:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777170816 00000100:00100000:1.0:1789760714.525459:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:1.0:1789760714.525473:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11897:x1876699777170816:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1789760714.525584:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.525607:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.525622:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760714.525986:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fda67c3c reply state 000000009bf620b3 transno 4294967335 ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.526003:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.526023:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:1.0:1789760714.526026:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1789760714.526031:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789760714.526040:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00000100:00100000:1.0:1789760714.526143:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11897:x1876699777170816:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 673us (1902us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789760714.526151:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:0.0:1789760714.529318:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.529506:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777171072 00000100:00100000:2.0:1789760714.529519:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777171072 00000100:00100000:2.0:1789760714.529802:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:2.0:1789760714.529817:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11897:x1876699777171072:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1789760714.530182:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11897:x1876699777171072:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 368us (886us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789760714.530192:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:3.0:1789760714.538406:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.538490:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777171200 00000100:00100000:2.0:1789760714.538504:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777171200 00000100:00100000:2.0:1789760714.538582:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:2.0:1789760714.538595:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11898:x1876699777171200:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:2.0:1789760714.538640:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.538671:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a7c expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.538761:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857ac0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.538779:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857ac0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.538978:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857ac0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760714.539026:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00000004:00200000:2.0:1789760714.539030:0:12655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760714.539056:0:12655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857ac0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.539088:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a7c expref: 13 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.539117:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857ac0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a7c expref: 12 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.539127:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.539130:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760714.539134:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ece00, rc 0) 00000100:00100000:2.0:1789760714.539330:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11898:x1876699777171200:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 737us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.539339:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:3.0:1789760714.546938:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.547516:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777171456 00000100:00100000:2.0:1789760714.547530:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777171456 00000100:00100000:2.0:1789760714.547696:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:2.0:1789760714.547709:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11898:x1876699777171456:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:2.0:1789760714.548034:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760714.548072:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857ac0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a7c expref: 12 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.548123:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.548129:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760714.548163:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.548179:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.548190:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760714.548561:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de7ac8b3 reply state 00000000b711e200 transno 4294967337 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.548575:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.548581:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.548584:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789760714.548587:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760714.548596:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00000100:00100000:2.0:1789760714.548973:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11898:x1876699777171456:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 1263us (2046us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789760714.548981:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:1.0:1789760714.596942:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760714.597485:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777171584 00000100:00100000:3.0:1789760714.597500:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777171584 00000100:00100000:3.0:1789760714.597569:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:3.0:1789760714.597581:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11902:x1876699777171584:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:3.0:1789760714.597706:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760714.597734:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857ace lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a83 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.597863:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.597881:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.597895:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.597912:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.597919:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.597927:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.598891:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857ae3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.598920:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857ae3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.598930:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857ae3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760714.598961:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857ae3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.598978:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.598985:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.598992:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.598998:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760714.599003:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599011:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599026:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760714.599030:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760714.599035:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599041:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599078:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599084:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599091:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599096:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760714.599100:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599106:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599114:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16000) 00010000:00010000:3.0:1789760714.599117:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760714.599120:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599127:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857adc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599169:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857ace lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a83 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599183:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857ae3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a83 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.599201:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e543c0a600) 00010000:00010000:3.0:1789760714.599204:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789760714.599207:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5c00, rc 0) 00000100:00100000:3.0:1789760714.599308:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11902:x1876699777171584:12345-192.168.203.38@tcp:101:touch.500 Request processed in 1719us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.599317:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:1.0:1789760714.603909:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.603963:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.604007:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777171712 00000100:00100000:2.0:1789760714.604021:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777171712 00000100:00100000:3.0:1789760714.604075:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777171840 00000100:00100000:3.0:1789760714.604082:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777171840 00000100:00100000:2.0:1789760714.604088:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:2.0:1789760714.604102:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11902:x1876699777171712:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:2.0:1789760714.604132:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789760714.604141:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1789760714.604152:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777171840:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760714.604164:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857aea lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a8a expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.604169:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760714.604253:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed800/0xc2b9a3a739857af1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.604268:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed800/0xc2b9a3a739857af1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.604282:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed800/0xc2b9a3a739857af1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.604319:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857ae3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a83 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760714.604335:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00000004:00200000:2.0:1789760714.604341:0:12655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00010000:00010000:3.0:1789760714.604342:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e543c0a600) 00010000:00010000:3.0:1789760714.604348:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760714.604405:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857aea lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a8a expref: 15 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.604418:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777171840:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 267us (452us total) trans 0 rc 0/0 00010000:00010000:2.0:1789760714.604425:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed800/0xc2b9a3a739857af1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a8a expref: 14 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.604432:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00010000:00010000:2.0:1789760714.604441:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.604445:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1789760714.604448:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ed800, rc 0) 00000100:00100000:2.0:1789760714.604475:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11902:x1876699777171712:12345-192.168.203.38@tcp:101:touch.500 Request processed in 379us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.604482:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:0.0:1789760714.610455:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.610765:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777172096 00000100:00100000:2.0:1789760714.610815:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777172096 00000100:00100000:2.0:1789760714.610886:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:2.0:1789760714.610899:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11902:x1876699777172096:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:2.0:1789760714.610950:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.610979:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec200/0xc2b9a3a739857af8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a91 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.611170:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 3/0,1 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.611317:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.611335:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.611572:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.611596:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.611609:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760714.612063:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798202368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789760714.612130:0:9081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.612201:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798202368 00000100:00100000:2.0:1789760714.612207:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5602169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760714.612212:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798202368 00000100:00100000:3.0:1789760714.612348:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789760714.612358:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798202368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789760714.612486:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:9081:x1876699798202368:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.612507:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789760714.616175:0:9081:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967339 gen 2 00000004:00080000:2.0:1789760714.616189:0:9081:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967339 committed transno 4294967339 00000100:00100000:2.0:1789760714.616220:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9081:1876699798202368:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1789760714.617059:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4:0x0], index 1: 0 00000004:00080000:2.0:1789760714.617070:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789760714.617279:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec800/0xc2b9a3a739857b0d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.617295:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec800/0xc2b9a3a739857b0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.617318:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec800/0xc2b9a3a739857b0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.617359:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.617366:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.617372:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.617379:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.617385:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ede00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760714.617390:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.617397:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.620990:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.621000:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760714.621008:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 3/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.621038:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857aff lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760714.621060:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064737de8 reply state 0000000057ae9755 transno 4294967338 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.621073:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.621081:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x2ab29dc6 (ffff97e543c0af00) 00010000:00010000:2.0:1789760714.621083:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760714.621087:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789760714.621141:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec200/0xc2b9a3a739857af8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a91 expref: 17 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.621158:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec800/0xc2b9a3a739857b0d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a91 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.621165:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e543c0a500) 00010000:00010000:2.0:1789760714.621167:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760714.621169:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ec800, rc 0) 00000100:00100000:2.0:1789760714.621254:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+17:11902:x1876699777172096:12345-192.168.203.38@tcp:101:touch.500 Request processed in 10358us (10814us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789760714.621263:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:1.0:1789760714.625968:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760714.626074:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777172352 00000100:00100000:3.0:1789760714.626084:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777172352 00000100:00100000:3.0:1789760714.626140:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:3.0:1789760714.626151:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+17:11902:x1876699777172352:12345-192.168.203.38@tcp:36:touch.500 00010000:00010000:3.0:1789760714.626212:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760714.626238:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec800/0xc2b9a3a739857b0d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a91 expref: 17 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.626258:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e543c0a500) 00010000:00010000:3.0:1789760714.626268:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760714.626320:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.626332:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.626341:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760714.626477:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fba80870 reply state 000000008f5084a1 transno 4294967339 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.626490:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.626496:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:3.0:1789760714.626499:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789760714.626502:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760714.626597:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11902:x1876699777172352:12345-192.168.203.38@tcp:36:touch.500 Request processed in 448us (647us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1789760714.626604:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:1.0:1789760714.632204:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.632292:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777172480 00000100:00100000:0.0:1789760714.632312:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777172480 00000100:00100000:0.0:1789760714.632375:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:0.0:1789760714.632385:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11902:x1876699777172480:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:0.0:1789760714.632421:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760714.632440:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542800/0xc2b9a3a739857b22 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a98 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.632496:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542800/0xc2b9a3a739857b22 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a98 expref: 19 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.632511:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542800/0xc2b9a3a739857b22 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a98 expref: 19 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.632530:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760714.632534:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789760714.632537:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542800, rc 0) 00000100:00100000:0.0:1789760714.632594:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11902:x1876699777172480:12345-192.168.203.38@tcp:101:touch.500 Request processed in 210us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.632601:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:0.0:1789760714.640634:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.640677:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.640839:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777172608 00000100:00100000:2.0:1789760714.640849:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777172608 00000100:00100000:2.0:1789760714.640888:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777172864 00000100:00100000:2.0:1789760714.640891:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777172864 00000100:00100000:2.0:1789760714.640920:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1789760714.640941:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1876699777172608:12345-192.168.203.38@tcp:8:touch.500 00010000:00080000:2.0:1789760714.640986:0:8110:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:2.0:1789760714.641015:0:8110:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739857b29 00002000:00100000:2.0:1789760714.641028:0:8110:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ac82f857-edfe-4201-bbe8-4599ba569acb/ffff97e54991b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 30670848 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760714.641038:0:8110:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760714.641262:0:8110:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789760714.641292:0:8110:0:(import.c:65:import_set_state_nolock()) ffff97e54991f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760714.641362:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777172608:12345-192.168.203.38@tcp:8:touch.500 Request processed in 421us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.641371:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1789760714.641388:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:2.0:1789760714.641392:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1876699777172864:12345-192.168.203.38@tcp:8:touch.500 00010000:00080000:2.0:1789760714.641407:0:8110:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:2.0:1789760714.641423:0:8110:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739857b30 00002000:00100000:2.0:1789760714.641429:0:8110:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ac82f857-edfe-4201-bbe8-4599ba569acb/ffff97e549918000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 201064448 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760714.641444:0:8110:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760714.641495:0:8110:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789760714.641511:0:8110:0:(import.c:65:import_set_state_nolock()) ffff97e54991f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760714.641536:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777172864:12345-192.168.203.38@tcp:8:touch.500 Request processed in 142us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.641542:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:1.0:1789760714.645352:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.645392:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.645545:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777172992 00000100:00100000:0.0:1789760714.645553:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777172992 00000100:00100000:0.0:1789760714.645622:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777172736 00000100:00100000:0.0:1789760714.645626:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777172736 00000100:00100000:0.0:1789760714.645666:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:0.0:1789760714.645676:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:0:x1876699777172992:12345-192.168.203.38@tcp:2:touch.500 00000100:00100000:3.0:1789760714.646129:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:3.0:1789760714.646139:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:0:x1876699777172736:12345-192.168.203.38@tcp:2:touch.500 00000100:00080000:1.0:1789760714.646375:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760714.646380:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789760714.693885:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000001:00080000:3.0:1789760714.693904:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000100:00100000:1.0:1789760714.694287:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:0:x1876699777172736:12345-192.168.203.38@tcp:2:touch.500 Request processed in 48032us (48776us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789760714.694309:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000001:00080000:1.0:1789760714.706975:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967427 is committed 00000001:00100000:1.0:1789760714.706993:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000001:00100000:1.0:1789760714.707000:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:1.0:1789760714.707004:0:8141:0:(genops.c:885:class_export_put()) final put ffff97e543260800/ac82f857-edfe-4201-bbe8-4599ba569acb 00000100:00100000:2.0:1789760714.707232:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:0:x1876699777172992:12345-192.168.203.38@tcp:2:touch.500 Request processed in 61553us (61885us total) trans 4294967427 rc 0/0 00000100:00100000:2.0:1789760714.707243:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000020:00000080:3.0:1789760714.707332:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e543260800/ac82f857-edfe-4201-bbe8-4599ba569acb for lustre-OST0000 00000020:00000080:3.0:1789760714.707379:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e543262000 for lustre-OST0000 00000100:00100000:1.0:1789760714.710115:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.710203:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777173248 00000100:00100000:0.0:1789760714.710214:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777173248 00000100:00100000:0.0:1789760714.710285:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1789760714.710296:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11902:x1876699777173248:12345-192.168.203.38@tcp:35:touch.500 00000100:00100000:0.0:1789760714.710749:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11902:x1876699777173248:12345-192.168.203.38@tcp:35:touch.500 Request processed in 454us (646us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789760714.710757:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1789760714.760405:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.763334:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777173504 00000100:00100000:2.0:1789760714.763355:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777173504 00000100:00100000:2.0:1789760714.763542:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:2.0:1789760714.763555:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11906:x1876699777173504:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:2.0:1789760714.763589:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.763617:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec200/0xc2b9a3a739857b37 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211a9f expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.763782:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.763835:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.763850:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.763866:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.763873:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.763880:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760714.764357:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5:0x0], index 0: 0 00000004:00080000:2.0:1789760714.764365:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789760714.764552:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b4c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764575:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b4c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764586:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b4c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764626:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764634:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764641:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764648:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764655:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ede00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760714.764667:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764675:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764688:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.764691:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760714.764695:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 3/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764703:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b3e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760714.764727:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000733764b7 reply state 0000000093db1e95 transno 4294967341 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764740:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764746:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x151ecd9f (ffff97e543c0ab00) 00010000:00010000:2.0:1789760714.764749:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760714.764751:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789760714.764837:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec200/0xc2b9a3a739857b37 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a9f expref: 23 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764855:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b4c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a9f expref: 22 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.764862:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0a300) 00010000:00010000:2.0:1789760714.764864:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760714.764867:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ed000, rc 0) 00000100:00100000:2.0:1789760714.764962:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11906:x1876699777173504:12345-192.168.203.38@tcp:101:touch.500 Request processed in 1409us (4572us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789760714.764970:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:3.0:1789760714.768461:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.768522:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777173760 00000100:00100000:2.0:1789760714.768536:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777173760 00000100:00100000:2.0:1789760714.768615:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:2.0:1789760714.768627:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11906:x1876699777173760:12345-192.168.203.38@tcp:36:touch.500 00010000:00010000:2.0:1789760714.768703:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760714.768737:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b4c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a9f expref: 23 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.768777:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0a300) 00010000:00010000:2.0:1789760714.768830:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760714.768888:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.768904:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.768916:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760714.769090:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd8a0727 reply state 00000000280ffb41 transno 4294967342 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.769103:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.769110:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760714.769113:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760714.769116:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760714.769271:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11906:x1876699777173760:12345-192.168.203.38@tcp:36:touch.500 Request processed in 646us (825us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789760714.769280:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:1.0:1789760714.774759:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.774914:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777173888 00000100:00100000:2.0:1789760714.774928:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777173888 00000100:00100000:2.0:1789760714.775125:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:2.0:1789760714.775137:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11906:x1876699777173888:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:2.0:1789760714.775168:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.775216:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec200/0xc2b9a3a739857b61 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211aa6 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.775307:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec200/0xc2b9a3a739857b61 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aa6 expref: 25 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.775325:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec200/0xc2b9a3a739857b61 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aa6 expref: 25 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.775349:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760714.775352:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789760714.775356:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ec200, rc 0) 00000100:00100000:2.0:1789760714.775438:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11906:x1876699777173888:12345-192.168.203.38@tcp:101:touch.500 Request processed in 303us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.775445:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:0.0:1789760714.779139:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.779234:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760714.779508:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777174016 00000100:00100000:3.0:1789760714.779521:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777174016 00000100:00100000:3.0:1789760714.779682:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777174144 00000100:00100000:3.0:1789760714.779686:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777174144 00000100:00100000:1.0:1789760714.779725:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:1.0:1789760714.779739:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777174016:12345-192.168.203.38@tcp:2:touch.500 00000100:00100000:1.0:1789760714.780223:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777174016:12345-192.168.203.38@tcp:2:touch.500 Request processed in 485us (1097us total) trans 4294967428 rc 0/0 00000100:00100000:1.0:1789760714.780231:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:1.0:1789760714.780253:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:1.0:1789760714.780260:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777174144:12345-192.168.203.38@tcp:2:touch.500 00000100:00100000:1.0:1789760714.780467:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777174144:12345-192.168.203.38@tcp:2:touch.500 Request processed in 207us (1233us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789760714.780474:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:2.0:1789760714.784166:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760714.784413:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777174400 00000100:00100000:3.0:1789760714.784427:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777174400 00000100:00100000:3.0:1789760714.784487:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:3.0:1789760714.784498:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565dda050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11906:x1876699777174400:12345-192.168.203.38@tcp:35:touch.500 00000100:00100000:3.0:1789760714.785042:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565dda050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+26:11906:x1876699777174400:12345-192.168.203.38@tcp:35:touch.500 Request processed in 543us (888us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789760714.786469:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1789760714.825437:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.825584:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777174656 00000100:00100000:2.0:1789760714.825608:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777174656 00000100:00100000:2.0:1789760714.825682:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:2.0:1789760714.825694:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+26:11910:x1876699777174656:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1789760714.825724:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.825752:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211aad expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760714.825919:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00010000:00010000:2.0:1789760714.826189:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aad expref: 28 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.826382:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e543c0a300) 00010000:00010000:2.0:1789760714.826386:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760714.826392:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aad expref: 28 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.826416:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ed000, rc 0) 00000100:00100000:2.0:1789760714.826573:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11910:x1876699777174656:12345-192.168.203.38@tcp:101:bash.0 Request processed in 880us (1149us total) trans 4294967344 rc 301/301 00000100:00100000:2.0:1789760714.826582:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:1.0:1789760714.833758:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.834023:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777174784 00000100:00100000:2.0:1789760714.834039:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777174784 00000100:00100000:2.0:1789760714.834330:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:2.0:1789760714.834345:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11910:x1876699777174784:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1789760714.834377:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.834407:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ab4 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.834494:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b7d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.834511:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b7d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.834527:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b7d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760714.834568:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00000004:00200000:2.0:1789760714.834587:0:12655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760714.834627:0:12655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b7d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.834656:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857b76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ab4 expref: 29 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.834685:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b7d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ab4 expref: 28 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.834695:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760714.834698:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760714.834701:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ede00, rc 0) 00000100:00100000:2.0:1789760714.834846:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11910:x1876699777174784:12345-192.168.203.38@tcp:101:bash.0 Request processed in 439us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.834855:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:1.0:1789760714.839374:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760714.839481:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777174912 00000100:00100000:3.0:1789760714.839494:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777174912 00000100:00100000:3.0:1789760714.839606:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1789760714.839618:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11910:x1876699777174912:12345-192.168.203.38@tcp:37:bash.0 00000100:00100000:3.0:1789760714.844071:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11910:x1876699777174912:12345-192.168.203.38@tcp:37:bash.0 Request processed in 4433us (4690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.844103:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:1.0:1789760714.848001:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.848103:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777175168 00000100:00100000:2.0:1789760714.848116:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777175168 00000100:00100000:2.0:1789760714.848185:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1789760714.848198:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11910:x1876699777175168:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:2.0:1789760714.848583:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11910:x1876699777175168:12345-192.168.203.38@tcp:35:bash.0 Request processed in 386us (593us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789760714.848592:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1789760714.858293:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.858474:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777175296 00000100:00100000:0.0:1789760714.858486:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777175296 00000100:00100000:0.0:1789760714.858545:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:0.0:1789760714.858553:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11910:x1876699777175296:12345-192.168.203.38@tcp:101:chmod.500 00010000:00010000:0.0:1789760714.858583:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760714.858615:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857b84 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211abb expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.858687:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.858705:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.858718:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.858747:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.858755:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.858762:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859029:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543e00/0xc2b9a3a739857b99 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859048:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543e00/0xc2b9a3a739857b99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859060:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543e00/0xc2b9a3a739857b99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760714.859098:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789760714.859103:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760714.859145:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543e00/0xc2b9a3a739857b99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859159:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543e00/0xc2b9a3a739857b99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859169:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859175:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859589:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859596:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760714.859600:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859608:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859699:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:0.0:1789760714.859703:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760714.859708:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859715:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542e00/0xc2b9a3a739857b8b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859860:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859867:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859873:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859879:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760714.859882:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859901:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859911:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x2ab29dc6 (ffff97e543c0af00) 00010000:00010000:0.0:1789760714.859913:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760714.859916:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859922:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857b92 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859960:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857b84 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211abb expref: 31 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859975:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543e00/0xc2b9a3a739857b99 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211abb expref: 30 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.859982:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760714.859984:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760714.859987:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548543e00, rc 0) 00000100:00100000:0.0:1789760714.860167:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11910:x1876699777175296:12345-192.168.203.38@tcp:101:chmod.500 Request processed in 1611us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.860176:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:0.0:1789760714.863495:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.863547:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.863661:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777175552 00000100:00100000:1.0:1789760714.863675:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777175552 00000100:00100000:1.0:1789760714.863738:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777175424 00000100:00100000:1.0:1789760714.863742:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777175424 00000100:00100000:1.0:1789760714.863779:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1789760714.863827:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777175552:12345-192.168.203.38@tcp:101:chmod.500 00010000:00010000:1.0:1789760714.863851:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760714.863878:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ac9 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760714.863910:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x6aad94ca, atime: 0x6aad94ca, ctime: 0x6aad94ca, blocks: 0x1 00010000:00010000:1.0:1789760714.863935:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1789760714.863940:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760714.863952:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.863975:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.863992:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f4000, rc 0) 00000100:00100000:1.0:1789760714.864074:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777175552:12345-192.168.203.38@tcp:101:chmod.500 Request processed in 284us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760714.864081:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1789760714.864103:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:1.0:1789760714.864127:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777175424:12345-192.168.203.38@tcp:101:chmod.500 00010000:00010000:1.0:1789760714.864136:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760714.864149:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ac2 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760714.864167:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4:0x0] initial LVB size: 0, mtime: 0x6aad94ca, atime: 0x6aad94ca, ctime: 0x6aad94ca, blocks: 0x1 00010000:00010000:1.0:1789760714.864178:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1789760714.864182:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760714.864188:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.864203:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.864212:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f5800, rc 0) 00000100:00100000:1.0:1789760714.864233:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777175424:12345-192.168.203.38@tcp:101:chmod.500 Request processed in 106us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760714.864239:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:2.0:1789760714.867739:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.867908:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777175808 00000100:00100000:1.0:1789760714.867921:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777175808 00000100:00100000:1.0:1789760714.867992:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:1.0:1789760714.868005:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11910:x1876699777175808:12345-192.168.203.38@tcp:36:chmod.500 00010000:00010000:1.0:1789760714.868076:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760714.868112:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543e00/0xc2b9a3a739857b99 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211abb expref: 30 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.868160:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:1.0:1789760714.868166:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760714.868203:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.868218:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.868230:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760714.868498:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000449be9af reply state 000000006d2d283c transno 4294967346 ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.868514:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.868521:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:1.0:1789760714.868523:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789760714.868526:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760714.868635:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+31:11910:x1876699777175808:12345-192.168.203.38@tcp:36:chmod.500 Request processed in 633us (911us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789760714.868644:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1789760714.870218:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.870478:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777175936 00000100:00100000:0.0:1789760714.870489:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777175936 00000100:00100000:2.0:1789760714.870518:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.871160:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777176064 00000100:00100000:2.0:1789760714.871178:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:0.0:1789760714.871182:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777176064 00000100:00100000:2.0:1789760714.871207:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777175936:12345-192.168.203.38@tcp:2:chmod.500 00000100:00100000:0.0:1789760714.871282:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:0.0:1789760714.871296:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777176064:12345-192.168.203.38@tcp:2:chmod.500 00002000:00010000:2.0:1789760714.871497:0:9533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760714.871500:0:9533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb mtime from disk: 1789760714 -> 1789760714 00002000:00010000:2.0:1789760714.871503:0:9533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb atime from disk: 1789760714 -> 1789760714 00002000:00010000:2.0:1789760714.871506:0:9533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb ctime from disk: 1789760714 -> 1789760714 00002000:00010000:2.0:1789760714.871508:0:9533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760714.871611:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2405:x1876699777175936:12345-192.168.203.38@tcp:2:chmod.500 Request processed in 410us (1400us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789760714.871620:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00002000:00010000:0.0:1789760714.871656:0:8114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789760714.871661:0:8114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.871664:0:8114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.871666:0:8114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.871669:0:8114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789760714.871694:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2405:x1876699777176064:12345-192.168.203.38@tcp:2:chmod.500 Request processed in 402us (1178us total) trans 4294967429 rc 0/0 00000100:00100000:0.0:1789760714.871703:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:2.0:1789760714.876208:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760714.876276:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777176192 00000100:00100000:3.0:1789760714.876290:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777176192 00000100:00100000:3.0:1789760714.876370:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:3.0:1789760714.876382:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+31:11910:x1876699777176192:12345-192.168.203.38@tcp:101:chmod.500 00010000:00010000:3.0:1789760714.876413:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760714.876437:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857bb5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ad0 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.876914:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.876935:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.876955:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.876969:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.876977:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.876983:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877127:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857bca lrc: 3/1,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877153:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857bca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877159:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857bca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760714.877198:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x8:0x0]: returning size 0 00000004:00200000:0.0:1789760714.877204:0:12655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760714.877236:0:12655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857bca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877250:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857bca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877261:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877269:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877275:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877281:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877288:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760714.877293:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877318:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877344:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:0.0:1789760714.877347:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760714.877352:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 3/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877360:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542000/0xc2b9a3a739857bbc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877377:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877383:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877389:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877395:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760714.877398:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877404:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877412:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x151ecd9f (ffff97e543c0ab00) 00010000:00010000:0.0:1789760714.877415:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760714.877418:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877423:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bc3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877466:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4600/0xc2b9a3a739857bb5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad0 expref: 33 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877480:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857bca lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad0 expref: 32 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.877486:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:0.0:1789760714.877487:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760714.877489:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542200, rc 0) 00000100:00100000:0.0:1789760714.877558:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+32:11910:x1876699777176192:12345-192.168.203.38@tcp:101:chmod.500 Request processed in 1178us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.877563:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:1.0:1789760714.881295:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.881872:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760714.882067:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777176320 00000100:00100000:3.0:1789760714.882080:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777176320 00000100:00100000:3.0:1789760714.882153:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777176448 00000100:00100000:3.0:1789760714.882157:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777176448 00000100:00100000:3.0:1789760714.882249:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:3.0:1789760714.882263:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2404:x1876699777176320:12345-192.168.203.38@tcp:101:chmod.500 00010000:00010000:3.0:1789760714.882290:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789760714.882294:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:2.0:1789760714.882319:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777176448:12345-192.168.203.38@tcp:101:chmod.500 00010000:00010000:3.0:1789760714.882326:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ad7 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.882330:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760714.882348:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ade expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760714.882365:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x6aad94ca, atime: 0x6aad94ca, ctime: 0x6aad94ca, blocks: 0x1 00002000:00010000:2.0:1789760714.882373:0:8110:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5:0x0] initial LVB size: 0, mtime: 0x6aad94ca, atime: 0x6aad94ca, ctime: 0x6aad94ca, blocks: 0x1 00010000:00010000:2.0:1789760714.882394:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1789760714.882394:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1789760714.882406:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760714.882406:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760714.882427:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.882428:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 9 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.882465:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 9 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.882478:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.882528:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ec400, rc 0) 00010000:00010000:3.0:1789760714.882528:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5400, rc 0) 00000100:00100000:2.0:1789760714.882606:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2403:x1876699777176448:12345-192.168.203.38@tcp:101:chmod.500 Request processed in 291us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.882615:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1789760714.885485:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777176320:12345-192.168.203.38@tcp:101:chmod.500 Request processed in 3198us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.885501:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1789760714.888023:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.888746:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777176704 00000100:00100000:0.0:1789760714.888760:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777176704 00000100:00100000:0.0:1789760714.888873:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:0.0:1789760714.888887:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+32:11910:x1876699777176704:12345-192.168.203.38@tcp:36:chmod.500 00010000:00010000:0.0:1789760714.888960:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760714.888998:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857bca lrc: 0/0,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad0 expref: 32 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.889021:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:0.0:1789760714.889027:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760714.889061:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.889077:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.889107:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760714.889875:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7e76fb8 reply state 0000000080228232 transno 4294967347 ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.889894:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.889902:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:0.0:1789760714.889905:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789760714.889908:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760714.890039:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+33:11910:x1876699777176704:12345-192.168.203.38@tcp:36:chmod.500 Request processed in 1153us (2029us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789760714.890056:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:2.0:1789760714.892122:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.892294:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777176832 00000100:00100000:0.0:1789760714.892316:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777176832 00000100:00100000:0.0:1789760714.892394:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:0.0:1789760714.892405:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2406:x1876699777176832:12345-192.168.203.38@tcp:2:chmod.500 00002000:00010000:0.0:1789760714.892643:0:8114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789760714.892647:0:8114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.892650:0:8114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.892652:0:8114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.892654:0:8114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789760714.892921:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2406:x1876699777176832:12345-192.168.203.38@tcp:2:chmod.500 Request processed in 516us (871us total) trans 4294967430 rc 0/0 00000100:00100000:0.0:1789760714.892930:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:3.0:1789760714.893281:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.893432:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777176960 00000100:00100000:0.0:1789760714.893438:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777176960 00000100:00100000:0.0:1789760714.893480:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:0.0:1789760714.893488:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2406:x1876699777176960:12345-192.168.203.38@tcp:2:chmod.500 00002000:00010000:0.0:1789760714.893624:0:8110:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789760714.893628:0:8110:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb mtime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.893630:0:8110:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb atime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.893632:0:8110:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb ctime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.893635:0:8110:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789760714.893675:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2406:x1876699777176960:12345-192.168.203.38@tcp:2:chmod.500 Request processed in 188us (395us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789760714.893683:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:2.0:1789760714.932929:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.933343:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777177216 00000100:00100000:1.0:1789760714.933361:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777177216 00000100:00100000:1.0:1789760714.933442:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:1.0:1789760714.933456:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+33:11914:x1876699777177216:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:1.0:1789760714.933505:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760714.933508:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789760714.933542:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ede00/0xc2b9a3a739857b7d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ab4 expref: 33 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.933566:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:1.0:1789760714.933572:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760714.933588:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857be6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ae5 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934161:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934177:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934189:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934199:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934207:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934213:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934293:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4a00/0xc2b9a3a739857bfb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934325:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4a00/0xc2b9a3a739857bfb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934342:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4a00/0xc2b9a3a739857bfb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760714.934355:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789760714.934473:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934482:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934488:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934494:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934501:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760714.934505:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934514:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934524:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:1.0:1789760714.934527:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760714.934531:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 3/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934537:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857bed lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934556:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934562:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934567:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934572:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760714.934575:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934581:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934589:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x2ab29dc6 (ffff97e543c0af00) 00010000:00010000:1.0:1789760714.934591:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760714.934604:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934611:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5400/0xc2b9a3a739857bf4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934653:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857be6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ae5 expref: 35 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934667:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4a00/0xc2b9a3a739857bfb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ae5 expref: 34 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.934688:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:1.0:1789760714.934690:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760714.934693:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f4a00, rc 0) 00000100:00100000:1.0:1789760714.934776:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+34:11914:x1876699777177216:12345-192.168.203.38@tcp:101:dd.500 Request processed in 1323us (1860us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789760714.934812:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:2.0:1789760714.936914:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.936999:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777177472 00000100:00100000:0.0:1789760714.937010:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777177472 00000100:00100000:0.0:1789760714.937076:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:0.0:1789760714.937086:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+34:11914:x1876699777177472:12345-192.168.203.38@tcp:36:dd.500 00010000:00010000:0.0:1789760714.937317:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760714.937564:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4a00/0xc2b9a3a739857bfb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ae5 expref: 34 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.937588:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760714.937593:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760714.937885:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.937902:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.937934:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760714.937993:0:12655:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967349 00000004:00010000:0.0:1789760714.938022:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000290f8072 reply state 0000000017aa333b transno 4294967350 ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.938036:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.938043:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760714.938045:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760714.938048:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760714.938516:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+36:11914:x1876699777177472:12345-192.168.203.38@tcp:36:dd.500 Request processed in 1428us (1609us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789760714.938526:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00000020:00080000:0.0:1789760714.938532:0:12655:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789760714.941197:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.941278:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777177600 00000100:00100000:1.0:1789760714.941292:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777177600 00000100:00100000:1.0:1789760714.941499:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:1.0:1789760714.941521:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11914:x1876699777177600:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:1.0:1789760714.941538:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760714.941555:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1fcef97/0xc2b9a3a739857c10 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211aec expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.941589:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 11 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.941598:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760714.941602:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760714.941608:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1fcef97/0xc2b9a3a739857c10 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aec expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.941947:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 11 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.941981:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 11 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760714.941994:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8112:1876699798202496:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760714.942079:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760714.944743:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8112:1876699798202496:192.168.203.38@tcp:104: 00010000:00010000:1.0:1789760714.944872:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1fcef97/0xc2b9a3a739857c10 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aec expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.944901:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f4400, rc 0) 00000100:00100000:1.0:1789760714.944977:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11914:x1876699777177600:12345-192.168.203.38@tcp:101:dd.500 Request processed in 3467us (3791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760714.944988:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:2.0:1789760714.945690:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.945921:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777177728 00000100:00100000:1.0:1789760714.945931:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777177728 00010000:00010000:1.0:1789760714.945970:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 11 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760714.946049:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:1.0:1789760714.946072:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2404:x1876699777177728:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760714.946090:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760714.946098:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 11 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.946130:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 11 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.946159:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000125765e5/0xc2b9a3a739857ba7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac2 expref: 11 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.946177:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760714.946183:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760714.946191:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1fcef97/0xc2b9a3a739857c10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aec expref: 10 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.946202:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1fcef97/0xc2b9a3a739857c10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aec expref: 10 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.946244:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c1fcef97/0xc2b9a3a739857c10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aec expref: 10 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760714.946260:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f950000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798202624:192.168.203.38@tcp:105: 00000100:00100000:1.0:1789760714.946527:0:6452:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760714.951018:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.951091:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777177856 00000100:00100000:0.0:1789760714.951103:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777177856 00000100:00100000:2.0:1789760714.951196:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760714.951218:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798202752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760714.951220:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:0.0:1789760714.951237:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11914:x1876699777177856:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760714.951260:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760714.951285:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857c17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211af3 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760714.951312:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.951372:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798202752 00000100:00100000:3.0:1789760714.951378:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798202752 00000100:00100000:3.0:1789760714.951422:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789760714.951431:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798202752:12345-0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789760714.951473:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 11 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00000024:3.0:1789760714.951485:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00010000:00010000:0.0:1789760714.951509:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760714.951514:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760714.951522:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857c17 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211af3 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.951547:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798202752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.951558:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00010000:0.0:1789760714.951561:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 11 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.951581:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 11 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760714.951595:0:8114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44bc44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8114:1876699798202880:192.168.203.38@tcp:104: 00000100:00100000:0.0:1789760714.951737:0:8114:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e543e53540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760714.951896:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798202752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760714.955199:0:8114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44bc44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8114:1876699798202880:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760714.955247:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857c17 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211af3 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.955272:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542000, rc 0) 00000100:00100000:1.0:1789760714.955479:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f950000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798202624:192.168.203.38@tcp:105: 00010000:00010000:1.0:1789760714.955497:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760714.955561:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2404:x1876699777177728:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 9490us (9874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.955564:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.955601:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:3.0:1789760714.955611:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777177984 00000100:00100000:3.0:1789760714.955620:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777177984 00010000:00010000:3.0:1789760714.955657:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 12 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.955691:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:3.0:1789760714.955701:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2403:x1876699777177984:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760714.955717:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760714.955730:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 12 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.955744:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 12 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.955772:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8726c6/0xc2b9a3a739857ba0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ac9 expref: 12 pid: 8112 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.955817:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760714.955823:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760714.955831:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211af3 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.955842:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211af3 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760714.955882:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211af3 expref: 11 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760714.955898:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fab6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798203008:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760714.955964:0:6451:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760714.956310:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11914:x1876699777177856:12345-192.168.203.38@tcp:101:dd.500 Request processed in 5061us (5290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760714.956320:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:0.0:1789760714.959173:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fab6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798203008:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760714.959204:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760714.959275:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2403:x1876699777177984:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 3574us (3712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760714.959287:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:3.0:1789760714.959330:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.961642:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777178240 00000100:00100000:2.0:1789760714.961657:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777178240 00002000:00010000:2.0:1789760714.961735:0:13385:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:2.0:1789760714.961741:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57fab6680 with x1876699777178240 ext(0->18446744073709551615) 00002000:00010000:2.0:1789760714.961756:0:13385:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57fab6680. 00000100:00100000:2.0:1789760714.961781:0:13385:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 3 deadline 0 time 391145985902 state 0x0 ref 1 00000100:00100000:2.0:1789760714.961838:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 3 deadline 391345985902 time 391145985902 state 0x1 ref 1 00000100:00100000:2.0:1789760714.961880:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 2 deadline 391345985902 time 391146088390 state 0x0 ref 1 00000100:00100000:2.0:1789760714.961901:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2404:x1876699777178240:12345-192.168.203.38@tcp:10:dd.500 00000100:00100000:3.0:1789760714.961931:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760714.961981:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777178112 00000100:00100000:0.0:1789760714.961987:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777178112 00002000:00010000:0.0:1789760714.962012:0:8118:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/4 (0->18446744073709551615) 00002000:00100000:0.0:1789760714.962016:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e4499dad80 with x1876699777178112 ext(0->18446744073709551615) 00002000:00010000:0.0:1789760714.962023:0:8118:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e4499dad80. 00000100:00100000:0.0:1789760714.962032:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 2 deadline 391346088390 time 391146088390 state 0x1 ref 2 00000100:00100000:0.0:1789760714.962079:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 1 deadline 391346088390 time 391146288709 state 0x0 ref 2 00000100:00100000:0.0:1789760714.962093:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2404:x1876699777178112:12345-192.168.203.38@tcp:10:dd.500 00002000:00010000:0.0:1789760714.962344:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789760714.962349:0:8118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb mtime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.962352:0:8118:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb atime from disk: 1789760714 -> 1789760714 00002000:00010000:2.0:1789760714.962354:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789760714.962355:0:8118:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb ctime from disk: 1789760714 -> 1789760714 00002000:00010000:0.0:1789760714.962362:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1789760714.962362:0:13385:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789760714 -> 1789760714 00002000:00010000:2.0:1789760714.962369:0:13385:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789760714 -> 1789760714 00002000:00010000:2.0:1789760714.962373:0:13385:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789760714 -> 1789760714 00002000:00010000:2.0:1789760714.962375:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760714.962447:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2404:x1876699777178240:12345-192.168.203.38@tcp:10:dd.500 Request processed in 555us (3126us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789760714.962457:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 0 00002000:00010000:2.0:1789760714.962461:0:13385:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:2.0:1789760714.962465:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57fab6680 with x1876699777178240 ext(0->18446744073709551615) 00002000:00010000:2.0:1789760714.962471:0:13385:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57fab6680. 00000100:00100000:0.0:1789760714.964482:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2404:x1876699777178112:12345-192.168.203.38@tcp:10:dd.500 Request processed in 2378us (2543us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789760714.964496:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1789760714.964503:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 1 deadline 391346088390 time 391146288709 state 0x2 ref 0 00002000:00010000:0.0:1789760714.964513:0:8118:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/4 (0->18446744073709551615) 00002000:00100000:0.0:1789760714.964516:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e4499dad80 with x1876699777178112 ext(0->18446744073709551615) 00002000:00010000:0.0:1789760714.964527:0:8118:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e4499dad80. 00000100:00100000:1.0:1789760714.986459:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760714.986534:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777178368 00000100:00100000:2.0:1789760714.986548:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777178368 00002000:00100000:2.0:1789760714.986677:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x4:0x0] (0->1048575) req@ffff97e57f950000 x1876699777178368/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:5/0 lens 488/0 e 0 to 0 dl 1789760725 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760714.986690:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f950000 with x1876699777178368 ext(0->1048575) 00002000:00010000:2.0:1789760714.986697:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f950000 00000100:00100000:2.0:1789760714.986728:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 1 deadline 391346088390 time 391146288709 state 0x0 ref 1 00000100:00100000:2.0:1789760714.986741:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 1 deadline 391346288709 time 391146288709 state 0x1 ref 1 00000100:00100000:2.0:1789760714.986877:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391346288709 time 391171085550 state 0x0 ref 1 00000100:00100000:2.0:1789760714.986891:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2403:x1876699777178368:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:3.0:1789760714.998838:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760714.999174:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777178496 00000100:00100000:1.0:1789760714.999188:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777178496 00002000:00100000:1.0:1789760714.999252:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x4:0x0] (1048576->2097151) req@ffff97e57ab36a00 x1876699777178496/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:5/0 lens 488/0 e 0 to 0 dl 1789760725 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760714.999265:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab36a00 with x1876699777178496 ext(1048576->2097151) 00002000:00010000:1.0:1789760714.999273:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ab36a00 00000100:00100000:1.0:1789760714.999294:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391371085550 time 391171085550 state 0x1 ref 2 00000100:00100000:2.0:1789760715.007239:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2403:x1876699777178368:12345-192.168.203.38@tcp:4:dd.500 Request processed in 20334us (20776us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789760715.007257:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 2 00002000:00100000:2.0:1789760715.007274:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x4:0x0] (0->1048575) req@ffff97e57f950000 x1876699777178368/t4294967330(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:5/0 lens 488/448 e 0 to 0 dl 1789760725 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760715.007284:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f950000 with x1876699777178368 ext(0->1048575) 00002000:00010000:2.0:1789760715.007292:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f950000 00000100:00100000:1.0:1789760715.019471:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760715.020142:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777178624 00000100:00100000:0.0:1789760715.020156:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777178624 00002000:00100000:0.0:1789760715.020577:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x4:0x0] (2097152->3145727) req@ffff97e57f952a00 x1876699777178624/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760715.020592:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f952a00 with x1876699777178624 ext(2097152->3145727) 00002000:00010000:0.0:1789760715.020600:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f952a00 00000100:00100000:0.0:1789760715.020624:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391371085550 time 391171085550 state 0x1 ref 2 00000100:00100000:3.0:1789760715.033460:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760715.035412:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777178752 00000100:00100000:0.0:1789760715.035430:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777178752 00002000:00100000:0.0:1789760715.035525:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x4:0x0] (3145728->4194303) req@ffff97e57ab34a80 x1876699777178752/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760715.035538:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab34a80 with x1876699777178752 ext(3145728->4194303) 00002000:00010000:0.0:1789760715.035547:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ab34a80 00000100:00100000:0.0:1789760715.035569:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391371085550 time 391171085550 state 0x1 ref 3 00000100:00100000:0.0:1789760715.056575:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760715.056728:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777178880 00000100:00100000:2.0:1789760715.056915:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777178880 00002000:00100000:2.0:1789760715.056974:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->1048575) req@ffff97e44bc44a80 x1876699777178880/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760715.056983:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44bc44a80 with x1876699777178880 ext(0->1048575) 00002000:00010000:2.0:1789760715.056988:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44bc44a80 00000100:00100000:2.0:1789760715.057007:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391371085550 time 391171085550 state 0x1 ref 4 00000100:00100000:1.0:1789760715.074454:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760715.074586:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777179008 00000100:00100000:0.0:1789760715.074599:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777179008 00002000:00100000:0.0:1789760715.074670:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x4:0x0] (1048576->2097151) req@ffff97e57f950a80 x1876699777179008/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760715.074683:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f950a80 with x1876699777179008 ext(1048576->2097151) 00002000:00010000:0.0:1789760715.074690:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f950a80 00000100:00100000:0.0:1789760715.074710:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391371085550 time 391171085550 state 0x1 ref 5 00000100:00100000:0.0:1789760715.187444:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391571637039 time 391371637039 state 0x1 ref 5 00000100:00100000:0.0:1789760715.187511:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+15:2404:x1876699777178496:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760715.205285:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+17:2404:x1876699777178496:12345-192.168.203.38@tcp:4:dd.500 Request processed in 17789us (206485us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789760715.207960:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 3 00002000:00100000:2.0:1789760715.207983:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x4:0x0] (1048576->2097151) req@ffff97e57ab36a00 x1876699777178496/t4294967331(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:5/0 lens 488/448 e 0 to 0 dl 1789760725 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760715.208012:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab36a00 with x1876699777178496 ext(1048576->2097151) 00002000:00010000:2.0:1789760715.208019:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ab36a00 00010000:00010000:2.0:1789760715.272191:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760715.388895:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391773093730 time 391573093730 state 0x1 ref 4 00000100:00100000:2.0:1789760715.388928:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+16:2403:x1876699777178624:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760715.405574:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2403:x1876699777178624:12345-192.168.203.38@tcp:4:dd.500 Request processed in 16653us (386108us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789760715.405587:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 4 00002000:00100000:2.0:1789760715.405599:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x4:0x0] (2097152->3145727) req@ffff97e57f952a00 x1876699777178624/t4294967332(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760715.405610:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f952a00 with x1876699777178624 ext(2097152->3145727) 00002000:00010000:2.0:1789760715.405616:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f952a00 00000100:00100000:0.0:1789760715.467414:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760715.467437:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798203136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760715.467505:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760715.467579:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798203136 00000100:00100000:0.0:1789760715.467586:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798203136 00000100:00100000:0.0:1789760715.467630:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789760715.467639:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798203136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760715.467676:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760715.467735:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798203136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760715.467741:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789760715.468104:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798203136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760715.589257:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 391973456296 time 391773456296 state 0x1 ref 3 00000100:00100000:0.0:1789760715.589290:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+17:2404:x1876699777178752:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760715.614108:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+19:2404:x1876699777178752:12345-192.168.203.38@tcp:4:dd.500 Request processed in 24824us (580652us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789760715.614130:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 5 00002000:00100000:0.0:1789760715.614143:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x4:0x0] (3145728->4194303) req@ffff97e57ab34a80 x1876699777178752/t4294967333(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760715.614154:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab34a80 with x1876699777178752 ext(3145728->4194303) 00002000:00010000:0.0:1789760715.614160:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ab34a80 00000100:00100000:1.0:1789760715.789472:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392173670876 time 391973670876 state 0x1 ref 2 00000100:00100000:1.0:1789760715.789505:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2406:x1876699777178880:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:1.0:1789760715.820704:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2406:x1876699777178880:12345-192.168.203.38@tcp:4:dd.500 Request processed in 31198us (764127us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789760715.820732:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 6 00002000:00100000:1.0:1789760715.820751:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (0->1048575) req@ffff97e44bc44a80 x1876699777178880/t4294967432(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760715.820762:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44bc44a80 with x1876699777178880 ext(0->1048575) 00002000:00010000:1.0:1789760715.820769:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44bc44a80 00000100:00100000:0.0:1789760715.833213:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760715.835080:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777179136 00000100:00100000:2.0:1789760715.835101:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777179136 00002000:00100000:2.0:1789760715.835183:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x4:0x0] (2097152->3145727) req@ffff97e57f030e00 x1876699777179136/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760715.835198:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f030e00 with x1876699777179136 ext(2097152->3145727) 00002000:00010000:2.0:1789760715.835207:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f030e00 00000100:00100000:2.0:1789760715.835232:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392173670876 time 391973670876 state 0x1 ref 2 00000100:00100000:3.0:1789760715.852439:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760715.852742:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777179264 00000100:00100000:2.0:1789760715.852754:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777179264 00002000:00100000:2.0:1789760715.852862:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (3145728->4194303) req@ffff97e57ab37100 x1876699777179264/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760715.852893:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab37100 with x1876699777179264 ext(3145728->4194303) 00002000:00010000:2.0:1789760715.852900:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab37100 00000100:00100000:2.0:1789760715.852920:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392173670876 time 391973670876 state 0x1 ref 3 00000100:00100000:0.0:1789760715.874160:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760715.874303:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777179392 00000100:00100000:2.0:1789760715.874318:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777179392 00002000:00100000:2.0:1789760715.874382:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x4:0x0] (4194304->5242879) req@ffff97e57fd78700 x1876699777179392/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760715.874397:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57fd78700 with x1876699777179392 ext(4194304->5242879) 00002000:00010000:2.0:1789760715.874404:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57fd78700 00000100:00100000:2.0:1789760715.874424:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392173670876 time 391973670876 state 0x1 ref 4 00000100:00100000:0.0:1789760715.893558:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760715.893660:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777179520 00000100:00100000:2.0:1789760715.893673:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777179520 00002000:00100000:2.0:1789760715.893737:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x4:0x0] (5242880->6291455) req@ffff97e57fbc4380 x1876699777179520/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760715.893751:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57fbc4380 with x1876699777179520 ext(5242880->6291455) 00002000:00010000:2.0:1789760715.893758:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57fbc4380 00000100:00100000:2.0:1789760715.893779:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392173670876 time 391973670876 state 0x1 ref 5 00000100:00100000:3.0:1789760715.912394:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760715.912514:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777179648 00000100:00100000:0.0:1789760715.912526:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777179648 00002000:00100000:0.0:1789760715.912592:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x4:0x0] (6291456->7340031) req@ffff97e57ab36680 x1876699777179648/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760715.912605:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab36680 with x1876699777179648 ext(6291456->7340031) 00002000:00010000:0.0:1789760715.912612:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ab36680 00000100:00100000:0.0:1789760715.912633:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392173670876 time 391973670876 state 0x1 ref 6 00000100:00100000:0.0:1789760715.948278:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760715.948448:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777179776 00000100:00100000:3.0:1789760715.948463:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777179776 00002000:00100000:3.0:1789760715.948528:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x4:0x0] (7340032->8388607) req@ffff97e57f8d3480 x1876699777179776/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1789760726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760715.948542:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f8d3480 with x1876699777179776 ext(7340032->8388607) 00002000:00010000:3.0:1789760715.948550:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f8d3480 00000100:00100000:3.0:1789760715.948571:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392173670876 time 391973670876 state 0x1 ref 7 00000100:00100000:2.0:1789760715.975748:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798203264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760715.975884:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760715.976210:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798203264 00000100:00100000:1.0:1789760715.976221:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798203264 00000100:00100000:1.0:1789760715.976285:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789760715.976327:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798203264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760715.976492:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760715.976733:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798203264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 408us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760715.976741:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789760715.979061:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798203392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760715.979150:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760715.979457:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798203392 00000100:00100000:1.0:1789760715.979466:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798203392 00000100:00100000:1.0:1789760715.979526:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789760715.979536:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798203392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760715.979563:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760715.979623:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798203392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760715.979631:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789760715.980710:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798203392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760715.983729:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798203264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760715.993271:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392377464142 time 392177464142 state 0x1 ref 7 00000100:00100000:2.0:1789760715.993331:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+15:2405:x1876699777179008:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760716.009860:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+17:2405:x1876699777179008:12345-192.168.203.38@tcp:4:dd.500 Request processed in 16539us (935404us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789760716.009878:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 7 00002000:00100000:2.0:1789760716.009895:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (1048576->2097151) req@ffff97e57f950a80 x1876699777179008/t4294967433(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760716.009907:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f950a80 with x1876699777179008 ext(1048576->2097151) 00002000:00010000:2.0:1789760716.009916:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f950a80 00000100:00100000:0.0:1789760716.031456:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.031575:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777179904 00000100:00100000:2.0:1789760716.031590:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777179904 00002000:00100000:2.0:1789760716.031673:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (4194304->5242879) req@ffff97e548820a80 x1876699777179904/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760716.031686:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e548820a80 with x1876699777179904 ext(4194304->5242879) 00002000:00010000:2.0:1789760716.031694:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e548820a80 00000100:00100000:2.0:1789760716.031715:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392377464142 time 392177464142 state 0x1 ref 7 00000100:00080000:1.0:1789760716.032041:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760716.059567:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760716.060157:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777180032 00000100:00100000:1.0:1789760716.060170:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777180032 00002000:00100000:1.0:1789760716.060234:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x4:0x0] (5242880->6291455) req@ffff97e57ab36d80 x1876699777180032/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760716.060247:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab36d80 with x1876699777180032 ext(5242880->6291455) 00002000:00010000:1.0:1789760716.060254:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab36d80 00000100:00100000:1.0:1789760716.060275:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392377464142 time 392177464142 state 0x1 ref 8 00000100:00100000:1.0:1789760716.194278:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392578471615 time 392378471615 state 0x1 ref 8 00000100:00100000:1.0:1789760716.194333:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2405:x1876699777179136:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:1.0:1789760716.220525:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+20:2405:x1876699777179136:12345-192.168.203.38@tcp:4:dd.500 Request processed in 26200us (387310us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789760716.220561:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 8 00002000:00100000:1.0:1789760716.220580:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (2097152->3145727) req@ffff97e57f030e00 x1876699777179136/t4294967434(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760716.220592:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f030e00 with x1876699777179136 ext(2097152->3145727) 00002000:00010000:1.0:1789760716.220601:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f030e00 00000100:00100000:3.0:1789760716.227139:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.227502:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777180160 00000100:00100000:0.0:1789760716.227515:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777180160 00002000:00100000:0.0:1789760716.227579:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (6291456->7340031) req@ffff97e57ab34e00 x1876699777180160/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760716.227593:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab34e00 with x1876699777180160 ext(6291456->7340031) 00002000:00010000:0.0:1789760716.227600:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab34e00 00000100:00100000:0.0:1789760716.227620:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392578471615 time 392378471615 state 0x1 ref 8 00000100:00100000:0.0:1789760716.252747:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760716.253182:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777180544 00000100:00100000:3.0:1789760716.253197:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777180544 00000100:00100000:3.0:1789760716.253286:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:3.0:1789760716.253311:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+36:11914:x1876699777180544:12345-192.168.203.38@tcp:35:dd.500 00000001:00080000:3.0:1789760716.253663:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00000100:00100000:3.0:1789760716.253859:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+38:11914:x1876699777180544:12345-192.168.203.38@tcp:35:dd.500 Request processed in 550us (1136us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789760716.253869:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000020:00080000:3.0:1789760716.253876:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789760716.253939:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760716.253984:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777180288 00000100:00100000:3.0:1789760716.253988:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777180288 00002000:00100000:3.0:1789760716.254023:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x4:0x0] (7340032->8388607) req@ffff97e57ab37800 x1876699777180288/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760716.254097:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab37800 with x1876699777180288 ext(7340032->8388607) 00002000:00010000:3.0:1789760716.254104:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab37800 00000100:00100000:3.0:1789760716.254129:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392578471615 time 392378471615 state 0x1 ref 9 00000100:00080000:1.0:1789760716.255283:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789760716.295132:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760716.324987:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.326782:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777180800 00000100:00100000:2.0:1789760716.326835:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777180800 00000100:00100000:2.0:1789760716.326925:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:2.0:1789760716.326938:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+38:11926:x1876699777180800:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.326979:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.327004:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec800/0xc2b9a3a739857c1e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211afa expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327202:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327243:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327257:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327272:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327279:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327295:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327373:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857c33 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327383:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857c33 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327392:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857c33 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760716.327403:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x8:0x0]: returning size 0 00010000:00010000:2.0:1789760716.327531:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327540:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327548:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327562:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3eda00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760716.327568:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327577:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327594:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760716.327597:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760716.327603:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327610:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eda00/0xc2b9a3a739857c25 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327629:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327650:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327657:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327663:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3eca00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760716.327666:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327673:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327691:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x151ecd9f (ffff97e543c0ab00) 00010000:00010000:2.0:1789760716.327694:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760716.327698:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327704:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3eca00/0xc2b9a3a739857c2c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327749:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec800/0xc2b9a3a739857c1e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211afa expref: 41 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327765:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857c33 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211afa expref: 40 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.327773:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760716.327776:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760716.327779:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ed000, rc 0) 00000100:00100000:2.0:1789760716.327922:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+40:11926:x1876699777180800:12345-192.168.203.38@tcp:101:dd.0 Request processed in 986us (2949us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789760716.327931:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:0.0:1789760716.340467:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760716.340585:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777180928 00000100:00100000:1.0:1789760716.340599:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777180928 00000100:00100000:1.0:1789760716.340681:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:1.0:1789760716.340694:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+22:11926:x1876699777180928:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760716.340860:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760716.340885:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857c41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b01 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760716.340929:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 23 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760716.340940:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760716.340956:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760716.340963:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857c41 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b01 expref: 23 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760716.341705:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 23 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760716.341858:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 23 pid: 8112 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760716.341876:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9533:1876699798203520:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760716.342089:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5467869c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760716.371821:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.371876:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.371923:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777181056 00000100:00100000:2.0:1789760716.371936:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777181056 00000100:00100000:2.0:1789760716.372008:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777181184 00000100:00100000:2.0:1789760716.372012:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777181184 00000100:00100000:2.0:1789760716.372035:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:2.0:1789760716.372046:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11929:x1876699777181056:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.372088:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.372112:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b00829/0xc2b9a3a739857c48 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b08 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.372155:0:13387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 24 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.372164:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760716.372169:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.372174:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b00829/0xc2b9a3a739857c48 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b08 expref: 24 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.372240:0:13387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 24 pid: 8110 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.372253:0:13387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 24 pid: 8110 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.372270:0:13387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13387:1876699798203648:192.168.203.38@tcp:104: 00000100:00100000:2.0:1789760716.372380:0:13387:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760716.372405:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:2.0:1789760716.372413:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+24:11925:x1876699777181184:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.372422:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.372434:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007da0961/0xc2b9a3a739857c4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b0f expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.372462:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.372466:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.372472:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007da0961/0xc2b9a3a739857c4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b0f expref: 25 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.372484:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007da0961/0xc2b9a3a739857c4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b0f expref: 25 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.372500:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3eca00, rc 0) 00000100:00100000:2.0:1789760716.372530:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11925:x1876699777181184:12345-192.168.203.38@tcp:101:dd.0 Request processed in 118us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.372537:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00080000:0.0:1789760716.373366:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760716.375904:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.375943:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.375972:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.375991:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.376005:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.376046:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.376067:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.376080:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.376138:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.376419:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777181312 00000100:00100000:2.0:1789760716.376432:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777181312 00000100:00100000:2.0:1789760716.376483:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777181440 00000100:00100000:2.0:1789760716.376486:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777181440 00000100:00100000:2.0:1789760716.376496:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777181568 00000100:00100000:2.0:1789760716.376499:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777181568 00000100:00100000:2.0:1789760716.376508:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777181696 00000100:00100000:2.0:1789760716.376510:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777181696 00000100:00100000:2.0:1789760716.376517:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777181824 00000100:00100000:2.0:1789760716.376519:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777181824 00000100:00100000:2.0:1789760716.376528:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777181952 00000100:00100000:2.0:1789760716.376530:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777181952 00000100:00100000:2.0:1789760716.376537:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777182080 00000100:00100000:2.0:1789760716.376539:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777182080 00000100:00100000:2.0:1789760716.376549:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777182208 00000100:00100000:2.0:1789760716.376551:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777182208 00000100:00100000:2.0:1789760716.376560:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777182336 00000100:00100000:2.0:1789760716.376570:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777182336 00000100:00100000:2.0:1789760716.376595:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:2.0:1789760716.376606:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11932:x1876699777181312:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.376629:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.376653:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e966e041/0xc2b9a3a739857c56 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b16 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.376691:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.376697:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.376704:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e966e041/0xc2b9a3a739857c56 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b16 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.376720:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e966e041/0xc2b9a3a739857c56 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b16 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.376736:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3eda00, rc 0) 00000100:00100000:2.0:1789760716.376823:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11932:x1876699777181312:12345-192.168.203.38@tcp:101:dd.0 Request processed in 218us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.376831:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:2.0:1789760716.376852:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:2.0:1789760716.376858:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11937:x1876699777181440:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.376865:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.376873:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e672949/0xc2b9a3a739857c5d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b1d expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.376885:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.376894:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.376900:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e672949/0xc2b9a3a739857c5d lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b1d expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.376909:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e672949/0xc2b9a3a739857c5d lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b1d expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.376918:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ed400, rc 0) 00000100:00100000:2.0:1789760716.376939:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11937:x1876699777181440:12345-192.168.203.38@tcp:101:dd.0 Request processed in 82us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.376946:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:2.0:1789760716.376959:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:2.0:1789760716.376966:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11936:x1876699777181568:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.376973:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.376984:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c076610b/0xc2b9a3a739857c64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b24 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.377000:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.377003:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.377007:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c076610b/0xc2b9a3a739857c64 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b24 expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.377017:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c076610b/0xc2b9a3a739857c64 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b24 expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.377026:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ecc00, rc 0) 00000100:00100000:2.0:1789760716.377055:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11936:x1876699777181568:12345-192.168.203.38@tcp:101:dd.0 Request processed in 90us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.377061:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:2.0:1789760716.377074:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:2.0:1789760716.377079:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11939:x1876699777181696:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.377085:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.377092:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000824f0ff/0xc2b9a3a739857c6b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b2b expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.377105:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.377108:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.377112:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000824f0ff/0xc2b9a3a739857c6b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b2b expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.377121:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000824f0ff/0xc2b9a3a739857c6b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b2b expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.377130:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ede00, rc 0) 00000100:00100000:2.0:1789760716.377150:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11939:x1876699777181696:12345-192.168.203.38@tcp:101:dd.0 Request processed in 70us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.377155:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:2.0:1789760716.377167:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:2.0:1789760716.377173:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11938:x1876699777181824:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.377179:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.377187:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a37527/0xc2b9a3a739857c72 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b32 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.377211:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.378541:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.378559:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a37527/0xc2b9a3a739857c72 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b32 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.378577:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0a37527/0xc2b9a3a739857c72 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b32 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.378591:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3edc00, rc 0) 00000100:00100000:2.0:1789760716.378640:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11938:x1876699777181824:12345-192.168.203.38@tcp:101:dd.0 Request processed in 1466us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.378648:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:2.0:1789760716.378678:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:2.0:1789760716.378690:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11934:x1876699777181952:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.378702:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.378717:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b621b45/0xc2b9a3a739857c79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b39 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.378760:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.378765:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.378770:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b621b45/0xc2b9a3a739857c79 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b39 expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.378781:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b621b45/0xc2b9a3a739857c79 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b39 expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.378817:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ed200, rc 0) 00000100:00100000:2.0:1789760716.378835:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11934:x1876699777181952:12345-192.168.203.38@tcp:101:dd.0 Request processed in 149us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.378841:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:2.0:1789760716.378856:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:2.0:1789760716.378863:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11931:x1876699777182080:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.378871:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.378893:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df0b6608/0xc2b9a3a739857c80 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b40 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.378907:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.378911:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.378915:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df0b6608/0xc2b9a3a739857c80 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b40 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.378924:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df0b6608/0xc2b9a3a739857c80 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b40 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.378932:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540030600, rc 0) 00000100:00100000:2.0:1789760716.378948:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11931:x1876699777182080:12345-192.168.203.38@tcp:101:dd.0 Request processed in 86us (2881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.378954:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:2.0:1789760716.378968:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:2.0:1789760716.378975:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11928:x1876699777182208:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.378988:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.378997:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000357ab3f2/0xc2b9a3a739857c87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b47 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.379010:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.379013:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.379019:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000357ab3f2/0xc2b9a3a739857c87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b47 expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.379028:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000357ab3f2/0xc2b9a3a739857c87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b47 expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.379036:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540031a00, rc 0) 00000100:00100000:2.0:1789760716.379052:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11928:x1876699777182208:12345-192.168.203.38@tcp:101:dd.0 Request processed in 78us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.379058:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:2.0:1789760716.379075:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:2.0:1789760716.379081:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+28:11935:x1876699777182336:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.379089:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.379095:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739857c8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b4e expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.379107:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.379110:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.379114:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739857c8e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b4e expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.379132:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739857c8e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b4e expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.379140:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540030c00, rc 0) 00000100:00100000:2.0:1789760716.379154:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11935:x1876699777182336:12345-192.168.203.38@tcp:101:dd.0 Request processed in 74us (3017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.379161:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:2.0:1789760716.381678:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.382919:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.383129:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760716.383150:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777182464 00000100:00100000:3.0:1789760716.383162:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777182464 00000100:00100000:2.0:1789760716.383437:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.383460:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777182592 00000100:00100000:3.0:1789760716.383470:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777182720 00000100:00100000:3.0:1789760716.383474:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777182720 00000100:00100000:3.0:1789760716.383497:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:3.0:1789760716.383508:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11940:x1876699777182464:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760716.383531:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760716.383553:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038f20357/0xc2b9a3a739857c95 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b55 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760716.383589:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760716.383596:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760716.383602:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038f20357/0xc2b9a3a739857c95 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b55 expref: 31 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760716.383617:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038f20357/0xc2b9a3a739857c95 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b55 expref: 31 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760716.383633:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4400, rc 0) 00000100:00100000:3.0:1789760716.383699:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+31:11940:x1876699777182464:12345-192.168.203.38@tcp:101:dd.0 Request processed in 193us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760716.383724:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:3.0:1789760716.383745:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:3.0:1789760716.383751:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+29:11933:x1876699777182720:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760716.383759:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760716.383781:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857c9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b63 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760716.384018:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760716.384024:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760716.384029:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857c9c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b63 expref: 30 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760716.384038:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857c9c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b63 expref: 30 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760716.384047:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5600, rc 0) 00000100:00100000:3.0:1789760716.384067:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11933:x1876699777182720:12345-192.168.203.38@tcp:101:dd.0 Request processed in 316us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760716.384073:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:0.0:1789760716.384676:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777182592 00000100:00100000:0.0:1789760716.384731:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:0.0:1789760716.384740:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+31:11930:x1876699777182592:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760716.384752:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760716.384764:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857ca3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b5c expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.384802:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.384806:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.384812:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857ca3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b5c expref: 32 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.384822:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857ca3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b5c expref: 32 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.384833:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548543200, rc 0) 00000100:00100000:0.0:1789760716.384868:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+32:11930:x1876699777182592:12345-192.168.203.38@tcp:101:dd.0 Request processed in 130us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760716.384874:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:2.0:1789760716.386638:0:13387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13387:1876699798203648:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760716.386682:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020b00829/0xc2b9a3a739857c48 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b08 expref: 31 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.386701:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f3ec800, rc 0) 00000100:00100000:2.0:1789760716.386754:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+31:11929:x1876699777181056:12345-192.168.203.38@tcp:101:dd.0 Request processed in 14709us (14973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.386762:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:2.0:1789760716.386829:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777182848 00000100:00100000:2.0:1789760716.386836:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777182848 00000100:00100000:2.0:1789760716.386875:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:2.0:1789760716.386884:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11927:x1876699777182848:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760716.386901:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760716.386938:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739857caa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b6a expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.386976:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.386982:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.386989:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739857caa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b6a expref: 31 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387000:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739857caa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b6a expref: 31 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387010:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e540030400, rc 0) 00000100:00100000:2.0:1789760716.387032:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+31:11927:x1876699777182848:12345-192.168.203.38@tcp:101:dd.0 Request processed in 150us (3596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760716.387038:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:2.0:1789760716.387081:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.387167:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.387454:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777182976 00000100:00100000:2.0:1789760716.387460:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777182976 00010000:00010000:2.0:1789760716.387486:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 31 pid: 8112 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.387511:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777183104 00000100:00100000:2.0:1789760716.387514:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777183104 00010000:00010000:2.0:1789760716.387529:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 31 pid: 8110 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.387553:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:2.0:1789760716.387569:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+31:2403:x1876699777182976:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760716.387580:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760716.387607:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 31 pid: 8112 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387621:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 31 pid: 8112 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387646:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387650:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387659:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857c41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b01 expref: 31 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387669:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857c41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b01 expref: 31 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387678:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387680:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387686:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007da0961/0xc2b9a3a739857c4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b0f expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387695:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007da0961/0xc2b9a3a739857c4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b0f expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387702:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387704:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387720:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c076610b/0xc2b9a3a739857c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b24 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387728:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c076610b/0xc2b9a3a739857c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b24 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387737:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387739:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387744:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b621b45/0xc2b9a3a739857c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b39 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387752:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b621b45/0xc2b9a3a739857c79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b39 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387759:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387761:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387767:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000357ab3f2/0xc2b9a3a739857c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b47 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387775:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000357ab3f2/0xc2b9a3a739857c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b47 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387782:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387784:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387814:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739857c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b4e expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387833:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739857c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b4e expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387842:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387845:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387851:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857c9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b63 expref: 31 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387859:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857c9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b63 expref: 31 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387866:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387868:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760716.387872:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739857caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b6a expref: 31 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387880:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739857caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b6a expref: 31 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760716.387918:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739857caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b6a expref: 31 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.387935:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798203776:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760716.388012:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857c9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b63 expref: 31 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.388041:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798203904:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760716.388074:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739857c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b4e expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.388083:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798204032:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760716.388112:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000357ab3f2/0xc2b9a3a739857c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b47 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.388122:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798204160:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760716.388150:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002b621b45/0xc2b9a3a739857c79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b39 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.388160:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798204288:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760716.388188:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c076610b/0xc2b9a3a739857c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b24 expref: 31 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.388198:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798204416:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.388460:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:0.0:1789760716.388473:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548b18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+31:2403:x1876699777183104:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760716.388484:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760716.388505:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 31 pid: 8110 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388529:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 31 pid: 8110 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388547:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be90e2f/0xc2b9a3a739857bd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x5:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ade expref: 31 pid: 8110 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388564:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388567:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388574:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020b00829/0xc2b9a3a739857c48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b08 expref: 30 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388582:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b00829/0xc2b9a3a739857c48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b08 expref: 30 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388590:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388592:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388596:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e966e041/0xc2b9a3a739857c56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b16 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388604:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e966e041/0xc2b9a3a739857c56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b16 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388611:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388613:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388617:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e672949/0xc2b9a3a739857c5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b1d expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388632:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e672949/0xc2b9a3a739857c5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b1d expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388639:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388642:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388648:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000824f0ff/0xc2b9a3a739857c6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b2b expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388656:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000824f0ff/0xc2b9a3a739857c6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b2b expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388663:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388665:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388670:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0a37527/0xc2b9a3a739857c72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b32 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388678:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a37527/0xc2b9a3a739857c72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b32 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388686:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388688:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388693:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df0b6608/0xc2b9a3a739857c80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b40 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388702:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df0b6608/0xc2b9a3a739857c80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b40 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388716:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388720:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388726:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038f20357/0xc2b9a3a739857c95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b55 expref: 30 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388734:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038f20357/0xc2b9a3a739857c95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b55 expref: 30 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388741:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388744:0:6452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.388748:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b5c expref: 30 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388756:0:6452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857ca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b5c expref: 30 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.388782:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857ca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b5c expref: 30 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.388835:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aab9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798204544:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760716.388887:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000038f20357/0xc2b9a3a739857c95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b55 expref: 30 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.388898:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aabb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798204672:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760716.388938:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000df0b6608/0xc2b9a3a739857c80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b40 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.388949:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aabaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798204800:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760716.388975:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e0a37527/0xc2b9a3a739857c72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b32 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.388984:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aab8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798204928:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760716.389009:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000824f0ff/0xc2b9a3a739857c6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b2b expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.389018:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aabb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798205056:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760716.389050:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007e672949/0xc2b9a3a739857c5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b1d expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.389060:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aaba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798205184:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760716.389086:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e966e041/0xc2b9a3a739857c56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b16 expref: 30 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.389095:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aabad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798205312:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760716.389115:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000020b00829/0xc2b9a3a739857c48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b08 expref: 30 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.389124:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798205440:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.389150:0:6452:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e543e533c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789760716.390661:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857bd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ad7 expref: 31 pid: 8112 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760716.390687:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9533:1876699798203520:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760716.390721:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857c41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b01 expref: 30 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760716.390749:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f4a00, rc 0) 00000100:00100000:3.0:1789760716.390837:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+30:11926:x1876699777180928:12345-192.168.203.38@tcp:101:dd.0 Request processed in 50145us (50385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760716.390847:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00010000:00010000:2.0:1789760716.394038:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000007da0961/0xc2b9a3a739857c4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b0f expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.394069:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798205568:192.168.203.38@tcp:105: 00010000:00010000:2.0:1789760716.394137:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857c41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b01 expref: 29 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760716.394148:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798205696:192.168.203.38@tcp:105: 00000100:00100000:2.0:1789760716.394170:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fdc7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789760716.394337:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392778540378 time 392578540378 state 0x1 ref 9 00000100:00100000:1.0:1789760716.394359:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2405:x1876699777179264:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760716.411490:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aab9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798204544:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.411512:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aabad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798205312:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.411753:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aabb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798204672:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.411763:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aabaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798204800:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.411772:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aab8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798204928:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.411781:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aabb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798205056:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.411817:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aaba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798205184:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760716.433083:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798203776:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760716.433105:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798203904:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760716.433115:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798204032:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760716.433125:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798204160:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760716.433136:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798204288:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760716.433146:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798204416:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760716.433156:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798205568:192.168.203.38@tcp:105: 00000100:00100000:3.0:1789760716.433166:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798205696:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760716.445960:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6452:1876699798205440:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760716.446048:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760716.446127:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548b18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2403:x1876699777183104:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 57656us (58957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760716.446143:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00010000:00010000:3.0:1789760716.449518:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760716.453073:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2403:x1876699777182976:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 65487us (65973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760716.453092:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:0.0:1789760716.462614:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2405:x1876699777179264:12345-192.168.203.38@tcp:4:dd.500 Request processed in 68245us (610172us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789760716.462637:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 9 00002000:00100000:0.0:1789760716.462661:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (3145728->4194303) req@ffff97e57ab37100 x1876699777179264/t4294967435(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760716.462677:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab37100 with x1876699777179264 ext(3145728->4194303) 00002000:00010000:0.0:1789760716.462687:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab37100 00000100:00100000:0.0:1789760716.478004:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.478202:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777183232 00000100:00100000:2.0:1789760716.478224:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777183232 00002000:00100000:2.0:1789760716.478303:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x5:0x0] (5242880->6291455) req@ffff97e57aab8e00 x1876699777183232/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.478318:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57aab8e00 with x1876699777183232 ext(5242880->6291455) 00002000:00010000:2.0:1789760716.478443:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57aab8e00 00000100:00100000:2.0:1789760716.478473:0:8118:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 3 deadline 0 time 392662677843 state 0x0 ref 1 00000100:00100000:2.0:1789760716.478497:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 3 deadline 392662777843 time 392662677843 state 0x1 ref 1 00000100:00100000:1.0:1789760716.478690:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392662777843 time 392662897091 state 0x0 ref 1 00000100:00100000:1.0:1789760716.478710:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2406:x1876699777183232:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760716.513015:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.513073:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777183360 00000100:00100000:2.0:1789760716.513085:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777183360 00002000:00100000:2.0:1789760716.513149:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x5:0x0] (0->1048575) req@ffff97e57f7f6300 x1876699777183360/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.513162:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f6300 with x1876699777183360 ext(0->1048575) 00002000:00010000:2.0:1789760716.513169:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f6300 00000100:00100000:2.0:1789760716.513193:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392662997091 time 392662897091 state 0x1 ref 2 00000100:00100000:2.0:1789760716.513226:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392662997091 time 392697434673 state 0x0 ref 2 00000100:00100000:2.0:1789760716.513239:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+32:2403:x1876699777183360:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760716.520277:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.522965:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777183488 00000100:00100000:0.0:1789760716.522983:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777183488 00002000:00100000:0.0:1789760716.524010:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (7340032->8388607) req@ffff97e57aaba680 x1876699777183488/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760716.524031:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57aaba680 with x1876699777183488 ext(7340032->8388607) 00002000:00010000:0.0:1789760716.524038:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57aaba680 00000100:00100000:0.0:1789760716.530603:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392697534673 time 392697434673 state 0x1 ref 3 00000100:00100000:3.0:1789760716.530682:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2406:x1876699777183232:12345-192.168.203.38@tcp:4:dd.0 Request processed in 51967us (52684us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789760716.530696:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 18 00002000:00100000:3.0:1789760716.530712:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x5:0x0] (5242880->6291455) req@ffff97e57aab8e00 x1876699777183232/t4294967334(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760716.530725:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57aab8e00 with x1876699777183232 ext(5242880->6291455) 00002000:00010000:3.0:1789760716.530731:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57aab8e00 00000100:00100000:3.0:1789760716.530782:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392697534673 time 392714987533 state 0x0 ref 2 00000100:00100000:3.0:1789760716.530829:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2405:x1876699777183488:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760716.533280:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760716.535135:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777183616 00000100:00100000:3.0:1789760716.535150:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777183616 00002000:00100000:3.0:1789760716.535358:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x5:0x0] (4194304->5242879) req@ffff97e57aabb100 x1876699777183616/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760716.535370:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57aabb100 with x1876699777183616 ext(4194304->5242879) 00002000:00010000:3.0:1789760716.535375:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57aabb100 00000100:00100000:3.0:1789760716.535423:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392715087533 time 392714987533 state 0x1 ref 3 00000100:00100000:3.0:1789760716.535448:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392715087533 time 392719658200 state 0x0 ref 3 00000100:00100000:3.0:1789760716.535525:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+32:2406:x1876699777183616:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760716.542453:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2403:x1876699777183360:12345-192.168.203.38@tcp:4:dd.0 Request processed in 29200us (29437us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789760716.542471:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 19 00002000:00100000:0.0:1789760716.542490:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x5:0x0] (0->1048575) req@ffff97e57f7f6300 x1876699777183360/t4294967335(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760716.542503:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f6300 with x1876699777183360 ext(0->1048575) 00002000:00010000:0.0:1789760716.542512:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f6300 00000100:00100000:1.0:1789760716.543111:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.543196:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777183744 00000100:00100000:0.0:1789760716.543265:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777183744 00002000:00100000:0.0:1789760716.543393:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x5:0x0] (4194304->5242879) req@ffff97e546385500 x1876699777183744/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760716.543403:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546385500 with x1876699777183744 ext(4194304->5242879) 00002000:00010000:0.0:1789760716.543407:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e546385500 00000100:00100000:0.0:1789760716.543460:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392719758200 time 392719658200 state 0x1 ref 3 00000100:00100000:0.0:1789760716.543495:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392719758200 time 392727704213 state 0x0 ref 3 00000100:00100000:0.0:1789760716.543510:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2405:x1876699777183744:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760716.556978:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760716.563083:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777183872 00000100:00100000:1.0:1789760716.563108:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777183872 00002000:00100000:1.0:1789760716.563258:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x5:0x0] (3145728->4194303) req@ffff97e57f7f5180 x1876699777183872/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760716.563271:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f5180 with x1876699777183872 ext(3145728->4194303) 00002000:00010000:1.0:1789760716.563277:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f5180 00000100:00100000:1.0:1789760716.563338:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392727804213 time 392727704213 state 0x1 ref 4 00000100:00100000:1.0:1789760716.563389:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392727804213 time 392747597497 state 0x0 ref 4 00000100:00100000:1.0:1789760716.563402:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2404:x1876699777183872:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:1.0:1789760716.566641:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.571397:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777184000 00000100:00100000:0.0:1789760716.571418:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777184000 00002000:00100000:0.0:1789760716.571494:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x5:0x0] (1048576->2097151) req@ffff97e546384e00 x1876699777184000/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760716.571510:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546384e00 with x1876699777184000 ext(1048576->2097151) 00002000:00010000:0.0:1789760716.571518:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e546384e00 00000100:00100000:0.0:1789760716.571580:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392747697497 time 392747597497 state 0x1 ref 5 00000100:00100000:0.0:1789760716.571616:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392747697497 time 392755824535 state 0x0 ref 5 00000100:00100000:0.0:1789760716.571643:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+38:2406:x1876699777184000:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760716.579700:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2405:x1876699777183488:12345-192.168.203.38@tcp:4:dd.0 Request processed in 48860us (59682us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789760716.579719:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 20 00002000:00100000:3.0:1789760716.579736:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (7340032->8388607) req@ffff97e57aaba680 x1876699777183488/t4294967436(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760716.579750:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57aaba680 with x1876699777183488 ext(7340032->8388607) 00002000:00010000:3.0:1789760716.579759:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57aaba680 00000100:00100000:1.0:1789760716.582848:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760716.582891:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777184128 00000100:00100000:1.0:1789760716.582903:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777184128 00002000:00100000:1.0:1789760716.582964:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x5:0x0] (6291456->7340031) req@ffff97e44c6dd880 x1876699777184128/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760716.582977:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44c6dd880 with x1876699777184128 ext(6291456->7340031) 00002000:00010000:1.0:1789760716.582983:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e44c6dd880 00000100:00100000:1.0:1789760716.583663:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392755924535 time 392755824535 state 0x1 ref 5 00000100:00100000:1.0:1789760716.583697:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392755924535 time 392767905840 state 0x0 ref 5 00000100:00100000:1.0:1789760716.583714:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+40:2403:x1876699777184128:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760716.596781:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 392980976348 time 392780976348 state 0x1 ref 8 00000100:00100000:2.0:1789760716.596832:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+40:2406:x1876699777179392:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760716.598813:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760716.599168:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777184256 00000100:00100000:1.0:1789760716.599181:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777184256 00002000:00100000:1.0:1789760716.599258:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (6291456->7340031) req@ffff97e57f7f4000 x1876699777184256/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760716.599271:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f4000 with x1876699777184256 ext(6291456->7340031) 00002000:00010000:1.0:1789760716.599278:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f7f4000 00000100:00100000:1.0:1789760716.599314:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392768005840 time 392767905840 state 0x1 ref 6 00000100:00100000:1.0:1789760716.599356:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392768005840 time 392783564642 state 0x0 ref 6 00000100:00100000:1.0:1789760716.599394:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2405:x1876699777184256:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760716.603177:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.603707:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777184384 00000100:00100000:2.0:1789760716.604278:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777184384 00002000:00100000:2.0:1789760716.604405:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x5:0x0] (3145728->4194303) req@ffff97e57f7f5500 x1876699777184384/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.604417:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f5500 with x1876699777184384 ext(3145728->4194303) 00002000:00010000:2.0:1789760716.604424:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f7f5500 00000100:00100000:2.0:1789760716.604464:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392783664642 time 392783564642 state 0x1 ref 7 00000100:00100000:2.0:1789760716.604491:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392783664642 time 392788701034 state 0x0 ref 7 00000100:00100000:2.0:1789760716.604504:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2404:x1876699777184384:12345-192.168.203.38@tcp:4:dd.0 00000001:00080000:3.0:1789760716.612154:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967350 is committed 00000020:00080000:3.0:1789760716.612202:0:7272:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97e57fdc73c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789760716.612217:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e44c198600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97e57fdc7540 00000020:00080000:3.0:1789760716.612221:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].3 00000020:00080000:3.0:1789760716.612236:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e44c198b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e4497bc800 00000020:00080000:3.0:1789760716.612240:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].3 00000001:00080000:3.0:1789760716.612261:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967353 is committed 00010000:00010000:0.0:1789760716.612516:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612531:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612540:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612548:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.612553:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612562:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612583:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:0.0:1789760716.612586:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760716.612598:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612605:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4200/0xc2b9a3a739857a42 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612627:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612646:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612653:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612659:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.612662:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612668:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612677:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:0.0:1789760716.612680:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789760716.612683:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612688:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4e00/0xc2b9a3a739857ab2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612699:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612705:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612726:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612732:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ec000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.612735:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612741:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612750:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:0.0:1789760716.612752:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760716.612754:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612760:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec000/0xc2b9a3a739857ac7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612775:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612781:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612829:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612835:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ed600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.612838:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612854:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612865:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x2ab29dc6 (ffff97e543c0af00) 00010000:00010000:0.0:1789760716.612867:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760716.612871:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612877:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed600/0xc2b9a3a739857b06 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612899:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612906:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612912:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612918:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.612921:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612927:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612936:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760716.612939:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760716.612942:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612958:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf5c00/0xc2b9a3a739857b1b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612971:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612977:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612983:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612988:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ece00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.612991:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.612997:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613006:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x151ecd9f (ffff97e543c0ab00) 00010000:00010000:0.0:1789760716.613020:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760716.613023:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613029:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ece00/0xc2b9a3a739857b45 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613044:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613050:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613062:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613067:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ec600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.613070:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613077:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613085:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:0.0:1789760716.613088:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760716.613090:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613097:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec600/0xc2b9a3a739857b5a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613108:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613114:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613120:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613125:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.613128:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613142:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613151:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760716.613154:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760716.613157:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613163:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5200/0xc2b9a3a739857bae lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613174:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613180:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613187:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613192:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.613194:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.613201:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789760716.613844:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 3 committed batchid 2 00000020:00080000:3.0:1789760716.614098:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 2 00010000:00010000:0.0:1789760716.614193:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:0.0:1789760716.614198:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760716.614312:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.614396:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857bdf lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.614414:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.614421:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.614427:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.614432:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760716.614436:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.614443:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.614452:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760716.614454:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760716.614457:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.614462:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542200/0xc2b9a3a739857c09 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760716.617885:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+38:2406:x1876699777183616:12345-192.168.203.38@tcp:4:dd.0 Request processed in 82346us (84662us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789760716.617904:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 21 00002000:00100000:1.0:1789760716.617920:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x5:0x0] (4194304->5242879) req@ffff97e57aabb100 x1876699777183616/t4294967437(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760716.617932:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57aabb100 with x1876699777183616 ext(4194304->5242879) 00002000:00010000:1.0:1789760716.617940:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57aabb100 00000100:00100000:1.0:1789760716.623946:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2405:x1876699777183744:12345-192.168.203.38@tcp:4:dd.0 Request processed in 80422us (80820us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789760716.623965:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 22 00002000:00100000:1.0:1789760716.623984:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x5:0x0] (4194304->5242879) req@ffff97e546385500 x1876699777183744/t4294967336(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760716.623997:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546385500 with x1876699777183744 ext(4194304->5242879) 00002000:00010000:1.0:1789760716.624004:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e546385500 00000100:00100000:1.0:1789760716.628910:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760716.630618:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777184640 00000100:00100000:3.0:1789760716.630648:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777184640 00002000:00100000:3.0:1789760716.630844:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (2097152->3145727) req@ffff97e57f75a680 x1876699777184640/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760716.630857:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f75a680 with x1876699777184640 ext(2097152->3145727) 00002000:00010000:3.0:1789760716.630865:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f75a680 00000100:00100000:3.0:1789760716.630919:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392788801034 time 392788701034 state 0x1 ref 6 00000100:00100000:3.0:1789760716.630961:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392788801034 time 392815170334 state 0x0 ref 6 00000100:00100000:3.0:1789760716.630975:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+38:2405:x1876699777184640:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760716.632462:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760716.633160:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777184512 00000100:00100000:1.0:1789760716.633173:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777184512 00002000:00100000:1.0:1789760716.634197:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x5:0x0] (0->1048575) req@ffff97e57f7f7480 x1876699777184512/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760716.634383:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f7480 with x1876699777184512 ext(0->1048575) 00002000:00010000:1.0:1789760716.634392:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f7f7480 00000100:00100000:1.0:1789760716.634490:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392815270334 time 392815170334 state 0x1 ref 7 00000100:00100000:2.0:1789760716.635351:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2404:x1876699777183872:12345-192.168.203.38@tcp:4:dd.0 Request processed in 71945us (78392us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789760716.635362:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 23 00002000:00100000:2.0:1789760716.635374:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x5:0x0] (3145728->4194303) req@ffff97e57f7f5180 x1876699777183872/t4294967337(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.635383:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f5180 with x1876699777183872 ext(3145728->4194303) 00002000:00010000:2.0:1789760716.635388:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f5180 00000100:00100000:2.0:1789760716.635443:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392815270334 time 392819650316 state 0x0 ref 6 00000100:00100000:2.0:1789760716.635459:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+40:2405:x1876699777184512:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:1.0:1789760716.641759:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2406:x1876699777184000:12345-192.168.203.38@tcp:4:dd.0 Request processed in 70118us (75134us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789760716.641775:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 24 00002000:00100000:1.0:1789760716.641804:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x5:0x0] (1048576->2097151) req@ffff97e546384e00 x1876699777184000/t4294967338(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760716.641815:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546384e00 with x1876699777184000 ext(1048576->2097151) 00002000:00010000:1.0:1789760716.641822:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e546384e00 00000100:00100000:2.0:1789760716.642996:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.643038:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777184768 00000100:00100000:0.0:1789760716.643053:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777184768 00002000:00100000:0.0:1789760716.643119:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x5:0x0] (7340032->8388607) req@ffff97e57f7f6d80 x1876699777184768/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760716.643152:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f6d80 with x1876699777184768 ext(7340032->8388607) 00002000:00010000:0.0:1789760716.643157:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f6d80 00000100:00100000:0.0:1789760716.643737:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392819750316 time 392819650316 state 0x1 ref 6 00000100:00100000:0.0:1789760716.643777:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392819750316 time 392827985573 state 0x0 ref 6 00000100:00100000:0.0:1789760716.643825:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2406:x1876699777184768:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760716.656905:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.658358:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2406:x1876699777179392:12345-192.168.203.38@tcp:4:dd.500 Request processed in 61536us (784207us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1789760716.658369:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 10 00002000:00100000:2.0:1789760716.658382:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x4:0x0] (4194304->5242879) req@ffff97e57fd78700 x1876699777179392/t4294967339(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760716.658393:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57fd78700 with x1876699777179392 ext(4194304->5242879) 00002000:00010000:2.0:1789760716.658400:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57fd78700 00000100:00100000:2.0:1789760716.658423:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777184896 00000100:00100000:2.0:1789760716.658429:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777184896 00002000:00100000:2.0:1789760716.658454:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x5:0x0] (2097152->3145727) req@ffff97e57f7f7b80 x1876699777184896/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.658462:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f7b80 with x1876699777184896 ext(2097152->3145727) 00002000:00010000:2.0:1789760716.658465:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f7b80 00000100:00100000:2.0:1789760716.658498:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392828085573 time 392827985573 state 0x1 ref 7 00000100:00100000:2.0:1789760716.658876:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392828085573 time 392843083646 state 0x0 ref 7 00000100:00100000:2.0:1789760716.658891:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2405:x1876699777184896:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760716.663192:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2403:x1876699777184128:12345-192.168.203.38@tcp:4:dd.0 Request processed in 79473us (80351us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789760716.663221:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 25 00002000:00100000:2.0:1789760716.663234:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x5:0x0] (6291456->7340031) req@ffff97e44c6dd880 x1876699777184128/t4294967340(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.663244:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44c6dd880 with x1876699777184128 ext(6291456->7340031) 00002000:00010000:2.0:1789760716.663250:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e44c6dd880 00000100:00100000:0.0:1789760716.684141:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+42:2405:x1876699777184256:12345-192.168.203.38@tcp:4:dd.0 Request processed in 84739us (85354us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789760716.684155:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 26 00002000:00100000:0.0:1789760716.684168:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (6291456->7340031) req@ffff97e57f7f4000 x1876699777184256/t4294967438(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760716.684178:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f4000 with x1876699777184256 ext(6291456->7340031) 00002000:00010000:0.0:1789760716.684184:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f7f4000 00000100:00100000:0.0:1789760716.703050:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+42:2405:x1876699777184640:12345-192.168.203.38@tcp:4:dd.0 Request processed in 72065us (74143us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789760716.703067:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 28 00002000:00100000:0.0:1789760716.703086:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (2097152->3145727) req@ffff97e57f75a680 x1876699777184640/t4294967439(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760716.703098:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f75a680 with x1876699777184640 ext(2097152->3145727) 00002000:00010000:0.0:1789760716.703106:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f75a680 00000100:00100000:1.0:1789760716.703197:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760716.703330:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760716.703375:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777185152 00000100:00100000:2.0:1789760716.703387:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777185152 00000100:00100000:1.0:1789760716.703406:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760716.703422:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777185024 00000100:00100000:0.0:1789760716.703427:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777185024 00002000:00100000:2.0:1789760716.703436:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x5:0x0] (1048576->2097151) req@ffff97e57f918a80 x1876699777185152/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.703445:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f918a80 with x1876699777185152 ext(1048576->2097151) 00002000:00010000:2.0:1789760716.703449:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f918a80 00002000:00100000:0.0:1789760716.703458:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (5242880->6291455) req@ffff97e4498fca80 x1876699777185024/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1789760727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760716.703466:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e4498fca80 with x1876699777185024 ext(5242880->6291455) 00002000:00010000:0.0:1789760716.703469:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e4498fca80 00000100:00100000:2.0:1789760716.703497:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392843183646 time 392843083646 state 0x1 ref 6 00000100:00100000:2.0:1789760716.704097:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392843183646 time 392888302511 state 0x0 ref 6 00000100:00100000:2.0:1789760716.704115:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2404:x1876699777185152:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760716.704130:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392888402511 time 392888302511 state 0x1 ref 6 00000100:00100000:0.0:1789760716.704153:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 1 deadline 392888402511 time 392888363432 state 0x0 ref 6 00000100:00100000:0.0:1789760716.704165:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2404:x1876699777185024:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760716.706476:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777185408 00000100:00100000:3.0:1789760716.706492:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777185408 00000100:00100000:3.0:1789760716.706565:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:3.0:1789760716.706576:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:11934:x1876699777185408:12345-192.168.203.38@tcp:35:dd.0 00000001:00080000:3.0:1789760716.707391:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967354 00000100:00100000:3.0:1789760716.707545:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11934:x1876699777185408:12345-192.168.203.38@tcp:35:dd.0 Request processed in 968us (4141us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789760716.707555:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000020:00080000:3.0:1789760716.707560:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789760716.709537:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2404:x1876699777184384:12345-192.168.203.38@tcp:4:dd.0 Request processed in 105023us (106361us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789760716.709553:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 27 00002000:00100000:2.0:1789760716.709570:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x5:0x0] (3145728->4194303) req@ffff97e57f7f5500 x1876699777184384/t4294967440(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.709582:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f5500 with x1876699777184384 ext(3145728->4194303) 00002000:00010000:2.0:1789760716.709589:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f7f5500 00000100:00100000:2.0:1789760716.712735:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2405:x1876699777184512:12345-192.168.203.38@tcp:4:dd.0 Request processed in 77266us (80267us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789760716.712765:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 29 00002000:00100000:2.0:1789760716.712782:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x5:0x0] (0->1048575) req@ffff97e57f7f7480 x1876699777184512/t4294967441(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.712811:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f7480 with x1876699777184512 ext(0->1048575) 00002000:00010000:2.0:1789760716.712819:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f7f7480 00000100:00100000:2.0:1789760716.725610:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2406:x1876699777184768:12345-192.168.203.38@tcp:4:dd.0 Request processed in 81805us (82604us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789760716.725638:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 30 00002000:00100000:2.0:1789760716.725657:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x5:0x0] (7340032->8388607) req@ffff97e57f7f6d80 x1876699777184768/t4294967341(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.725668:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f6d80 with x1876699777184768 ext(7340032->8388607) 00002000:00010000:2.0:1789760716.725677:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f6d80 00000100:00100000:2.0:1789760716.732470:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2405:x1876699777184896:12345-192.168.203.38@tcp:4:dd.0 Request processed in 73568us (75560us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789760716.732488:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 31 00002000:00100000:2.0:1789760716.732507:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x5:0x0] (2097152->3145727) req@ffff97e57f7f7b80 x1876699777184896/t4294967342(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.732519:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f7b80 with x1876699777184896 ext(2097152->3145727) 00002000:00010000:2.0:1789760716.732528:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f7b80 00000100:00100000:2.0:1789760716.734719:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2404:x1876699777185152:12345-192.168.203.38@tcp:4:dd.0 Request processed in 30597us (31521us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789760716.734733:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 32 00002000:00100000:2.0:1789760716.734747:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (1048576->2097151) req@ffff97e57f918a80 x1876699777185152/t4294967442(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760716.734769:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f918a80 with x1876699777185152 ext(1048576->2097151) 00002000:00010000:2.0:1789760716.734776:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f918a80 00000100:00100000:3.0:1789760716.736979:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2404:x1876699777185024:12345-192.168.203.38@tcp:4:dd.0 Request processed in 32804us (33640us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789760716.737008:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1789760716.737018:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 1 deadline 392888402511 time 392888363432 state 0x2 ref 0 00002000:00100000:3.0:1789760716.737035:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (5242880->6291455) req@ffff97e4498fca80 x1876699777185024/t4294967443(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760716.737046:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e4498fca80 with x1876699777185024 ext(5242880->6291455) 00002000:00010000:3.0:1789760716.737053:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e4498fca80 00000100:00100000:0.0:1789760716.796958:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 393181151517 time 392981151517 state 0x1 ref 7 00000100:00100000:0.0:1789760716.797002:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2405:x1876699777179520:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760716.804586:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+48:2405:x1876699777179520:12345-192.168.203.38@tcp:4:dd.500 Request processed in 7583us (911021us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789760716.804604:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 11 00002000:00100000:0.0:1789760716.804620:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x4:0x0] (5242880->6291455) req@ffff97e57fbc4380 x1876699777179520/t4294967343(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760716.804632:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57fbc4380 with x1876699777179520 ext(5242880->6291455) 00002000:00010000:0.0:1789760716.804639:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57fbc4380 00000100:00100000:2.0:1789760716.997268:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 393381460733 time 393181460733 state 0x1 ref 6 00000100:00100000:2.0:1789760716.997434:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2403:x1876699777179648:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:3.0:1789760717.007504:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+49:2403:x1876699777179648:12345-192.168.203.38@tcp:4:dd.500 Request processed in 10192us (1095114us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789760717.007517:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 12 00002000:00100000:3.0:1789760717.007534:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x4:0x0] (6291456->7340031) req@ffff97e57ab36680 x1876699777179648/t4294967344(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760717.007545:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab36680 with x1876699777179648 ext(6291456->7340031) 00002000:00010000:3.0:1789760717.007552:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ab36680 00000100:00100000:0.0:1789760717.197452:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 393581646421 time 393381646421 state 0x1 ref 5 00000100:00100000:0.0:1789760717.197496:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+48:2404:x1876699777179776:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760717.227435:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+50:2404:x1876699777179776:12345-192.168.203.38@tcp:4:dd.500 Request processed in 29946us (1279490us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1789760717.227472:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 13 00002000:00100000:0.0:1789760717.227490:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x4:0x0] (7340032->8388607) req@ffff97e57f8d3480 x1876699777179776/t4294967345(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:6/0 lens 488/448 e 0 to 0 dl 1789760726 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760717.227502:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f8d3480 with x1876699777179776 ext(7340032->8388607) 00002000:00010000:0.0:1789760717.227509:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f8d3480 00010000:00010000:3.0:1789760717.320895:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760717.358877:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760717.358982:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760717.359015:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760717.359044:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760717.359078:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777185792 00000100:00100000:1.0:1789760717.359090:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777185792 00000100:00100000:1.0:1789760717.359163:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777185664 00000100:00100000:1.0:1789760717.359167:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777185664 00000100:00100000:1.0:1789760717.359188:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777185920 00000100:00100000:1.0:1789760717.359190:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777185920 00000100:00100000:1.0:1789760717.359213:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 369 00000100:00100000:1.0:1789760717.359224:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777185792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760717.359327:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777185792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 103us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760717.359335:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 369 00000100:00100000:1.0:1789760717.359354:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 370 00000100:00100000:1.0:1789760717.359379:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777185664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760717.359406:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777185664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760717.359413:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 370 00000100:00100000:1.0:1789760717.359427:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 371 00000100:00100000:1.0:1789760717.359433:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777185920:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760717.359457:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777185920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760717.359464:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 371 00000100:00080000:2.0:1789760717.359718:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760717.359723:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760717.367550:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777185536 00000100:00100000:0.0:1789760717.367569:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777185536 00000100:00100000:0.0:1789760717.367670:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 368 00000100:00100000:0.0:1789760717.367683:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777185536:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760717.367812:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777185536:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 131us (8945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760717.367820:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 368 00000100:00100000:1.0:1789760717.397880:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 393782073101 time 393582073101 state 0x1 ref 4 00000100:00100000:1.0:1789760717.397927:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777179904:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760717.414960:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2403:x1876699777179904:12345-192.168.203.38@tcp:4:dd.500 Request processed in 17038us (1383499us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789760717.414978:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 14 00002000:00100000:0.0:1789760717.414995:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x4:0x0] (4194304->5242879) req@ffff97e548820a80 x1876699777179904/t4294967444(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760717.415006:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e548820a80 with x1876699777179904 ext(4194304->5242879) 00002000:00010000:0.0:1789760717.415013:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e548820a80 00000100:00100000:2.0:1789760717.598091:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 393982284820 time 393782284820 state 0x1 ref 3 00000100:00100000:2.0:1789760717.598138:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2404:x1876699777180032:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760717.609141:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+48:2404:x1876699777180032:12345-192.168.203.38@tcp:4:dd.500 Request processed in 11011us (1549573us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1789760717.609159:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 15 00002000:00100000:2.0:1789760717.609176:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x4:0x0] (5242880->6291455) req@ffff97e57ab36d80 x1876699777180032/t4294967445(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760717.609189:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab36d80 with x1876699777180032 ext(5242880->6291455) 00002000:00010000:2.0:1789760717.609198:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab36d80 00000100:00100000:2.0:1789760717.798295:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 394182480143 time 393982480143 state 0x1 ref 2 00000100:00100000:2.0:1789760717.798340:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+47:2406:x1876699777180160:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760717.810722:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+49:2406:x1876699777180160:12345-192.168.203.38@tcp:4:dd.500 Request processed in 12388us (1583689us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789760717.810740:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 16 00002000:00100000:2.0:1789760717.810776:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (6291456->7340031) req@ffff97e57ab34e00 x1876699777180160/t4294967446(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760717.810809:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab34e00 with x1876699777180160 ext(6291456->7340031) 00002000:00010000:2.0:1789760717.810817:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab34e00 00000100:00100000:2.0:1789760718.000086:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 394182480143 time 394184281470 state 0x0 ref 1 00000100:00100000:2.0:1789760718.000137:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+48:2405:x1876699777180288:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760718.026724:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+50:2405:x1876699777180288:12345-192.168.203.38@tcp:4:dd.500 Request processed in 26598us (1772766us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789760718.026743:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1789760718.026758:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 394182480143 time 394184281470 state 0x2 ref 0 00002000:00100000:0.0:1789760718.026833:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x4:0x0] (7340032->8388607) req@ffff97e57ab37800 x1876699777180288/t4294967447(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1789760727 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760718.026845:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab37800 with x1876699777180288 ext(7340032->8388607) 00002000:00010000:0.0:1789760718.026853:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab37800 00000100:00100000:1.0:1789760718.114552:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.114729:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777186048 00000100:00100000:0.0:1789760718.114743:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777186048 00000100:00100000:0.0:1789760718.115012:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1789760718.115026:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+50:10517:x1876699777186048:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760718.115044:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00002000:00010000:0.0:1789760718.115081:0:6450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789760718.115084:0:6450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789760714 -> 1789760715 00002000:00010000:0.0:1789760718.115087:0:6450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789760714 -> 1789760715 00010000:00010000:0.0:1789760718.115123:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857c17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211af3 expref: 50 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760718.115164:0:6450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789760718.115167:0:6450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789760714 -> 1789760716 00002000:00010000:0.0:1789760718.115170:0:6450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789760714 -> 1789760716 00010000:00010000:0.0:1789760718.115180:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857c41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 10 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b01 expref: 49 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.115196:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b621b45/0xc2b9a3a739857c79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b39 expref: 48 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.115209:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739857caa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b6a expref: 47 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.115245:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007da0961/0xc2b9a3a739857c4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b0f expref: 46 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.115258:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000357ab3f2/0xc2b9a3a739857c87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b47 expref: 45 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.115271:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739857c8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b4e expref: 44 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.115293:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857c9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b63 expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.115305:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c076610b/0xc2b9a3a739857c64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b24 expref: 42 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.115319:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760718.115599:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+41:10517:x1876699777186048:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 575us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760718.115609:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00080000:2.0:1789760718.115896:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760718.132543:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.132908:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777186176 00000100:00100000:0.0:1789760718.132923:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777186176 00000100:00100000:0.0:1789760718.133138:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1789760718.133152:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+50:6389:x1876699777186176:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760718.133170:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00002000:00010000:0.0:1789760718.133214:0:6452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789760718.133217:0:6452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb mtime from disk: 1789760714 -> 1789760715 00002000:00010000:0.0:1789760718.133219:0:6452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb ctime from disk: 1789760714 -> 1789760715 00010000:00010000:0.0:1789760718.133254:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1fcef97/0xc2b9a3a739857c10 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aec expref: 50 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760718.133304:0:6452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789760718.133307:0:6452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb mtime from disk: 1789760714 -> 1789760716 00002000:00010000:0.0:1789760718.133309:0:6452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb ctime from disk: 1789760714 -> 1789760716 00010000:00010000:0.0:1789760718.133319:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df0b6608/0xc2b9a3a739857c80 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b40 expref: 49 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.133336:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038f20357/0xc2b9a3a739857c95 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b55 expref: 48 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.133349:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000824f0ff/0xc2b9a3a739857c6b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 8 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b2b expref: 47 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.133361:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857ca3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b5c expref: 46 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.133373:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e966e041/0xc2b9a3a739857c56 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b16 expref: 45 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.133385:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e672949/0xc2b9a3a739857c5d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b1d expref: 44 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.133414:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b00829/0xc2b9a3a739857c48 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b08 expref: 43 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.133428:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a37527/0xc2b9a3a739857c72 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b32 expref: 42 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.133442:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760718.133533:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+41:6389:x1876699777186176:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 385us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760718.133542:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00080000:2.0:1789760718.138511:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760718.266916:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760718.267032:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777186432 00000100:00100000:1.0:1789760718.267040:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777186432 00000100:00100000:1.0:1789760718.267147:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1789760718.267155:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11962:x1876699777186432:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760718.267176:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760718.267193:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5a00/0xc2b9a3a739857cb1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b71 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.267250:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.267260:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.267302:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.267318:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.267326:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.267333:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760718.267375:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789760718.268131:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5600/0xc2b9a3a739857cc6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268143:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5600/0xc2b9a3a739857cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268151:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5600/0xc2b9a3a739857cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760718.268161:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 16777216 00010000:00010000:1.0:1789760718.268256:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268263:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268268:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268287:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268303:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760718.268308:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268315:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268328:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:1.0:1789760718.268331:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760718.268336:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268342:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5c00/0xc2b9a3a739857cb8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268356:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268371:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268377:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268382:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760718.268385:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268392:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268412:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x2ab29dc6 (ffff97e5461f2900) 00010000:00010000:1.0:1789760718.268414:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760718.268417:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 2/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268423:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5e00/0xc2b9a3a739857cbf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268476:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5a00/0xc2b9a3a739857cb1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b71 expref: 14 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268491:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5600/0xc2b9a3a739857cc6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b71 expref: 13 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.268498:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:1.0:1789760718.268500:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760718.268503:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f5600, rc 0) 00000100:00100000:1.0:1789760718.268577:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11962:x1876699777186432:12345-192.168.203.38@tcp:101:dd.0 Request processed in 1418us (1667us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789760718.268585:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:3.0:1789760718.279776:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760718.279914:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.280639:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777186560 00000100:00100000:0.0:1789760718.280654:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777186560 00000100:00100000:0.0:1789760718.280724:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777186688 00000100:00100000:0.0:1789760718.280727:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777186688 00000100:00100000:0.0:1789760718.280859:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:0.0:1789760718.280873:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+42:11962:x1876699777186560:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760718.280896:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760718.280938:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b78 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760718.280978:0:8110:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad94cb, atime: 0x6aad94ca, ctime: 0x6aad94cb, blocks: 0x1 00010000:00010000:0.0:1789760718.281007:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1789760718.281013:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760718.281024:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.281070:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.281086:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548543200, rc 0) 00000100:00100000:0.0:1789760718.281160:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+43:11962:x1876699777186560:12345-192.168.203.38@tcp:101:dd.0 Request processed in 291us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760718.281167:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:0.0:1789760718.281189:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:0.0:1789760718.281196:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+42:11965:x1876699777186688:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760718.281203:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760718.281211:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b7f expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.281223:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760718.281227:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760718.281232:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.281243:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.281253:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542000, rc 0) 00000100:00100000:0.0:1789760718.281284:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+43:11965:x1876699777186688:12345-192.168.203.38@tcp:101:dd.0 Request processed in 80us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760718.281312:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:1.0:1789760718.286715:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760718.286928:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777186816 00000100:00100000:1.0:1789760718.286941:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777186816 00000100:00100000:1.0:1789760718.287016:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:1.0:1789760718.287029:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+43:11963:x1876699777186816:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760718.287053:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760718.292617:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b86 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.292685:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.292690:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.292705:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 44 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.292726:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 44 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.292744:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f5e00, rc 0) 00000100:00100000:1.0:1789760718.292855:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+44:11963:x1876699777186816:12345-192.168.203.38@tcp:101:dd.0 Request processed in 5827us (6153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760718.292866:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:2.0:1789760718.318707:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.318771:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.318839:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.318871:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.318904:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777186944 00000100:00100000:2.0:1789760718.318917:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777186944 00000100:00100000:2.0:1789760718.318986:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777187072 00000100:00100000:2.0:1789760718.318990:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777187072 00000100:00100000:2.0:1789760718.319001:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777187200 00000100:00100000:2.0:1789760718.319004:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777187200 00000100:00100000:2.0:1789760718.319012:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777187328 00000100:00100000:2.0:1789760718.319015:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777187328 00000100:00100000:2.0:1789760718.319032:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:2.0:1789760718.319044:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+47:11971:x1876699777186944:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760718.319070:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760718.319096:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b8d expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319156:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760718.319161:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760718.319172:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 48 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319193:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 48 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319209:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57d2f2c00, rc 0) 00000100:00100000:2.0:1789760718.319289:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+48:11971:x1876699777186944:12345-192.168.203.38@tcp:101:dd.0 Request processed in 233us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760718.319306:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:2.0:1789760718.319330:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:2.0:1789760718.319337:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+47:11966:x1876699777187072:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760718.319344:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760718.319352:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b94 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319366:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760718.319369:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760718.319374:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 48 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319384:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 48 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319400:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57d2f3400, rc 0) 00000100:00100000:2.0:1789760718.319421:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+48:11966:x1876699777187072:12345-192.168.203.38@tcp:101:dd.0 Request processed in 85us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760718.319429:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:2.0:1789760718.319442:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:2.0:1789760718.319448:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+47:11961:x1876699777187200:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760718.319455:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760718.319461:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211b9b expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319473:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760718.319475:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760718.319481:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 48 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319490:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 48 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319498:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57d2f2a00, rc 0) 00000100:00100000:2.0:1789760718.319530:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+48:11961:x1876699777187200:12345-192.168.203.38@tcp:101:dd.0 Request processed in 83us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760718.319536:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:2.0:1789760718.319548:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:2.0:1789760718.319554:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+47:11968:x1876699777187328:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760718.319567:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760718.319575:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ba2 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319588:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760718.319590:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760718.319596:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 48 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319605:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 48 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.319613:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57d2f2600, rc 0) 00000100:00100000:2.0:1789760718.319632:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+48:11968:x1876699777187328:12345-192.168.203.38@tcp:101:dd.0 Request processed in 78us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760718.319638:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:2.0:1789760718.319699:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.319730:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777187456 00000100:00100000:2.0:1789760718.319735:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777187456 00002000:00100000:2.0:1789760718.319774:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x4:0x0] (0->1048575) req@ffff97e57f7f7800 x1876699777187456/t0(0) o3->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1789760729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760718.319784:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f7800 with x1876699777187456 ext(0->1048575) 00002000:00010000:2.0:1789760718.319821:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f7800 00000100:00100000:2.0:1789760718.319836:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 1 deadline 392888402511 time 392888363432 state 0x0 ref 1 00000100:00100000:2.0:1789760718.319847:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 1 deadline 392888463432 time 392888363432 state 0x1 ref 1 00000100:00100000:2.0:1789760718.319874:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392888463432 time 394504083491 state 0x0 ref 1 00000100:00100000:2.0:1789760718.319884:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+48:2405:x1876699777187456:12345-192.168.203.38@tcp:3:dd.0 00000100:00100000:0.0:1789760718.341061:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+48:2405:x1876699777187456:12345-192.168.203.38@tcp:3:dd.0 Request processed in 21153us (21337us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760718.341079:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:0.0:1789760718.341091:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392888463432 time 394504083491 state 0x2 ref 0 00002000:00100000:0.0:1789760718.341113:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x4:0x0] (0->1048575) req@ffff97e57f7f7800 x1876699777187456/t0(0) o3->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:9/0 lens 488/440 e 0 to 0 dl 1789760729 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760718.341125:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f7800 with x1876699777187456 ext(0->1048575) 00002000:00010000:0.0:1789760718.341133:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f7f7800 00010000:00010000:2.0:1789760718.344061:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760718.374532:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760718.374614:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777187712 00000100:00100000:3.0:1789760718.374629:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777187712 00000100:00100000:3.0:1789760718.374745:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1789760718.374764:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11964:x1876699777187712:12345-192.168.203.38@tcp:35:dd.0 00000100:00100000:3.0:1789760718.375100:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11964:x1876699777187712:12345-192.168.203.38@tcp:35:dd.0 Request processed in 345us (581us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789760718.375127:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1789760718.400065:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.400304:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777187840 00000100:00100000:2.0:1789760718.400318:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777187840 00000100:00100000:2.0:1789760718.400399:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:2.0:1789760718.400412:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11978:x1876699777187840:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1789760718.400442:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760718.400470:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a739857d05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ba9 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.400556:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739857d0c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.400574:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739857d0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.400587:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739857d0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760718.400630:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00000004:00200000:2.0:1789760718.400635:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760718.400658:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739857d0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.400688:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00a00/0xc2b9a3a739857d05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba9 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.400741:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739857d0c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba9 expref: 15 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.400765:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760718.400769:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760718.400773:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00800, rc 0) 00000100:00100000:2.0:1789760718.400888:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11978:x1876699777187840:12345-192.168.203.38@tcp:101:rm.0 Request processed in 478us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760718.400896:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:1.0:1789760718.405404:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760718.405544:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777188096 00000100:00100000:3.0:1789760718.405559:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777188096 00000100:00100000:3.0:1789760718.405629:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:3.0:1789760718.405642:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11978:x1876699777188096:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760718.405668:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760718.405698:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bb0 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760718.405858:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00010000:00010000:3.0:1789760718.406042:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d13 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bb0 expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.406423:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e544c16400) 00010000:00010000:3.0:1789760718.406428:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789760718.406435:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bb0 expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.406462:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4e00, rc 0) 00000100:00100000:2.0:1789760718.406667:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+16:11978:x1876699777188096:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1025us (1275us total) trans 4294967358 rc 301/301 00000100:00100000:2.0:1789760718.406677:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:1.0:1789760718.411390:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.411595:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777188224 00000100:00100000:2.0:1789760718.411610:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777188224 00000100:00100000:2.0:1789760718.411714:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1789760718.411728:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565dd9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+16:11978:x1876699777188224:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:2.0:1789760718.416485:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565dd9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+16:11978:x1876699777188224:12345-192.168.203.38@tcp:37:rm.0 Request processed in 4745us (5095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760718.416500:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1789760718.425044:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760718.425149:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777188480 00000100:00100000:3.0:1789760718.425161:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777188480 00000100:00100000:3.0:1789760718.425236:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:3.0:1789760718.425249:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+16:11978:x1876699777188480:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:3.0:1789760718.425570:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+17:11978:x1876699777188480:12345-192.168.203.38@tcp:35:rm.0 Request processed in 322us (540us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1789760718.425579:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:1.0:1789760718.428438:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.428567:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777188736 00000100:00100000:0.0:1789760718.428580:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777188736 00000100:00100000:0.0:1789760718.428690:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:0.0:1789760718.428703:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+17:11978:x1876699777188736:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1789760718.428734:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760718.428774:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543400/0xc2b9a3a739857d21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bb7 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.428947:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542600/0xc2b9a3a739857d28 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.428965:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542600/0xc2b9a3a739857d28 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.428979:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542600/0xc2b9a3a739857d28 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760718.429023:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00010000:00010000:0.0:1789760718.429183:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543400/0xc2b9a3a739857d21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bb7 expref: 20 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.429209:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542600/0xc2b9a3a739857d28 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bb7 expref: 19 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.429218:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:0.0:1789760718.429221:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789760718.429225:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542600, rc 0) 00000100:00100000:0.0:1789760718.429310:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11978:x1876699777188736:12345-192.168.203.38@tcp:101:rm.0 Request processed in 610us (887us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789760718.429317:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:1.0:1789760718.432379:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.432534:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777188864 00000100:00100000:0.0:1789760718.432548:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777188864 00000100:00100000:0.0:1789760718.432628:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:0.0:1789760718.432642:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11978:x1876699777188864:12345-192.168.203.38@tcp:41:rm.0 00000004:00000024:0.0:1789760718.432728:0:6467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7713325056 00000100:00100000:0.0:1789760718.432861:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11978:x1876699777188864:12345-192.168.203.38@tcp:41:rm.0 Request processed in 222us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760718.432870:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:1.0:1789760718.440337:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.440457:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777189120 00000100:00100000:2.0:1789760718.440470:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777189120 00000100:00100000:2.0:1789760718.440547:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:2.0:1789760718.440558:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11978:x1876699777189120:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1789760718.440635:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789760718.440694:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed000/0xc2b9a3a739857c33 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211afa expref: 19 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.440724:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ec200/0xc2b9a3a739857b61 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211aa6 expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.440739:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760718.440759:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739857d0c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba9 expref: 17 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.440769:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760718.440774:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760718.441197:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.441215:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.441227:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.441244:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.441251:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.441258:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.441651:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.441665:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.441673:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789760718.443191:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789760718.443207:0:6465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 394627418204ns, next at 395627415122ns, rc = 0 00000040:00080000:2.0:1789760718.443388:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789760718.443396:0:6465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 394627607990ns, next at 395627606310ns, rc = 0 00010000:00010000:2.0:1789760718.443488:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443506:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443517:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443527:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443534:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443541:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443820:0:6465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789760718.443849:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443869:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443875:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443882:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760718.443887:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443895:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443909:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0a100) 00010000:00010000:2.0:1789760718.443912:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789760718.443917:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443923:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01000/0xc2b9a3a739857d44 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443946:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443953:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443959:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443964:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760718.443973:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443980:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.443989:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:2.0:1789760718.443991:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760718.443994:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.444000:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01800/0xc2b9a3a739857d36 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760718.444010:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c3207ea reply state 00000000b1463ca9 transno 4294967361 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.444023:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.444030:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x151ecd9f (ffff97e543c0a800) 00010000:00010000:2.0:1789760718.444033:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760718.444036:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760718.444149:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11978:x1876699777189120:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3587us (3822us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789760718.444159:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00010000:00010000:1.0:1789760718.445600:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760718.445616:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.445629:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760718.445633:0:7281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.445664:0:7281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.445683:0:7281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff97e543c0a100) 00010000:00010000:1.0:1789760718.445687:0:7281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789760718.445691:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 1/0,0 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.445696:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a739857d4b lrc: 0/0,0 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.445721:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760718.445723:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760718.445725:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760718.447580:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.447688:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777189376 00000100:00100000:0.0:1789760718.447703:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777189376 00000100:00100000:0.0:1789760718.447783:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:0.0:1789760718.447840:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11978:x1876699777189376:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1789760718.447942:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789760718.447975:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f5600/0xc2b9a3a739857cc6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b71 expref: 18 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448002:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542800/0xc2b9a3a739857b22 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a98 expref: 17 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448014:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760718.448027:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760718.448053:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448068:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448079:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448095:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448103:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448110:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448239:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448249:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.448269:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789760718.449091:0:12655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000040:00080000:0.0:1789760718.449120:0:12655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00010000:00010000:0.0:1789760718.449200:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449213:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449223:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449230:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449238:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449244:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449262:0:12655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760718.449296:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449303:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449313:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449335:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760718.449340:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449348:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449363:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e5489b1e00) 00010000:00010000:0.0:1789760718.449367:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760718.449371:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449382:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543600/0xc2b9a3a739857d60 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449404:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449411:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449417:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449427:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449432:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760718.449435:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449454:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449463:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:0.0:1789760718.449465:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760718.449468:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449474:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542a00/0xc2b9a3a739857d52 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760718.449486:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064651f24 reply state 00000000068f550e transno 4294967362 ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449497:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.449504:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x2ab29dc6 (ffff97e5489b1100) 00010000:00010000:0.0:1789760718.449506:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760718.449509:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760718.449612:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11978:x1876699777189376:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1773us (2044us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789760718.449621:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00010000:00010000:3.0:1789760718.451201:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760718.451215:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.451227:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760718.451232:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.451242:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.451261:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff97e5489b1e00) 00010000:00010000:3.0:1789760718.451265:0:6454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789760718.451269:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.451285:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543800/0xc2b9a3a739857d67 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.451311:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760718.451313:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760718.451315:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760718.456968:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.457021:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760718.457163:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777189504 00000100:00100000:2.0:1789760718.457181:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777189504 00000100:00100000:2.0:1789760718.457284:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1789760718.457302:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777189504:12345-192.168.203.38@tcp:103:rm.0 00010000:00010000:2.0:1789760718.457352:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760718.457395:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540030a00/0xc2b9a3a739857a6c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a59 expref: 7 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.457421:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e543c0a600) 00010000:00010000:2.0:1789760718.457434:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760718.457592:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777189760 00000100:00100000:3.0:1789760718.457598:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777189760 00000100:00100000:3.0:1789760718.457634:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1789760718.457642:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11978:x1876699777189760:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:2.0:1789760718.458066:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777189504:12345-192.168.203.38@tcp:103:rm.0 Request processed in 766us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760718.458075:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1789760718.458607:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11978:x1876699777189760:12345-192.168.203.38@tcp:35:rm.0 Request processed in 963us (1647us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789760718.458614:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:1.0:1789760718.463547:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.464284:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777190016 00000100:00100000:0.0:1789760718.464303:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777190016 00000100:00100000:0.0:1789760718.464584:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:0.0:1789760718.464597:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11978:x1876699777190016:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1789760718.464693:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789760718.464727:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548542600/0xc2b9a3a739857d28 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bb7 expref: 19 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.464753:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f3ed800/0xc2b9a3a739857af1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a8a expref: 18 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.464766:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2e00) 00010000:00010000:0.0:1789760718.464779:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760718.464940:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.464950:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.464962:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760718.464988:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aabb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798205824:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789760718.465129:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760718.465261:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e543e53300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760718.466894:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798205824 00000100:00100000:3.0:1789760718.466932:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798205824 00000100:00100000:3.0:1789760718.467039:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789760718.467058:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6466:x1876699798205824:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789760718.467080:0:7305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760718.467105:0:7305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739857d6e expref: -99 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.467141:0:7305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 5 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.467152:0:7305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857d6e expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.467191:0:7305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 5 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.467207:0:7305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 5 pid: 6467 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760718.467223:0:7305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab35c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798205952:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760718.467490:0:7305:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789760718.469859:0:7305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab35c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798205952:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760718.469909:0:7305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857d6e expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.469924:0:7305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760718.469927:0:7305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760718.469954:0:7305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857d6e expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.469967:0:7305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4e00, rc 0) 00000100:00100000:3.0:1789760718.470041:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6466:x1876699798205824:12345-0@lo:101:mdt00_001.0 Request processed in 2994us (4912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760718.470063:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789760718.470199:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aabb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798205824:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789760718.470223:0:6466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.470235:0:6466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760718.474431:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760718.476366:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777190144 00000100:00100000:0.0:1789760718.476388:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777190144 00010000:00010000:0.0:1789760718.476457:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 6 pid: 6467 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760718.476516:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:0.0:1789760718.476529:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777190144:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760718.476550:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760718.476559:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 6 pid: 6467 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.476576:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 6 pid: 6467 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.476604:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e540031400/0xc2b9a3a739857a81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211a67 expref: 6 pid: 6467 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.476629:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760718.476638:0:6452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857d6e expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.476652:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc2b9a3a739857d6e expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.476663:0:6452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc2b9a3a739857d6e expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.476734:0:6452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857d6e expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760718.476752:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aab9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6452:1876699798206080:0@lo:105: 00000100:00100000:0.0:1789760718.476902:0:6452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760718.476956:0:6452:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e543e53300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760718.478916:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798206080 00000100:00100000:3.0:1789760718.478934:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798206080 00000100:00100000:3.0:1789760718.479042:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789760718.479054:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6452:x1876699798206080:12345-0@lo:105: 00010000:00010000:3.0:1789760718.479074:0:6449:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.479088:0:6449:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.479099:0:6449:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.479108:0:6449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.479118:0:6449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.479129:0:6449:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.479245:0:6449:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97e548542a00) 00000100:00100000:3.0:1789760718.479361:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6452:x1876699798206080:12345-0@lo:105: Request processed in 310us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760718.479370:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760718.479578:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aab9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6452:1876699798206080:0@lo:105: 00010000:00010000:2.0:1789760718.479606:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760718.479668:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777190144:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 3140us (5252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760718.479677:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00010000:00010000:1.0:1789760718.486069:0:6466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.486099:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760718.486155:0:6466:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760718.486241:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.486248:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.486263:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760718.486324:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798206208:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789760718.486423:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760718.486478:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5412ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760718.486579:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798206208 00000100:00100000:3.0:1789760718.486590:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798206208 00000100:00100000:3.0:1789760718.486659:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789760718.486671:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6466:x1876699798206208:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789760718.486691:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760718.486712:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857d83 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739857d7c expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.486742:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857d83 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857d7c expref: 8 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.486758:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857d83 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857d7c expref: 8 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.486767:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16400) 00010000:00010000:3.0:1789760718.486771:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760718.486774:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5a00, rc 0) 00000100:00100000:3.0:1789760718.486856:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6466:x1876699798206208:12345-0@lo:101:mdt00_001.0 Request processed in 187us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760718.486863:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789760718.486995:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798206208:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789760718.487013:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.487024:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760718.487042:0:6466:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1789760718.487084:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f05ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798206336:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789760718.487115:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760718.487139:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5412ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1789760718.487189:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798206336 00000100:00100000:3.0:1789760718.487194:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798206336 00000100:00100000:3.0:1789760718.487234:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789760718.487241:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6466:x1876699798206336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789760718.487556:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6466:x1876699798206336:12345-0@lo:1000:mdt00_001.0 Request processed in 314us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760718.487564:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789760718.491626:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f05ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798206336:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789760718.491766:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798206464:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789760718.491948:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760718.492022:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e543e53540 going to sleep for 11 seconds 00000100:00100000:3.0:1789760718.492431:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798206464 00000100:00100000:3.0:1789760718.492442:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798206464 00000100:00100000:3.0:1789760718.492544:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789760718.492555:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6466:x1876699798206464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789760718.492929:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6466:x1876699798206464:12345-0@lo:1000:mdt00_001.0 Request processed in 375us (980us total) trans 0 rc 1/1 00000100:00100000:3.0:1789760718.492938:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789760718.493025:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798206464:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789760718.493107:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.493121:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.493132:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760718.493148:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798206592:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789760718.493180:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760718.497869:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5412ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760718.498133:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798206592 00000100:00100000:1.0:1789760718.498150:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798206592 00000100:00100000:1.0:1789760718.498241:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789760718.498257:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6466:x1876699798206592:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789760718.498295:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760718.498329:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a739857d91 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739857d8a expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.500231:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a739857d91 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739857d8a expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.500263:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a739857d91 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857d8a expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.500313:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2600) 00010000:00010000:1.0:1789760718.500317:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760718.500322:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f5a00, rc 0) 00000100:00100000:0.0:1789760718.500563:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6466:x1876699798206592:12345-0@lo:101:mdt00_001.0 Request processed in 2306us (7377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760718.500575:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789760718.500994:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6466:1876699798206592:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789760718.501027:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.501123:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.501189:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.501200:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.501210:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789760718.505898:0:6466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].4, 424 off35584 00000040:00080000:0.0:1789760718.506491:0:6466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].4, 504 off36048 00000004:00080000:0.0:1789760718.506505:0:6466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e543f30180 with version 9 00000004:00080000:3.0:1789760718.506609:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 9 rpc_version 9 00000020:00100000:3.0:1789760718.506667:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789760718.506686:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e57ab35c00 x1876699798206848/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789760718.506725:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab35c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798206848:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789760718.506913:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760718.507115:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e2a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789760718.511375:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798206848 00000100:00100000:0.0:1789760718.511398:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798206848 00000100:00100000:3.0:1789760718.511842:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789760718.511857:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7275:x1876699798206848:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789760718.513551:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7275:x1876699798206848:12345-0@lo:1000:osp_up0-1.0 Request processed in 1687us (6628us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789760718.513566:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789760718.514757:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab35c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798206848:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1789760718.517472:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 16384 00010000:00010000:2.0:1789760718.519233:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519254:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519262:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519269:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760718.519288:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519317:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519505:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2700) 00010000:00010000:2.0:1789760718.519509:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760718.519515:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519522:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e5461f4400/0xc2b9a3a739857d98 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519554:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519629:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519701:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519735:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789760718.519864:0:6466:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789760718.519873:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519881:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519889:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519922:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1789760718.519929:0:6466:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789760718.519935:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760718.519943:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.519959:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760718.519967:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.519986:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543600 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:3.0:1789760718.519990:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760718.519998:0:7281:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.520040:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.520047:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760718.520070:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 1/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.520077:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548543600/0xc2b9a3a739857d8a lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857d91 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.520092:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760718.520096:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.520102:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542a00 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:3.0:1789760718.520106:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760718.520113:0:7281:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760718.520129:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789760718.520143:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.520149:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789760718.520155:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798206976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760718.520155:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.520162:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e548542a00/0xc2b9a3a739857d6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739857d75 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.520171:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760718.520173:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760718.520175:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760718.520244:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11978:x1876699777190016:12345-192.168.203.38@tcp:36:rm.0 Request processed in 55646us (56707us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789760718.520256:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00010000:00010000:0.0:1789760718.520608:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760718.520617:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760718.520628:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798207104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760718.529654:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760718.530158:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798207104 00000100:00100000:3.0:1789760718.530171:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798207104 00000100:00100000:3.0:1789760718.530325:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760718.530338:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3461:x1876699798207104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760718.530362:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760718.530400:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857d75 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739857d6e expref: 10 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760718.530431:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760718.530438:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760718.530512:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3461:x1876699798207104:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760718.530520:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789760718.532600:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798207104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760718.538959:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760718.539108:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798206976 00000100:00100000:0.0:1789760718.539122:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798206976 00000100:00100000:0.0:1789760718.539210:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760718.539222:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3462:x1876699798206976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760718.539245:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760718.539290:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5a00/0xc2b9a3a739857d91 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739857d8a expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760718.539314:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff97e5461f2600) 00010000:00010000:0.0:1789760718.539326:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760718.539399:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3462:x1876699798206976:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760718.539406:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760718.544364:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798206976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760719.367923:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789760719.561256:0:9532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 395745464062ns, next at 396745460860ns, rc = 0 00000100:00100000:3.0:1789760719.561318:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798207232:0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.561416:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.561481:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798207744:0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.561513:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.561534:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798208256:0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.561557:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.561587:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798208768:0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.561610:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.561635:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789760719.561641:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798207360:0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.561672:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.561692:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798207872:0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.561714:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.561731:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798208384:0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.561749:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.561765:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798208896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760719.561784:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.561866:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798207232 00000100:00100000:3.0:1789760719.561875:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798207232 00000100:00100000:3.0:1789760719.562114:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789760719.562125:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798207232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.562186:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798207232:12345-0@lo:400:kworker.0 Request processed in 63us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.562193:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789760719.562245:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798207744 00000100:00100000:3.0:1789760719.562249:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798207744 00000100:00100000:3.0:1789760719.562288:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789760719.562295:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798207744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.562331:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798207744:12345-0@lo:400:kworker.0 Request processed in 37us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.562337:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789760719.562358:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798208256 00000100:00100000:3.0:1789760719.562362:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798208256 00000100:00100000:3.0:1789760719.562401:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798208768 00000100:00100000:3.0:1789760719.562404:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798208768 00000100:00100000:3.0:1789760719.562424:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789760719.562430:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798208256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.562516:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798208256:12345-0@lo:400:kworker.0 Request processed in 85us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.562522:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789760719.562535:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789760719.562540:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e581c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798208768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.562734:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e581c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798208768:12345-0@lo:400:kworker.0 Request processed in 193us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.562741:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789760719.562845:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798207616:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.562883:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760719.562909:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798208128:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.562943:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760719.562971:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798208640:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.562991:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760719.563006:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789760719.563012:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798207488:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.563034:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760719.563054:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798208000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.563074:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760719.563092:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798208512:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.563116:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760719.563128:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798209024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760719.563150:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760719.563184:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798207360 00000100:00100000:1.0:1789760719.563189:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798207360 00000100:00100000:1.0:1789760719.563215:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798207872 00000100:00100000:1.0:1789760719.563217:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798207872 00000100:00100000:1.0:1789760719.563231:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798208384 00000100:00100000:1.0:1789760719.563234:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798208384 00000100:00100000:1.0:1789760719.563249:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798207616 00000100:00100000:1.0:1789760719.563251:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798207616 00000100:00100000:1.0:1789760719.563271:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798208000 00000100:00100000:1.0:1789760719.563274:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798208000 00000100:00100000:1.0:1789760719.563287:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798208512 00000100:00100000:1.0:1789760719.563289:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798208512 00000100:00100000:1.0:1789760719.563303:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789760719.563309:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798207360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.563345:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798207360:12345-0@lo:400:kworker.0 Request processed in 36us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760719.563350:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789760719.563373:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789760719.563378:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798207872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.563408:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798207872:12345-0@lo:400:kworker.0 Request processed in 29us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760719.563414:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789760719.563426:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789760719.563431:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798208384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.563457:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798208384:12345-0@lo:400:kworker.0 Request processed in 25us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760719.563472:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789760719.563485:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789760719.563491:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798207616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.563521:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798207616:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760719.563528:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789760719.563539:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789760719.563544:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798208000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.563904:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798208128 00000100:00100000:3.0:1789760719.563910:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798208128 00000100:00100000:1.0:1789760719.564020:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798208000:12345-0@lo:400:kworker.0 Request processed in 476us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760719.564027:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789760719.564040:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789760719.564047:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798208512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.564076:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798208512:12345-0@lo:400:kworker.0 Request processed in 30us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760719.564082:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789760719.564115:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798208640 00000100:00100000:1.0:1789760719.564118:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798208640 00000100:00100000:1.0:1789760719.564146:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760719.564152:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798208640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.564184:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798208640:12345-0@lo:400:kworker.0 Request processed in 32us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760719.564190:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760719.564235:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798208000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.564245:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798208512:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.564256:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798207616:0@lo:400:kworker.0 00000100:00100000:1.0:1789760719.564278:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798208640:0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.564379:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789760719.564386:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798208128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.564430:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798208128:12345-0@lo:400:kworker.0 Request processed in 44us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.564447:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789760719.565723:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798208896 00000100:00100000:3.0:1789760719.565734:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798208896 00000100:00100000:3.0:1789760719.565772:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798209024 00000100:00100000:3.0:1789760719.565775:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798209024 00000100:00100000:3.0:1789760719.565806:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789760719.565816:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798208896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760719.565857:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 98631680 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760719.565993:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798208896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 179us (4206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.566000:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789760719.566016:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789760719.566022:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798209024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760719.566033:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 98631680 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760719.566060:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798209024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.566066:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789760719.566087:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798207488 00000100:00100000:3.0:1789760719.566091:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798207488 00000100:00100000:3.0:1789760719.566125:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789760719.566133:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3462:x1876699798207488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760719.566175:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3462:x1876699798207488:12345-0@lo:400:kworker.0 Request processed in 43us (3139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.566182:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:3.0:1789760719.566200:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760719.566207:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760719.566223:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760719.566226:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760719.568915:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798207488:0@lo:400:kworker.0 00000100:00100000:2.0:1789760719.568964:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798209024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760719.568979:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798208128:0@lo:400:kworker.0 00000100:00100000:2.0:1789760719.569044:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798207360:0@lo:400:kworker.0 00000100:00100000:2.0:1789760719.569059:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798207872:0@lo:400:kworker.0 00000100:00100000:2.0:1789760719.569070:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798208384:0@lo:400:kworker.0 00000100:00100000:2.0:1789760719.569088:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798208896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760719.569100:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798207232:0@lo:400:kworker.0 00000100:00100000:2.0:1789760719.569113:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798207744:0@lo:400:kworker.0 00000100:00100000:2.0:1789760719.569126:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798208256:0@lo:400:kworker.0 00000100:00100000:2.0:1789760719.569160:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798208768:0@lo:400:kworker.0 00000001:00080000:0.0:1789760719.664929:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000100:00100000:2.0:1789760719.713522:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.713614:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777190272 00000100:00100000:0.0:1789760719.713625:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777190272 00000100:00100000:0.0:1789760719.713712:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:0.0:1789760719.713723:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11989:x1876699777190272:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:0.0:1789760719.713745:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760719.713766:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857d9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bbe expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.713858:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857da6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.713874:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.713886:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760719.714066:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760719.714071:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760719.714093:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.714120:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857d9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bbe expref: 7 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.714138:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857da6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bbe expref: 6 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.714147:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760719.714150:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760719.714153:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542200, rc 0) 00000100:00100000:0.0:1789760719.714209:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11989:x1876699777190272:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 488us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760719.714223:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00080000:2.0:1789760719.714516:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760719.730377:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.730413:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.730446:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777190400 00000100:00100000:0.0:1789760719.730455:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777190400 00000100:00100000:0.0:1789760719.730500:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777190656 00000100:00100000:0.0:1789760719.730503:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777190656 00000100:00100000:0.0:1789760719.730524:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:0.0:1789760719.730533:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777190400:12345-192.168.203.38@tcp:41:mkdir.0 00000004:00000024:0.0:1789760719.730573:0:6466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760719.730647:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777190400:12345-192.168.203.38@tcp:41:mkdir.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760719.730655:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:0.0:1789760719.730674:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:0.0:1789760719.730681:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11989:x1876699777190656:12345-192.168.203.38@tcp:36:mkdir.0 00010000:00010000:0.0:1789760719.730734:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760719.730762:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857da6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bbe expref: 6 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.730779:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760719.730802:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760719.731188:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.731204:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.731225:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.731238:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.731249:0:6466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857d83 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739857d7c expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.731257:0:6466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.731296:0:6466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857d83 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739857d7c expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760719.731311:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6466:1876699798209152:0@lo:104: 00000100:00100000:0.0:1789760719.731354:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760719.731403:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449602600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760719.731700:0:6449:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789760719.731715:0:6449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798209152 00000100:00100000:2.0:1789760719.731719:0:6449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798209152 00000100:00100000:2.0:1789760719.731754:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760719.731763:0:6449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5799ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6466:x1876699798209152:12345-0@lo:104: 00010000:00010000:2.0:1789760719.731775:0:6449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.731850:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760719.731856:0:6449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5799ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6466:x1876699798209152:12345-0@lo:104: Request processed in 96us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760719.731863:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1789760719.732205:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760719.732212:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.732222:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5c00 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:2.0:1789760719.732228:0:7281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760719.732237:0:7281:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.732278:0:7281:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.732298:0:7281:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760719.732327:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.732335:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e5461f5c00/0xc2b9a3a739857d7c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739857d83 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.732353:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760719.732355:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760719.732357:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760719.732370:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798209280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789760719.732404:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760719.732528:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6466:1876699798209152:0@lo:104: 00010000:00010000:0.0:1789760719.732548:0:6466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760719.733013:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798209280 00000100:00100000:3.0:1789760719.733020:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798209280 00010000:00010000:3.0:1789760719.733047:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857d83 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc2b9a3a739857d7c expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760719.733080:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760719.733088:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f953800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3462:x1876699798209280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760719.733099:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760719.774998:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857d83 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739857d7c expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.775019:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16400) 00010000:00010000:0.0:1789760719.775025:0:6450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.775046:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.775054:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.775085:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760719.775160:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f953800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798209280:12345-0@lo:103:ldlm_bl.0 Request processed in 42071us (42753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760719.775170:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1789760719.775301:0:6466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.775310:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760719.776895:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798209280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760719.778070:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778088:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778099:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760719.778116:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045ee7ad7 reply state 000000002a47991b transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778139:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778145:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:1.0:1789760719.778149:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760719.778152:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789760719.778158:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00010000:00010000:1.0:1789760719.778168:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778175:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778181:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778188:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778193:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760719.778197:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778204:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778214:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760719.778216:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760719.778219:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778226:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542e00/0xc2b9a3a739857dad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760719.778245:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045ee7ad7 reply state 000000002a47991b transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778254:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.778269:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16400) 00010000:00010000:1.0:1789760719.778272:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760719.778275:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789760719.778364:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11989:x1876699777190656:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 47678us (47945us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789760719.778373:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:0.0:1789760719.803543:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.803581:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777190784 00000100:00100000:0.0:1789760719.803589:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777190784 00000100:00100000:0.0:1789760719.803641:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:0.0:1789760719.803651:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11990:x1876699777190784:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1789760719.803692:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760719.803713:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857dc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bc5 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.803773:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857dc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.803805:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.803819:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760719.803866:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760719.803870:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760719.803889:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.803912:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857dc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bc5 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.803941:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bc5 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.803950:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760719.803952:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760719.803956:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542800, rc 0) 00000100:00100000:0.0:1789760719.804006:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11990:x1876699777190784:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 356us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760719.804013:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:3.0:1789760719.813972:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.814105:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777191040 00000100:00100000:0.0:1789760719.814115:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777191040 00000100:00100000:0.0:1789760719.814177:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:0.0:1789760719.814187:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11990:x1876699777191040:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1789760719.814207:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760719.814210:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789760719.814236:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857dc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bc5 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814254:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760719.814277:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760719.814293:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857dd0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bcc expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814434:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814448:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814458:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814471:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814478:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814484:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814551:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814560:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814568:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760719.814577:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00010000:00010000:0.0:1789760719.814589:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814602:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814608:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814614:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760719.814618:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814625:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814635:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:0.0:1789760719.814638:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.814641:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814646:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857de5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814661:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814667:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814673:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814678:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814689:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760719.814693:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814698:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814707:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760719.814709:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.814712:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814718:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857dd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814728:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814734:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814740:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814756:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760719.814759:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814765:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814811:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16400) 00010000:00010000:0.0:1789760719.814814:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.814818:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814824:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857dde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814849:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857dd0 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bcc expref: 8 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814859:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760719.814861:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.814864:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857dd0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bcc expref: 8 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.814874:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542600, rc 0) 00000100:00100000:0.0:1789760719.814996:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11990:x1876699777191040:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 809us (1030us total) trans 0 rc 301/301 00000100:00100000:0.0:1789760719.815004:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:0.0:1789760719.821007:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760719.822255:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777191168 00000100:00100000:1.0:1789760719.822276:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777191168 00000100:00100000:1.0:1789760719.828063:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:1.0:1789760719.828086:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:11990:x1876699777191168:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1789760719.828109:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760719.828130:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5400/0xc2b9a3a739857dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bd3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.828193:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a739857df3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.828207:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a739857df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.828221:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a739857df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760719.828282:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789760719.828286:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789760719.828307:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a739857df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.828332:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f5400/0xc2b9a3a739857dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bd3 expref: 9 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.828348:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a739857df3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bd3 expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.828357:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760719.828359:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789760719.828363:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e5461f4000, rc 0) 00000100:00100000:1.0:1789760719.828702:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11990:x1876699777191168:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 623us (7699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760719.828710:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:0.0:1789760719.833295:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760719.833386:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777191424 00000100:00100000:2.0:1789760719.833397:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777191424 00000100:00100000:2.0:1789760719.833454:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:2.0:1789760719.833463:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11990:x1876699777191424:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760719.833482:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760719.833501:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a739857dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bda expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.833568:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.833581:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.833603:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.833641:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.833649:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.833656:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760719.833768:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00010000:00010000:2.0:1789760719.834166:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834176:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834183:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834190:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760719.834195:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834202:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834214:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760719.834217:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760719.834222:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834239:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a739857e01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834253:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834259:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834275:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834280:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760719.834283:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834290:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834298:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16400) 00010000:00010000:2.0:1789760719.834300:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760719.834312:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834317:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834353:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a739857dfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bda expref: 10 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834380:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760719.834383:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760719.834387:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00000/0xc2b9a3a739857dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bda expref: 10 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.834398:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00000, rc 0) 00000100:00100000:2.0:1789760719.834462:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:11990:x1876699777191424:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 999us (1174us total) trans 4294967342 rc 301/301 00000100:00100000:2.0:1789760719.834469:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:3.0:1789760719.840189:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.840250:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777191680 00000100:00100000:0.0:1789760719.840272:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777191680 00000100:00100000:0.0:1789760719.840370:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:0.0:1789760719.840381:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+9:11990:x1876699777191680:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1789760719.840460:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.840487:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.840499:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760719.840716:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b794fcdd reply state 000000005375be0b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.840730:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.840738:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:0.0:1789760719.840741:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1789760719.840744:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789760719.840752:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00000100:00100000:0.0:1789760719.840869:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11990:x1876699777191680:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 489us (688us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789760719.840876:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:0.0:1789760719.842943:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760719.843138:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777191936 00000100:00100000:2.0:1789760719.843148:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777191936 00000100:00100000:2.0:1789760719.843240:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:2.0:1789760719.843250:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11990:x1876699777191936:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1789760719.843480:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11990:x1876699777191936:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 230us (543us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789760719.843488:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1789760719.857510:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.857675:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777192064 00000100:00100000:0.0:1789760719.857685:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777192064 00000100:00100000:0.0:1789760719.857748:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:0.0:1789760719.857758:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:11991:x1876699777192064:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:0.0:1789760719.857779:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760719.857943:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211be1 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858008:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858029:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858040:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858662:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858676:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858684:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858780:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858815:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858823:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760719.858853:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00000004:00200000:0.0:1789760719.858857:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760719.858875:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858887:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858905:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858912:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858918:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858924:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760719.858928:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858937:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858950:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760719.858953:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.858957:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858965:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858979:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858985:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.858990:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.859001:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760719.859004:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.859010:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.859019:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16400) 00010000:00010000:0.0:1789760719.859022:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.859025:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.859031:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.859364:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543800/0xc2b9a3a739857e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211be1 expref: 14 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.859381:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211be1 expref: 13 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.859388:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:0.0:1789760719.859391:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760719.859393:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542200, rc 0) 00000100:00100000:0.0:1789760719.859514:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11991:x1876699777192064:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 1756us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760719.859522:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:1.0:1789760719.863218:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760719.863331:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777192320 00000100:00100000:2.0:1789760719.863342:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777192320 00000100:00100000:2.0:1789760719.863430:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:2.0:1789760719.863440:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+13:11991:x1876699777192320:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:2.0:1789760719.863490:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760719.863518:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211be1 expref: 13 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.863536:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:2.0:1789760719.863553:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760719.863576:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.863589:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.863598:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760719.864209:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab1199ac reply state 000000002c685b19 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.864223:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.864229:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:2.0:1789760719.864232:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789760719.864235:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760719.864242:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00000100:00100000:2.0:1789760719.864366:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11991:x1876699777192320:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 926us (1155us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789760719.864374:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:0.0:1789760719.881425:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760719.881525:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777192448 00000100:00100000:3.0:1789760719.881535:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777192448 00000100:00100000:3.0:1789760719.881630:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:3.0:1789760719.881642:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+14:11992:x1876699777192448:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:3.0:1789760719.881665:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760719.881686:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857e40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211be8 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.881769:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.881784:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.881838:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.881861:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.881877:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.881884:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.881999:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5800/0xc2b9a3a739857e55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882008:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5800/0xc2b9a3a739857e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882015:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5800/0xc2b9a3a739857e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760719.882036:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00000004:00200000:3.0:1789760719.882040:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789760719.882074:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5800/0xc2b9a3a739857e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882088:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882094:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882101:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882107:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882123:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760719.882129:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882136:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882148:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760719.882151:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760719.882156:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882162:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857e47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882177:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882182:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882188:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882194:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760719.882197:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882202:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882220:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16400) 00010000:00010000:3.0:1789760719.882222:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760719.882225:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882232:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4c00/0xc2b9a3a739857e4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882269:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857e40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211be8 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882284:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5800/0xc2b9a3a739857e55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211be8 expref: 15 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.882291:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:3.0:1789760719.882293:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789760719.882296:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5800, rc 0) 00000100:00100000:3.0:1789760719.882409:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11992:x1876699777192448:12345-192.168.203.38@tcp:101:touch.500 Request processed in 769us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.882417:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:0.0:1789760719.887656:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760719.888188:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777192704 00000100:00100000:1.0:1789760719.888199:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777192704 00000100:00100000:0.0:1789760719.888364:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:0.0:1789760719.888375:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+15:11992:x1876699777192704:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:0.0:1789760719.888395:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760719.888415:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e5c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.888547:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.888562:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.888572:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.888619:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.888628:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.888635:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789760719.889571:0:6466:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789760719.889751:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857e71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.889763:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.889781:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890300:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890310:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890317:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890326:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890333:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760719.890339:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890347:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890362:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:0.0:1789760719.890365:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.890370:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890377:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760719.890395:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040001b86 reply state 00000000568903d5 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890424:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890432:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x4009f790 (ffff97e5489b1400) 00010000:00010000:0.0:1789760719.890436:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760719.890440:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789760719.890489:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bef expref: 18 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890510:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bef expref: 17 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.890519:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e5489b1f00) 00010000:00010000:0.0:1789760719.890521:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760719.890525:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548543c00, rc 0) 00000100:00100000:0.0:1789760719.890644:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11992:x1876699777192704:12345-192.168.203.38@tcp:101:touch.500 Request processed in 2271us (2997us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789760719.890652:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:0.0:1789760719.894396:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760719.894491:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777192960 00000100:00100000:2.0:1789760719.894501:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777192960 00000100:00100000:2.0:1789760719.894584:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:2.0:1789760719.894594:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:11992:x1876699777192960:12345-192.168.203.38@tcp:36:touch.500 00010000:00010000:2.0:1789760719.894650:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760719.894676:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543c00/0xc2b9a3a739857e71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bef expref: 18 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.894710:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e5489b1f00) 00010000:00010000:2.0:1789760719.894720:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760719.894773:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.894827:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.894838:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760719.895095:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0d7679b reply state 00000000b66f6e7d transno 4294967347 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.895108:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.895114:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760719.895117:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760719.895119:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760719.895200:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11992:x1876699777192960:12345-192.168.203.38@tcp:36:touch.500 Request processed in 607us (813us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789760719.895207:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:2.0:1789760719.897566:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760719.897651:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777193088 00000100:00100000:3.0:1789760719.897660:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777193088 00000100:00100000:3.0:1789760719.897739:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:3.0:1789760719.897759:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+19:11992:x1876699777193088:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:3.0:1789760719.897782:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760719.897824:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857e86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bf6 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.897898:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857e86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bf6 expref: 20 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.897911:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857e86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bf6 expref: 20 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.897941:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:3.0:1789760719.897944:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789760719.897948:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4e00, rc 0) 00000100:00100000:3.0:1789760719.898000:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11992:x1876699777193088:12345-192.168.203.38@tcp:101:touch.500 Request processed in 242us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.898007:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:1.0:1789760719.902316:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760719.902471:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777193216 00000100:00100000:3.0:1789760719.902481:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777193216 00000100:00100000:3.0:1789760719.902632:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:3.0:1789760719.902643:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+41:2406:x1876699777193216:12345-192.168.203.38@tcp:2:touch.500 00000100:00100000:3.0:1789760719.903052:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+42:2406:x1876699777193216:12345-192.168.203.38@tcp:2:touch.500 Request processed in 408us (744us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789760719.903060:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:0.0:1789760719.905700:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760719.905879:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777193472 00000100:00100000:3.0:1789760719.905889:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777193472 00000100:00100000:3.0:1789760719.906056:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1789760719.906067:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+20:11992:x1876699777193472:12345-192.168.203.38@tcp:35:touch.500 00000100:00100000:3.0:1789760719.906416:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+21:11992:x1876699777193472:12345-192.168.203.38@tcp:35:touch.500 Request processed in 349us (721us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789760719.906438:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1789760719.919859:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.919953:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777193600 00000100:00100000:0.0:1789760719.919963:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777193600 00000100:00100000:0.0:1789760719.920031:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:0.0:1789760719.920044:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+21:11993:x1876699777193600:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:0.0:1789760719.920083:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760719.920108:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211bfd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920201:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920218:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920231:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920242:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920249:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920256:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920353:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857ea2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920362:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920368:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760719.920402:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789760719.920407:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760719.920426:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920451:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920461:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920468:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920474:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920481:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920488:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760719.920492:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920499:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920511:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:0.0:1789760719.920514:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.920519:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920525:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542c00/0xc2b9a3a739857e94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920538:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920549:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920555:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920562:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760719.920565:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920571:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920579:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x4009f790 (ffff97e5489b1400) 00010000:00010000:0.0:1789760719.920582:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760719.920585:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920592:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542200/0xc2b9a3a739857e9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920617:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857e8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bfd expref: 23 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920630:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bfd expref: 22 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.920636:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:0.0:1789760719.920638:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760719.920647:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542600, rc 0) 00000100:00100000:0.0:1789760719.920713:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+22:11993:x1876699777193600:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 672us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760719.920719:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:1.0:1789760719.924434:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760719.924524:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777193728 00000100:00100000:3.0:1789760719.924533:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777193728 00000100:00100000:3.0:1789760719.924593:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:3.0:1789760719.924604:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+42:2403:x1876699777193728:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:3.0:1789760719.924621:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760719.924640:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c04 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760719.924666:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x6aad94cf, atime: 0x6aad94cf, ctime: 0x6aad94cf, blocks: 0x1 00010000:00010000:3.0:1789760719.924684:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1789760719.924689:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760719.924698:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 43 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.924717:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 43 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.924729:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4c00, rc 0) 00000100:00100000:3.0:1789760719.924832:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2403:x1876699777193728:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 230us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.924840:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:3.0:1789760719.928070:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760719.928193:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777193984 00000100:00100000:0.0:1789760719.928202:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777193984 00000100:00100000:0.0:1789760719.928271:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:0.0:1789760719.928282:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+22:11993:x1876699777193984:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:0.0:1789760719.928331:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760719.928357:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542600/0xc2b9a3a739857ea2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bfd expref: 22 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.928376:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:0.0:1789760719.928382:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760719.928410:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.928423:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.928434:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760719.928650:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af0acadb reply state 00000000cbf2fe15 transno 4294967349 ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.928664:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760719.928671:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:0.0:1789760719.928688:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789760719.928691:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760719.928821:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11993:x1876699777193984:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 540us (771us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789760719.928829:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:2.0:1789760719.931447:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760719.931545:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777194112 00000100:00100000:1.0:1789760719.931553:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777194112 00000100:00100000:1.0:1789760719.931606:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:1.0:1789760719.931615:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+43:2404:x1876699777194112:12345-192.168.203.38@tcp:2:chmod.0 00002000:00010000:1.0:1789760719.931854:0:9533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760719.931858:0:9533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760719 -> 1789760719 00002000:00010000:1.0:1789760719.931860:0:9533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789760719 -> 1789760719 00002000:00010000:1.0:1789760719.931862:0:9533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760719 -> 1789760719 00002000:00010000:1.0:1789760719.931865:0:9533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760719.931926:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2404:x1876699777194112:12345-192.168.203.38@tcp:2:chmod.0 Request processed in 301us (475us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789760719.931935:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:2.0:1789760720.001325:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760720.001416:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777194368 00000100:00100000:3.0:1789760720.001426:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777194368 00000100:00100000:3.0:1789760720.001504:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:3.0:1789760720.001514:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+23:11999:x1876699777194368:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:3.0:1789760720.001539:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760720.001559:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857eb7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c0b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001706:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001722:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001733:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001745:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001766:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001773:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001882:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001893:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.001900:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760720.001932:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789760720.002029:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002038:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002044:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002170:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002181:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760720.002186:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002193:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002206:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:3.0:1789760720.002209:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760720.002214:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 3/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002221:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5400/0xc2b9a3a739857ebe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002235:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002242:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002254:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002269:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760720.002272:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002278:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002287:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x4009f790 (ffff97e5489b1400) 00010000:00010000:3.0:1789760720.002289:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760720.002292:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002298:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5a00/0xc2b9a3a739857ec5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002337:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4000/0xc2b9a3a739857eb7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c0b expref: 26 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002352:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c0b expref: 25 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.002360:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:3.0:1789760720.002362:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789760720.002365:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf4400, rc 0) 00000100:00100000:3.0:1789760720.002488:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11999:x1876699777194368:12345-192.168.203.38@tcp:101:dd.500 Request processed in 975us (1172us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789760720.002507:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:0.0:1789760720.010050:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760720.010175:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777194624 00000100:00100000:1.0:1789760720.010185:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777194624 00000100:00100000:1.0:1789760720.010338:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:1.0:1789760720.010349:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+25:11999:x1876699777194624:12345-192.168.203.38@tcp:36:dd.500 00010000:00010000:1.0:1789760720.010415:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760720.010440:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4400/0xc2b9a3a739857ecc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c0b expref: 25 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.010460:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:1.0:1789760720.010465:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760720.010647:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.010660:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.010669:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760720.010718:0:12655:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00000004:00010000:1.0:1789760720.010758:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003209082b reply state 00000000a80dbb11 transno 4294967352 ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.010770:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.010778:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:1.0:1789760720.010781:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760720.010783:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760720.010893:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+27:11999:x1876699777194624:12345-192.168.203.38@tcp:36:dd.500 Request processed in 545us (854us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789760720.011446:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 159 00000020:00080000:1.0:1789760720.011453:0:12655:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789760720.013435:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760720.013505:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777194752 00000100:00100000:3.0:1789760720.013514:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777194752 00000100:00100000:3.0:1789760720.013583:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:3.0:1789760720.013592:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+44:11999:x1876699777194752:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:3.0:1789760720.013608:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760720.013623:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c12 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.013652:0:13387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 45 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760720.013659:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760720.013661:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760720.013665:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760720.013670:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 45 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.013702:0:13387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 45 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.013715:0:13387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 45 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760720.013728:0:13387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13387:1876699798209408:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760720.013856:0:13387:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448b03000 going to sleep for 11 seconds 00000100:00100000:3.0:1789760720.021836:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760720.022033:0:13387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13387:1876699798209408:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760720.022086:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 45 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.022114:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fcf5600, rc 0) 00000100:00100000:2.0:1789760720.022174:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+45:11999:x1876699777194752:12345-192.168.203.38@tcp:101:dd.500 Request processed in 8583us (8746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760720.022183:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:0.0:1789760720.022327:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777194880 00000100:00100000:0.0:1789760720.022333:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777194880 00010000:00010000:0.0:1789760720.022365:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 45 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760720.022399:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:0.0:1789760720.022408:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777194880:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760720.022421:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760720.022427:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 45 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.022442:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 45 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.022467:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a739857ea9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c04 expref: 45 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.022481:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760720.022486:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760720.022493:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 44 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.022511:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 44 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.022545:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 44 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760720.022560:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798209536:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760720.022609:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449602a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760720.028017:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760720.028054:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9898:1876699798209536:192.168.203.38@tcp:105: 00010000:00010000:1.0:1789760720.028080:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760720.028142:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2403:x1876699777194880:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 5734us (6314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760720.028151:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:3.0:1789760720.028193:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777195008 00000100:00100000:3.0:1789760720.028204:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777195008 00002000:00010000:3.0:1789760720.028237:0:8120:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789760720.028241:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f7100 with x1876699777195008 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760720.028251:0:8120:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f7f7100. 00000100:00100000:3.0:1789760720.028275:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 394182480143 time 394184281470 state 0x0 ref 1 00000100:00100000:3.0:1789760720.028286:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 394384281470 time 394184281470 state 0x1 ref 1 00000100:00100000:3.0:1789760720.028309:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 2 deadline 394384281470 time 396212518737 state 0x0 ref 1 00000100:00100000:3.0:1789760720.028320:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2404:x1876699777195008:12345-192.168.203.38@tcp:10:dd.500 00002000:00010000:3.0:1789760720.028582:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789760720.028586:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760719 -> 1789760719 00002000:00010000:3.0:1789760720.028588:0:8120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789760719 -> 1789760719 00002000:00010000:3.0:1789760720.028590:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760719 -> 1789760719 00002000:00010000:3.0:1789760720.028591:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789760720.028630:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2404:x1876699777195008:12345-192.168.203.38@tcp:10:dd.500 Request processed in 310us (621us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789760720.028648:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:3.0:1789760720.028652:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 2 deadline 394384281470 time 396212518737 state 0x2 ref 0 00002000:00010000:3.0:1789760720.028658:0:8120:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789760720.028661:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f7f7100 with x1876699777195008 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760720.028666:0:8120:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f7f7100. 00000100:00100000:0.0:1789760720.040483:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760720.040559:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777195136 00000100:00100000:3.0:1789760720.040569:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777195136 00000100:00100000:3.0:1789760720.040626:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 2 deadline 394384281470 time 396212518737 state 0x0 ref 1 00000100:00100000:3.0:1789760720.040649:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 2 deadline 396412518737 time 396212518737 state 0x1 ref 1 00000100:00100000:3.0:1789760720.040678:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 1 deadline 396412518737 time 396224885930 state 0x0 ref 1 00000100:00100000:3.0:1789760720.040692:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2406:x1876699777195136:12345-192.168.203.38@tcp:4:dd.500 00010000:00010000:3.0:1789760720.040725:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.040753:0:13390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 45 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.040761:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760720.040765:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789760720.040769:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.040830:0:13390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 45 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.040843:0:13390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 45 pid: 13387 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760720.040856:0:13390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:13390:1876699798209664:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760720.040990:0:13390:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e448b03240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760720.045323:0:13390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:13390:1876699798209664:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760720.045366:0:13390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760720.048293:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760720.048601:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777195264 00000100:00100000:2.0:1789760720.048736:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777195264 00010000:00010000:2.0:1789760720.048776:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 46 pid: 13387 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760720.048946:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:2.0:1789760720.048957:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+46:2403:x1876699777195264:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760720.048974:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760720.048997:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 46 pid: 13387 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.049012:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 46 pid: 13387 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.049037:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739857ee1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c12 expref: 46 pid: 13387 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.049064:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789760720.049085:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789760720.049091:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.049101:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.049134:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760720.049195:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777195264:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 239us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760720.049203:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00010000:00010000:3.0:1789760720.049271:0:13390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.049280:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760720.105886:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798209792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760720.105984:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760720.106057:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798209792 00000100:00100000:1.0:1789760720.106066:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798209792 00000100:00100000:1.0:1789760720.106118:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789760720.106128:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798209792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760720.106169:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760720.106211:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798209792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760720.106229:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789760720.106274:0:3463:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967340 gen 2 00000004:00080000:1.0:1789760720.106281:0:3463:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967340 committed transno 4294967340 00000100:00100000:1.0:1789760720.106316:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798209792:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1789760720.187017:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00000001:00080000:0.0:1789760720.189179:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967447 is committed 00000001:00080000:0.0:1789760720.189215:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967449 is committed 00000001:00080000:0.0:1789760720.189276:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967451 is committed 00002000:00010000:3.0:1789760720.189374:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789760720.189379:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789760720.189392:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.189405:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.189414:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.189422:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760720.189427:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.189437:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.189481:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.189489:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857ee8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760720.189630:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777195136:12345-192.168.203.38@tcp:4:dd.500 Request processed in 148935us (149148us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789760720.189640:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1789760720.189649:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 1 deadline 396412518737 time 396224885930 state 0x2 ref 0 00000100:00100000:1.0:1789760720.218181:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760720.218314:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777195392 00000100:00100000:0.0:1789760720.218324:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777195392 00000100:00100000:0.0:1789760720.218375:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 1 deadline 396412518737 time 396224885930 state 0x0 ref 1 00000100:00100000:0.0:1789760720.218387:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 1 deadline 396424885930 time 396224885930 state 0x1 ref 1 00000100:00100000:0.0:1789760720.218464:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396424885930 time 396402672841 state 0x0 ref 1 00000100:00100000:0.0:1789760720.218478:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777195392:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760720.218523:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 1048576, mtime: 0x6aad94cf, atime: 0x6aad94cf, ctime: 0x6aad94cf, blocks: 0x803 00010000:00010000:0.0:1789760720.218531:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.218558:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1789760720.218563:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760720.218570:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.218585:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760720.287424:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967452 is committed 00002000:00010000:0.0:1789760720.287605:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1789760720.287610:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1789760720.287626:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.287639:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.287647:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.287654:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760720.288452:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.288467:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.288510:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.288517:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4be06c/0xc2b9a3a739857eef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760720.288703:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777195392:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70223us (70527us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789760720.288714:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:0.0:1789760720.288724:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396424885930 time 396402672841 state 0x2 ref 0 00000100:00100000:1.0:1789760720.302199:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760720.302308:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777195520 00000100:00100000:2.0:1789760720.302320:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777195520 00000100:00100000:2.0:1789760720.302374:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396424885930 time 396402672841 state 0x0 ref 1 00000100:00100000:2.0:1789760720.302389:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396602672841 time 396402672841 state 0x1 ref 1 00010000:00010000:0.0:1789760720.391151:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760720.419006:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396602672841 time 396603206939 state 0x0 ref 1 00000100:00100000:2.0:1789760720.419041:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777195520:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760720.419096:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 2097152, mtime: 0x6aad94cf, atime: 0x6aad94cf, ctime: 0x6aad94cf, blocks: 0x1007 00010000:00010000:2.0:1789760720.419106:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.419133:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1789760720.419139:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760720.419145:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.419175:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760720.534042:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789760720.534051:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789760720.534065:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.534079:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.534090:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.534098:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760720.534103:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.534112:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.534186:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.534195:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739857ef6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760720.534326:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777195520:12345-192.168.203.38@tcp:4:dd.500 Request processed in 115298us (232204us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789760720.534336:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1789760720.534343:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396602672841 time 396603206939 state 0x2 ref 0 00000001:00080000:2.0:1789760720.534383:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967453 is committed 00000100:00100000:1.0:1789760720.550490:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760720.552219:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777195648 00000100:00100000:0.0:1789760720.552235:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777195648 00000100:00100000:0.0:1789760720.552301:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396602672841 time 396603206939 state 0x0 ref 1 00000100:00100000:0.0:1789760720.552314:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396803206939 time 396603206939 state 0x1 ref 1 00000100:00100000:1.0:1789760720.583184:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760720.583206:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798209920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760720.583286:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760720.583450:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798209920 00000100:00100000:3.0:1789760720.583459:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798209920 00000100:00100000:3.0:1789760720.583512:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789760720.583522:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798209920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760720.583560:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760720.583619:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798209920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760720.583626:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789760720.583713:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798209920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760720.619243:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396803206939 time 396803323433 state 0x0 ref 1 00000100:00100000:0.0:1789760720.619286:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777195648:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760720.619343:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 3145728, mtime: 0x6aad94cf, atime: 0x6aad94cf, ctime: 0x6aad94cf, blocks: 0x1807 00010000:00010000:0.0:1789760720.619352:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.619386:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1789760720.619390:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760720.619396:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.619410:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760720.713581:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1789760720.713590:0:8118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760719 -> 1789760720 00002000:00010000:1.0:1789760720.713593:0:8118:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760719 -> 1789760720 00002000:00010000:1.0:1789760720.713595:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789760720.713609:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.713622:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.713631:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.713638:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760720.713642:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.713671:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.713693:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.713701:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739857efd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760720.713831:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777195648:12345-192.168.203.38@tcp:4:dd.500 Request processed in 94558us (163349us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789760720.713841:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:1.0:1789760720.713849:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396803206939 time 396803323433 state 0x2 ref 0 00000001:00080000:2.0:1789760720.714097:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967454 is committed 00000100:00100000:2.0:1789760720.723128:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760720.723296:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777195776 00000100:00100000:0.0:1789760720.723306:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777195776 00000100:00100000:0.0:1789760720.723370:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 396803206939 time 396803323433 state 0x0 ref 1 00000100:00100000:0.0:1789760720.723384:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397003323433 time 396803323433 state 0x1 ref 1 00000100:00100000:2.0:1789760720.820023:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397003323433 time 397004223320 state 0x0 ref 1 00000100:00100000:2.0:1789760720.820055:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777195776:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760720.820113:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 4194304, mtime: 0x6aad94d0, atime: 0x6aad94cf, ctime: 0x6aad94d0, blocks: 0x2007 00010000:00010000:2.0:1789760720.820122:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.820137:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1789760720.820142:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760720.820147:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.820165:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760720.913591:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1789760720.913600:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1789760720.913614:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.913628:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.913636:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.913644:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760720.913649:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.913674:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.913694:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760720.913700:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a739857f04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760720.913836:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777195776:12345-192.168.203.38@tcp:4:dd.500 Request processed in 93791us (190711us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789760720.913846:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:0.0:1789760720.913854:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397003323433 time 397004223320 state 0x2 ref 0 00000001:00080000:1.0:1789760720.915270:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967455 is committed 00000100:00100000:0.0:1789760720.925345:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760720.925537:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777195904 00000100:00100000:2.0:1789760720.925546:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777195904 00000100:00100000:2.0:1789760720.925609:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397003323433 time 397004223320 state 0x0 ref 1 00000100:00100000:2.0:1789760720.925621:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397204223320 time 397004223320 state 0x1 ref 1 00000100:00100000:0.0:1789760721.023995:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397204223320 time 397208181839 state 0x0 ref 1 00000100:00100000:0.0:1789760721.024030:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777195904:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760721.024088:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 5242880, mtime: 0x6aad94d0, atime: 0x6aad94cf, ctime: 0x6aad94d0, blocks: 0x2807 00010000:00010000:0.0:1789760721.024097:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.024113:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:0.0:1789760721.024118:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760721.024124:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.024156:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760721.095008:0:8431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 397279218109ns, next at 398279215707ns, rc = 0 00000100:00100000:3.0:1789760721.095103:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760721.095124:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798210048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760721.095192:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760721.095631:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798210048 00000100:00100000:1.0:1789760721.095640:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798210048 00000100:00100000:1.0:1789760721.095775:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789760721.095804:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798210048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760721.095826:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 1703936 free 3859808256 avail 3835691008 00000100:00100000:1.0:1789760721.095871:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798210048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760721.095878:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789760721.096029:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798210048:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789760721.096089:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760721.096167:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760721.101148:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798210176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760721.101229:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760721.101389:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798210176 00000100:00100000:1.0:1789760721.101411:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798210176 00000100:00100000:1.0:1789760721.101480:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789760721.101489:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798210176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760721.101528:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 1703936 free 3859808256 avail 3835691008 00000100:00100000:1.0:1789760721.101579:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798210176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760721.101587:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789760721.101656:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798210176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789760721.101833:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760721.142769:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967456 is committed 00002000:00010000:2.0:1789760721.142808:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1789760721.142813:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1789760721.142829:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.142842:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.142850:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.142857:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760721.142862:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.142871:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.142890:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.142897:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739857f0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.143287:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777195904:12345-192.168.203.38@tcp:4:dd.500 Request processed in 119269us (217946us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789760721.143297:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:2.0:1789760721.143305:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397204223320 time 397208181839 state 0x2 ref 0 00000100:00100000:2.0:1789760721.152745:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760721.152935:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777196032 00000100:00100000:0.0:1789760721.152945:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777196032 00000100:00100000:0.0:1789760721.152990:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397204223320 time 397208181839 state 0x0 ref 1 00000100:00100000:0.0:1789760721.152999:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397408181839 time 397208181839 state 0x1 ref 1 00000100:00100000:3.0:1789760721.226474:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397408181839 time 397410675521 state 0x0 ref 1 00000100:00100000:3.0:1789760721.226505:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777196032:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760721.226576:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 6291456, mtime: 0x6aad94d0, atime: 0x6aad94cf, ctime: 0x6aad94d0, blocks: 0x3007 00010000:00010000:3.0:1789760721.226584:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.226599:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1789760721.226604:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760721.226610:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.226624:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760721.268321:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967457 is committed 00002000:00010000:0.0:1789760721.268453:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789760721.268458:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789760721.268471:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.268484:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.268493:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.268501:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760721.268506:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.268528:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.268548:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.268556:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a739857f12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760721.268667:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777196032:12345-192.168.203.38@tcp:4:dd.500 Request processed in 42172us (115926us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789760721.268677:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1789760721.268685:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397408181839 time 397410675521 state 0x2 ref 0 00000100:00100000:0.0:1789760721.280023:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760721.280084:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777196160 00000100:00100000:1.0:1789760721.280096:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777196160 00000100:00100000:1.0:1789760721.280160:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397408181839 time 397410675521 state 0x0 ref 1 00000100:00100000:1.0:1789760721.280175:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397610675521 time 397410675521 state 0x1 ref 1 00010000:00010000:3.0:1789760721.415041:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760721.429042:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397610675521 time 397613240606 state 0x0 ref 1 00000100:00100000:3.0:1789760721.429075:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777196160:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760721.429133:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 7340032, mtime: 0x6aad94d0, atime: 0x6aad94cf, ctime: 0x6aad94d0, blocks: 0x3807 00010000:00010000:3.0:1789760721.429143:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.429159:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1789760721.429163:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760721.429170:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.429184:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760721.605503:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967458 is committed 00002000:00010000:2.0:1789760721.608095:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:2.0:1789760721.608110:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1789760721.608131:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.608146:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.608156:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.608164:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760721.608170:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.608180:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.608205:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.608243:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004571fc92/0xc2b9a3a739857f19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.608409:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777196160:12345-192.168.203.38@tcp:4:dd.500 Request processed in 179341us (328384us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789760721.608421:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:2.0:1789760721.608433:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397610675521 time 397613240606 state 0x2 ref 0 00000100:00100000:1.0:1789760721.641306:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760721.641364:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777196288 00000100:00100000:1.0:1789760721.641377:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777196288 00000100:00100000:1.0:1789760721.641451:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397610675521 time 397613240606 state 0x0 ref 1 00000100:00100000:1.0:1789760721.641470:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397813240606 time 397613240606 state 0x1 ref 1 00000100:00100000:1.0:1789760721.641500:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397813240606 time 397825708306 state 0x0 ref 1 00000100:00100000:1.0:1789760721.641514:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777196288:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760721.642051:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad94d0, atime: 0x6aad94cf, ctime: 0x6aad94d0, blocks: 0x4007 00010000:00010000:1.0:1789760721.642063:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.642117:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1789760721.642122:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760721.642130:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.642146:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760721.715640:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967364 is committed 00000020:00080000:1.0:1789760721.715664:0:7272:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97e543f30c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789760721.715671:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e44c198e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97e543f30180 00000020:00080000:1.0:1789760721.715675:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].4 00000020:00080000:1.0:1789760721.715678:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e44c198f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e57fc6a000 00000020:00080000:1.0:1789760721.715682:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].4 00000004:00080000:1.0:1789760721.715711:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 6 committed 00000004:00080000:1.0:1789760721.715730:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00000004:00080000:1.0:1789760721.715739:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 5 committed 00000004:00080000:1.0:1789760721.715744:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 6 committed 00000020:00080000:1.0:1789760721.715765:0:7272:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 3 batchid updated 00010000:00010000:1.0:1789760721.715811:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715824:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715832:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715855:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760721.715860:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715869:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715891:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x151ecd9f (ffff97e543c0a800) 00010000:00010000:1.0:1789760721.715894:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760721.715900:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715907:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01a00/0xc2b9a3a739857d3d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715940:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715946:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715952:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715956:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760721.715958:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715963:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715984:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x2ab29dc6 (ffff97e5489b1100) 00010000:00010000:1.0:1789760721.715986:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760721.715990:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.715996:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e548543000/0xc2b9a3a739857d59 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789760721.716020:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4 committed batchid 3 00000100:00100000:2.0:1789760721.716734:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798210432:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1789760721.716843:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760721.716910:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760721.716916:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798210304:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1789760721.716935:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760721.716968:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798210432 00000100:00100000:2.0:1789760721.716975:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798210432 00000100:00100000:2.0:1789760721.717024:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798210304 00000100:00100000:2.0:1789760721.717027:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798210304 00000100:00100000:2.0:1789760721.717046:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789760721.717054:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798210432:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1789760721.717101:0:9533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789760721.717142:0:9533:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad94cb, atime: 0x6aad94ca, ctime: 0x6aad94cb, blocks: 0x4007 00010000:00010000:2.0:1789760721.717151:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.717168:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1789760721.717182:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760721.717189:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.717204:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.717213:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.717220:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.717238:0:9533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789760721.717499:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789760721.717511:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798210304:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1789760721.717535:0:8112:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1789760721.717554:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 8388608, mtime: 0x6aad94cc, atime: 0x6aad94ca, ctime: 0x6aad94cc, blocks: 0x4007 00010000:00010000:0.0:1789760721.717559:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.717569:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:0.0:1789760721.717572:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760721.717577:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.717596:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.717604:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.717611:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.717627:0:8112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1789760721.718823:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3464:x1876699798210304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1306us (1876us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789760721.718835:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000004:00080000:1.0:1789760721.719147:0:7284:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e57f6e8900 with version 10 00000020:00080000:1.0:1789760721.719160:0:7284:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 3 cancel update log [0x200000401:0x2:0x0].3: rc = 0 00000020:00080000:1.0:1789760721.719625:0:7284:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 3 cancel update log [0x240000400:0x2:0x0].3: rc = 0 00000020:00080000:1.0:1789760721.719635:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 3 00000100:00100000:1.0:1789760721.719766:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798210560:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1789760721.719849:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760721.719902:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760721.719909:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798210688:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1789760721.719935:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760721.719978:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798210560 00000100:00100000:1.0:1789760721.719987:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798210560 00000100:00100000:1.0:1789760721.720033:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798210688 00000100:00100000:1.0:1789760721.720036:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798210688 00000100:00100000:1.0:1789760721.720051:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789760721.720060:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798210560:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1789760721.720088:0:8112:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:5 count 1 00002000:00010000:1.0:1789760721.720125:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5:0x0] initial LVB size: 8388608, mtime: 0x6aad94cc, atime: 0x6aad94ca, ctime: 0x6aad94cc, blocks: 0x4007 00010000:00010000:1.0:1789760721.720135:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.720163:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1789760721.720168:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760721.720176:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.720191:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.720203:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.720212:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.720231:0:8112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1789760721.720455:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3464:x1876699798210432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1932us (2143us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789760721.720464:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789760721.720488:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789760721.720496:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798210688:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1789760721.720510:0:9533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:4 count 1 00010000:00010000:2.0:1789760721.720524:0:9533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720541:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 11 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720551:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 11 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720568:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 11 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720576:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 11 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720584:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 11 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720591:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 11 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720598:0:9533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 11 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720605:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1789760721.720609:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760721.720613:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 10/0,1 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720644:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 11 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720660:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 11 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.720683:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798210816:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760721.720777:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 11 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720808:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 11 pid: 9533 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.720820:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fd10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798210944:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760721.720879:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 11 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720889:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 11 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.720900:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211072:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760721.720935:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 11 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.720945:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 11 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.720955:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211200:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760721.720999:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 11 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721008:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 11 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.721017:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211328:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760721.721047:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 11 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721057:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 11 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.721066:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211456:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760721.721096:0:9533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 11 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721107:0:9533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 11 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.721115:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211584:192.168.203.38@tcp:104: 00000100:00100000:2.0:1789760721.721137:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fd8d9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789760721.721178:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789760721.721187:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721210:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760721.721215:0:7281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721227:0:7281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721263:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721272:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a739857f27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721295:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789760721.721300:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721307:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760721.721310:0:7281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721318:0:7281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721328:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721342:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721358:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760721.721362:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721369:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760721.721372:0:7281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721381:0:7281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721392:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721401:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f35 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.721415:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760721.721417:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760721.721419:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789760721.721431:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 10 rpc_version 10 00000020:00100000:2.0:1789760721.721458:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760721.721469:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e44a0d0380 x1876699798211840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760721.721495:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798211840:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789760721.721549:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760721.721579:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fd8d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760721.721780:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798211840 00000100:00100000:2.0:1789760721.721823:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798211840 00000100:00100000:2.0:1789760721.721878:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789760721.721888:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7275:x1876699798211840:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789760721.728193:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3461:x1876699798210560:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8084us (8294us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789760721.728209:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789760721.728294:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7275:x1876699798211840:12345-0@lo:1000:osp_up0-1.0 Request processed in 6287us (6624us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789760721.728305:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789760721.728406:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798211840:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1789760721.728453:0:3464:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e548823100/2, rc 0, transno 4294967460 00000100:00100000:2.0:1789760721.728459:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798210304:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1789760721.728470:0:3464:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e57fab7480/2, rc 0, transno 4294967461 00000100:00100000:2.0:1789760721.728474:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798210432:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1789760721.728585:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789760721.728614:0:3461:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e57fc4a300/2, rc 0, transno 4294967346 00000100:00100000:1.0:1789760721.728620:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798210560:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1789760721.729352:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760721.729378:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760721.729404:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760721.729434:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777196544 00000100:00100000:2.0:1789760721.729442:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777196544 00010000:00010000:2.0:1789760721.729488:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 12 pid: 9533 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760721.729662:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798210816:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760721.729672:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fd10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798210944:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760721.729681:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211584:192.168.203.38@tcp:104: 00000100:00100000:2.0:1789760721.729751:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777196416 00000100:00100000:2.0:1789760721.729756:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777196416 00010000:00010000:2.0:1789760721.729780:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 13 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.729850:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760721.730050:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777196672 00000100:00100000:2.0:1789760721.730054:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777196672 00010000:00010000:2.0:1789760721.730072:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 14 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.730318:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1789760721.730328:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2404:x1876699777196544:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760721.730343:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760721.730349:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 14 pid: 9533 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730362:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 14 pid: 9533 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730388:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d277c9e8/0xc2b9a3a739857ce2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b86 expref: 14 pid: 9533 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730408:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760721.730516:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+13:2404:x1876699777196544:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 189us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760721.730532:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1789760721.730555:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:2.0:1789760721.730562:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2404:x1876699777196416:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760721.730581:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760721.730587:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 12 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730599:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 12 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730613:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000279e56af/0xc2b9a3a739857cdb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b7f expref: 12 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730624:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760721.730644:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2404:x1876699777196416:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 82us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760721.730651:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:2.0:1789760721.730666:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1789760721.730673:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2404:x1876699777196672:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760721.730680:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760721.730685:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 10 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730695:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 10 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730707:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5b8c361/0xc2b9a3a739857cd4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b78 expref: 10 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.730729:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760721.730749:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777196672:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 76us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760721.730755:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00080000:0.0:1789760721.732897:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760721.744698:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760721.744937:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760721.745177:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211072:192.168.203.38@tcp:104: 00000100:00100000:2.0:1789760721.745190:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211200:192.168.203.38@tcp:104: 00000100:00100000:2.0:1789760721.745197:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211328:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760721.745730:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760721.745785:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777196800 00000100:00100000:3.0:1789760721.745806:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777196800 00010000:00010000:3.0:1789760721.745863:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 9 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760721.745965:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777197056 00000100:00100000:3.0:1789760721.745970:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777197056 00010000:00010000:3.0:1789760721.745985:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760721.746010:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:3.0:1789760721.746020:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2405:x1876699777196800:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760721.746040:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760721.746046:0:6452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.746060:0:6452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.746154:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004005da73/0xc2b9a3a739857ce9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b8d expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.746201:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760721.746424:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760721.746512:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2405:x1876699777196800:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 489us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760721.746622:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777196928 00000100:00100000:2.0:1789760721.746628:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777196928 00010000:00010000:2.0:1789760721.746657:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760721.746681:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:3.0:1789760721.746741:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777197184 00000100:00100000:3.0:1789760721.746745:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777197184 00010000:00010000:3.0:1789760721.746758:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.753964:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:2.0:1789760721.753986:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2405:x1876699777197056:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760721.754011:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760721.754023:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.754040:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.754067:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057bb3a6d/0xc2b9a3a739857cf7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b9b expref: 10 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.754107:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760721.754312:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2405:x1876699777197056:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 332us (9371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760721.754321:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:2.0:1789760721.754359:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:2.0:1789760721.754367:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2405:x1876699777196928:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760721.754375:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760721.754380:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 8 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.754391:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 8 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.754406:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046195f8/0xc2b9a3a739857cf0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211b94 expref: 8 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.754422:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760721.754457:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777196928:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 90us (8728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760721.754466:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:2.0:1789760721.754677:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9533:1876699798211456:192.168.203.38@tcp:104: 00010000:00010000:2.0:1789760721.754714:0:9533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760721.763964:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:0.0:1789760721.763991:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777197184:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760721.764014:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760721.764026:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 6 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.764050:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 6 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.764076:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee45926/0xc2b9a3a739857cfe lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ba2 expref: 6 pid: 13387 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.764094:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760721.764114:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760721.764120:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.764130:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.764173:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760721.764254:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777197184:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 269us (17822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760721.764262:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00010000:00010000:3.0:1789760721.765325:0:9533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.765339:0:9533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.765350:0:9533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.765357:0:9533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760721.765376:0:9533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789760721.766146:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3461:x1876699798210688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 45648us (46207us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789760721.766156:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:2.0:1789760721.766371:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760721.766379:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.766390:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760721.766394:0:7281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.766404:0:7281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.766423:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.766431:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d770cb6c/0xc2b9a3a739857f3c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.766451:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760721.766453:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760721.766454:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760721.766934:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967459 is committed 00002000:00010000:1.0:1789760721.768848:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:1.0:1789760721.768860:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760720 -> 1789760721 00002000:00010000:1.0:1789760721.768863:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760720 -> 1789760721 00002000:00010000:1.0:1789760721.768866:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:1.0:1789760721.768884:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.768913:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.768922:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.768931:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760721.768936:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.768946:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.768968:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.769009:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7aaa16/0xc2b9a3a739857f20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760721.769162:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777196288:12345-192.168.203.38@tcp:4:dd.500 Request processed in 127642us (127864us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789760721.769174:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:1.0:1789760721.769186:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397813240606 time 397825708306 state 0x2 ref 0 00000004:00080000:1.0:1789760721.769300:0:3461:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e57fc49180/2, rc 0, transno 4294967347 00000100:00100000:1.0:1789760721.769309:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798210688:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1789760721.779138:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760721.779332:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777197312 00000100:00100000:2.0:1789760721.779348:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777197312 00000100:00100000:2.0:1789760721.779424:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 397813240606 time 397825708306 state 0x0 ref 1 00000100:00100000:2.0:1789760721.779442:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398025708306 time 397825708306 state 0x1 ref 1 00000100:00100000:0.0:1789760721.841854:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398025708306 time 398026045810 state 0x0 ref 1 00000100:00100000:0.0:1789760721.842018:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777197312:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760721.842108:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9437184, mtime: 0x6aad94d1, atime: 0x6aad94cf, ctime: 0x6aad94d1, blocks: 0x4807 00010000:00010000:0.0:1789760721.842123:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.842144:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1789760721.842149:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760721.842158:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760721.842181:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760721.960006:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967460 is committed 00000001:00080000:1.0:1789760721.960030:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967461 is committed 00000001:00080000:1.0:1789760721.960037:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967462 is committed 00002000:00010000:2.0:1789760721.960197:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:2.0:1789760721.960204:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:2.0:1789760721.960222:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.960237:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.960257:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.960266:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760721.960271:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.960281:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.960305:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.960383:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739857f43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.963090:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777197312:12345-192.168.203.38@tcp:4:dd.500 Request processed in 118640us (181394us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789760721.963111:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1789760721.963146:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398025708306 time 398026045810 state 0x2 ref 0 00000100:00100000:3.0:1789760721.973132:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760721.973395:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777197440 00000100:00100000:2.0:1789760721.973409:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777197440 00000100:00100000:2.0:1789760721.973486:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398025708306 time 398026045810 state 0x0 ref 1 00000100:00100000:2.0:1789760721.973656:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398226045810 time 398026045810 state 0x1 ref 1 00000100:00100000:1.0:1789760722.043741:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398226045810 time 398227934395 state 0x0 ref 1 00000100:00100000:1.0:1789760722.043858:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777197440:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760722.043951:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 10485760, mtime: 0x6aad94d1, atime: 0x6aad94cf, ctime: 0x6aad94d1, blocks: 0x5007 00010000:00010000:1.0:1789760722.043962:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.043983:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1789760722.043988:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.043996:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.044037:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760722.044238:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760722.142484:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967463 is committed 00002000:00010000:1.0:1789760722.142613:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1789760722.142620:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:1.0:1789760722.142639:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.142653:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.142662:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.142670:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760722.142675:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.142685:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.142708:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.142715:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760722.143166:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777197440:12345-192.168.203.38@tcp:4:dd.500 Request processed in 99392us (170667us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789760722.143178:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:1.0:1789760722.143189:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398226045810 time 398227934395 state 0x2 ref 0 00000100:00100000:1.0:1789760722.151070:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760722.151157:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777197568 00000100:00100000:2.0:1789760722.151170:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777197568 00000100:00100000:2.0:1789760722.151254:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398226045810 time 398227934395 state 0x0 ref 1 00000100:00100000:2.0:1789760722.151272:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398427934395 time 398227934395 state 0x1 ref 1 00000100:00100000:1.0:1789760722.244478:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398427934395 time 398428670745 state 0x0 ref 1 00000100:00100000:1.0:1789760722.244731:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777197568:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760722.245840:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 11534336, mtime: 0x6aad94d1, atime: 0x6aad94cf, ctime: 0x6aad94d1, blocks: 0x5807 00010000:00010000:1.0:1789760722.245856:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.245877:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1789760722.245883:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.245891:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.245909:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760722.341466:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967464 is committed 00002000:00010000:2.0:1789760722.341623:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:2.0:1789760722.341629:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:2.0:1789760722.341645:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.341660:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.341669:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.341676:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760722.341683:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.341692:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.341735:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.341743:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d277c9e8/0xc2b9a3a739857f51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760722.341927:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777197568:12345-192.168.203.38@tcp:4:dd.500 Request processed in 97214us (191141us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1789760722.341939:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:2.0:1789760722.341949:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398427934395 time 398428670745 state 0x2 ref 0 00000100:00100000:0.0:1789760722.349594:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760722.350011:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777197696 00000100:00100000:2.0:1789760722.350025:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777197696 00000100:00100000:2.0:1789760722.350107:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398427934395 time 398428670745 state 0x0 ref 1 00000100:00100000:2.0:1789760722.350126:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398628670745 time 398428670745 state 0x1 ref 1 00010000:00010000:1.0:1789760722.439141:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760722.445030:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398628670745 time 398629223767 state 0x0 ref 1 00000100:00100000:1.0:1789760722.445077:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777197696:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760722.445466:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 12582912, mtime: 0x6aad94d1, atime: 0x6aad94cf, ctime: 0x6aad94d1, blocks: 0x6007 00010000:00010000:1.0:1789760722.445479:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.445501:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1789760722.445506:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.445514:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.445532:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760722.484009:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760722.484045:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760722.484075:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760722.484100:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777197952 00000100:00100000:0.0:1789760722.484101:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760722.484116:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777197952 00000100:00100000:0.0:1789760722.484132:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760722.484165:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777198208 00000100:00100000:0.0:1789760722.484170:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777198208 00000100:00100000:1.0:1789760722.484202:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777198080 00000100:00100000:0.0:1789760722.484203:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777198336 00000100:00100000:1.0:1789760722.484207:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777198080 00000100:00100000:0.0:1789760722.484209:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777198336 00000100:00100000:1.0:1789760722.484254:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 378 00000100:00100000:1.0:1789760722.484270:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2404:x1876699777197952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760722.484309:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 379 00000100:00100000:0.0:1789760722.484321:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777198208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760722.484369:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2404:x1876699777197952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760722.484370:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777198208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760722.484384:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 378 00000100:00100000:0.0:1789760722.484409:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 379 00000100:00100000:1.0:1789760722.484427:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 380 00000100:00100000:0.0:1789760722.484434:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 381 00000100:00100000:1.0:1789760722.484438:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777198080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760722.484448:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777198336:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760722.484474:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777198080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760722.484481:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 380 00000100:00100000:0.0:1789760722.484486:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777198336:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760722.484511:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 381 00000100:00100000:1.0:1789760722.484531:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777197824 00000100:00100000:1.0:1789760722.484536:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777197824 00000100:00080000:0.0:1789760722.484567:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760722.484572:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760722.484631:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 370 00000100:00100000:1.0:1789760722.484638:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777197824:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760722.484663:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777197824:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760722.484669:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 370 00002000:00010000:0.0:1789760722.546910:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:0.0:1789760722.546925:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:0.0:1789760722.546944:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.546978:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.546988:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.546996:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760722.547002:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.547012:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.547036:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.547044:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc9ed3f/0xc2b9a3a739857f58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760722.547173:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777197696:12345-192.168.203.38@tcp:4:dd.500 Request processed in 102115us (197587us total) trans 4294967465 rc 0/0 00000100:00100000:0.0:1789760722.547186:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:0.0:1789760722.547370:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398628670745 time 398629223767 state 0x2 ref 0 00000001:00080000:0.0:1789760722.547429:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967465 is committed 00000100:00100000:2.0:1789760722.553618:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760722.553717:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777198464 00000100:00100000:3.0:1789760722.553731:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777198464 00000100:00100000:3.0:1789760722.553831:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398628670745 time 398629223767 state 0x0 ref 1 00000100:00100000:3.0:1789760722.553858:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398829223767 time 398629223767 state 0x1 ref 1 00000100:00100000:2.0:1789760722.645309:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398829223767 time 398829433179 state 0x0 ref 1 00000100:00100000:2.0:1789760722.645356:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777198464:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760722.645433:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 13631488, mtime: 0x6aad94d1, atime: 0x6aad94cf, ctime: 0x6aad94d1, blocks: 0x6807 00010000:00010000:2.0:1789760722.645445:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.645464:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1789760722.645488:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760722.645497:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.645517:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760722.729056:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967466 is committed 00002000:00010000:0.0:1789760722.729268:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789760722.729273:0:13391:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760721 -> 1789760722 00002000:00010000:0.0:1789760722.729275:0:13391:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760721 -> 1789760722 00002000:00010000:0.0:1789760722.729278:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789760722.729294:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.729308:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.729318:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.729325:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760722.729331:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.729340:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.729364:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.729371:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096a6395/0xc2b9a3a739857f5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760722.729505:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777198464:12345-192.168.203.38@tcp:4:dd.500 Request processed in 84159us (175888us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789760722.729536:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1789760722.729546:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398829223767 time 398829433179 state 0x2 ref 0 00000100:00100000:1.0:1789760722.736358:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760722.736704:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777198592 00000100:00100000:2.0:1789760722.736718:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777198592 00000100:00100000:2.0:1789760722.736950:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 398829223767 time 398829433179 state 0x0 ref 1 00000100:00100000:2.0:1789760722.736967:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399029433179 time 398829433179 state 0x1 ref 1 00000100:00100000:3.0:1789760722.846671:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399029433179 time 399030866839 state 0x0 ref 1 00000100:00100000:3.0:1789760722.846717:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777198592:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760722.846830:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 14680064, mtime: 0x6aad94d2, atime: 0x6aad94cf, ctime: 0x6aad94d2, blocks: 0x7007 00010000:00010000:3.0:1789760722.846842:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.846862:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1789760722.846867:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760722.846875:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.846895:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760722.934633:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967467 is committed 00002000:00010000:2.0:1789760722.934948:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:2.0:1789760722.934955:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:2.0:1789760722.934975:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.934990:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.935007:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.935017:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760722.935025:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.935065:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.935092:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760722.935101:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739857f66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760722.935371:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777198592:12345-192.168.203.38@tcp:4:dd.500 Request processed in 88665us (199014us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1789760722.935388:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:0.0:1789760722.935401:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399029433179 time 399030866839 state 0x2 ref 0 00000100:00100000:0.0:1789760722.945259:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760722.945378:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777198720 00000100:00100000:2.0:1789760722.945393:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777198720 00000100:00100000:2.0:1789760722.945479:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399029433179 time 399030866839 state 0x0 ref 1 00000100:00100000:2.0:1789760722.945497:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399230866839 time 399030866839 state 0x1 ref 1 00000100:00100000:0.0:1789760723.046888:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399230866839 time 399231081506 state 0x0 ref 1 00000100:00100000:0.0:1789760723.046944:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777198720:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760723.047028:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 15728640, mtime: 0x6aad94d2, atime: 0x6aad94cf, ctime: 0x6aad94d2, blocks: 0x7807 00010000:00010000:0.0:1789760723.047040:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.047061:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1789760723.047067:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760723.047075:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.047093:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760723.165107:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:2.0:1789760723.165119:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:2.0:1789760723.165138:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.165153:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.165162:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.165170:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760723.165197:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.165207:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.165233:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.165253:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739857f6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760723.165373:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777198720:12345-192.168.203.38@tcp:4:dd.500 Request processed in 118453us (220133us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789760723.165386:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1789760723.165396:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399230866839 time 399231081506 state 0x2 ref 0 00000001:00080000:1.0:1789760723.166378:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967468 is committed 00000100:00100000:1.0:1789760723.169206:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760723.169350:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777198848 00000100:00100000:0.0:1789760723.169381:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777198848 00000100:00100000:0.0:1789760723.169445:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399230866839 time 399231081506 state 0x0 ref 1 00000100:00100000:0.0:1789760723.169457:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399431081506 time 399231081506 state 0x1 ref 1 00000100:00100000:0.0:1789760723.247120:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399431081506 time 399431314083 state 0x0 ref 1 00000100:00100000:0.0:1789760723.247168:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777198848:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760723.247266:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 16777216, mtime: 0x6aad94d2, atime: 0x6aad94cf, ctime: 0x6aad94d2, blocks: 0x8007 00010000:00010000:0.0:1789760723.247279:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.247299:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1789760723.247304:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760723.247313:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.247330:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760723.377357:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967469 is committed 00002000:00010000:0.0:1789760723.377598:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:0.0:1789760723.377605:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:0.0:1789760723.377624:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.377637:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.377670:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.377678:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760723.377882:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.377957:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.377986:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.377995:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760723.378253:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777198848:12345-192.168.203.38@tcp:4:dd.500 Request processed in 131096us (209041us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789760723.378265:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:0.0:1789760723.378285:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399431081506 time 399431314083 state 0x2 ref 0 00000100:00100000:1.0:1789760723.386451:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760723.386583:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777198976 00000100:00100000:0.0:1789760723.386596:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777198976 00000100:00100000:0.0:1789760723.386672:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399431081506 time 399431314083 state 0x0 ref 1 00000100:00100000:0.0:1789760723.386960:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399631314083 time 399431314083 state 0x1 ref 1 00000100:00100000:3.0:1789760723.449076:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399631314083 time 399633260567 state 0x0 ref 1 00000100:00100000:3.0:1789760723.449126:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777198976:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760723.449206:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17825792, mtime: 0x6aad94d2, atime: 0x6aad94cf, ctime: 0x6aad94d2, blocks: 0x8807 00010000:00010000:3.0:1789760723.449218:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.449268:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1789760723.449273:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760723.449280:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.449296:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.464096:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789760723.519555:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:3.0:1789760723.519569:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:3.0:1789760723.519705:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.519721:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.519732:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.519740:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760723.519745:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.519757:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.519841:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.519850:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760723.520000:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777198976:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70895us (133558us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789760723.520012:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:3.0:1789760723.520023:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399631314083 time 399633260567 state 0x2 ref 0 00000001:00080000:0.0:1789760723.521076:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967470 is committed 00000100:00100000:3.0:1789760723.525422:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760723.529336:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777199104 00000100:00100000:0.0:1789760723.529356:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777199104 00000100:00100000:0.0:1789760723.529437:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399631314083 time 399633260567 state 0x0 ref 1 00000100:00100000:0.0:1789760723.529454:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399833260567 time 399633260567 state 0x1 ref 1 00000100:00100000:1.0:1789760723.651680:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399833260567 time 399835873972 state 0x0 ref 1 00000100:00100000:1.0:1789760723.651728:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777199104:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760723.652216:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18874368, mtime: 0x6aad94d2, atime: 0x6aad94cf, ctime: 0x6aad94d2, blocks: 0x9007 00010000:00010000:1.0:1789760723.652229:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.652260:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1789760723.652265:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.652273:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.652290:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760723.700274:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967471 is committed 00002000:00010000:3.0:1789760723.700452:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:3.0:1789760723.700458:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760722 -> 1789760723 00002000:00010000:3.0:1789760723.700461:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760722 -> 1789760723 00002000:00010000:3.0:1789760723.700463:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 36871 -> 38921 00010000:00010000:3.0:1789760723.700481:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.700495:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.700517:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.700525:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760723.700548:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.700558:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.700582:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760723.700589:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a739857f82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760723.700711:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777199104:12345-192.168.203.38@tcp:4:dd.500 Request processed in 49001us (175296us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789760723.700723:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:3.0:1789760723.700733:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399833260567 time 399835873972 state 0x2 ref 0 00000100:00100000:2.0:1789760723.711698:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760723.711849:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777199232 00000100:00100000:0.0:1789760723.711862:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777199232 00000100:00100000:0.0:1789760723.711940:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 399833260567 time 399835873972 state 0x0 ref 1 00000100:00100000:0.0:1789760723.711956:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400035873972 time 399835873972 state 0x1 ref 1 00000100:00100000:0.0:1789760723.851847:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400035873972 time 400036043284 state 0x0 ref 1 00000100:00100000:0.0:1789760723.851892:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777199232:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760723.851975:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19922944, mtime: 0x6aad94d3, atime: 0x6aad94cf, ctime: 0x6aad94d3, blocks: 0x9809 00010000:00010000:0.0:1789760723.851986:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.852006:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1789760723.852012:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760723.852019:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760723.852040:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760723.946822:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967472 is committed 00002000:00010000:1.0:1789760723.946999:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:1.0:1789760723.947006:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 38921 -> 40969 00010000:00010000:1.0:1789760723.947023:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.947038:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.947048:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.947056:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760723.947061:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.947070:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.947094:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.947102:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739857f89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760723.947225:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777199232:12345-192.168.203.38@tcp:4:dd.500 Request processed in 95351us (235535us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789760723.947394:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1789760723.947405:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400035873972 time 400036043284 state 0x2 ref 0 00000100:00100000:2.0:1789760723.955422:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760723.955533:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777199360 00000100:00100000:0.0:1789760723.955546:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777199360 00000100:00100000:0.0:1789760723.955699:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400035873972 time 400036043284 state 0x0 ref 1 00000100:00100000:0.0:1789760723.955726:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400236043284 time 400036043284 state 0x1 ref 1 00000100:00100000:0.0:1789760724.051993:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400236043284 time 400236187263 state 0x0 ref 1 00000100:00100000:0.0:1789760724.052074:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777199360:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760724.052226:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20971520, mtime: 0x6aad94d3, atime: 0x6aad94cf, ctime: 0x6aad94d3, blocks: 0xa009 00010000:00010000:0.0:1789760724.052250:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.052271:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1789760724.052276:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760724.052284:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.052302:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760724.052898:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789760724.114133:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:0.0:1789760724.114212:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 40969 -> 43017 00010000:00010000:0.0:1789760724.114307:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.114346:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.114356:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.114366:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760724.114371:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.114383:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.114410:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.114419:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760724.114547:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777199360:12345-192.168.203.38@tcp:4:dd.500 Request processed in 62523us (159131us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789760724.114560:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:0.0:1789760724.114570:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400236043284 time 400236187263 state 0x2 ref 0 00000001:00080000:3.0:1789760724.114850:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967473 is committed 00000100:00100000:1.0:1789760724.123476:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760724.123586:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777199488 00000100:00100000:3.0:1789760724.123600:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777199488 00000100:00100000:3.0:1789760724.123688:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400236043284 time 400236187263 state 0x0 ref 1 00000100:00100000:3.0:1789760724.123707:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400436187263 time 400236187263 state 0x1 ref 1 00000100:00100000:0.0:1789760724.252419:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400436187263 time 400436613099 state 0x0 ref 1 00000100:00100000:0.0:1789760724.252486:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777199488:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760724.252569:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22020096, mtime: 0x6aad94d3, atime: 0x6aad94cf, ctime: 0x6aad94d3, blocks: 0xa809 00010000:00010000:0.0:1789760724.252580:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.252602:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1789760724.252607:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760724.252615:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.252634:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760724.316653:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:0.0:1789760724.316664:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 43017 -> 45065 00010000:00010000:0.0:1789760724.316682:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.316696:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.316704:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.316778:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760724.316808:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.316839:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.316865:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.316873:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739857f97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760724.317175:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777199488:12345-192.168.203.38@tcp:4:dd.500 Request processed in 64701us (193706us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789760724.317188:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1789760724.317198:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400436187263 time 400436613099 state 0x2 ref 0 00000001:00080000:3.0:1789760724.317298:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967474 is committed 00000100:00100000:2.0:1789760724.324082:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760724.324267:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777199616 00000100:00100000:3.0:1789760724.324281:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777199616 00000100:00100000:3.0:1789760724.324352:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400436187263 time 400436613099 state 0x0 ref 1 00000100:00100000:3.0:1789760724.324385:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400636613099 time 400436613099 state 0x1 ref 1 00000100:00100000:3.0:1789760724.453276:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400636613099 time 400637470896 state 0x0 ref 1 00000100:00100000:3.0:1789760724.453337:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777199616:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760724.453418:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23068672, mtime: 0x6aad94d3, atime: 0x6aad94cf, ctime: 0x6aad94d3, blocks: 0xb009 00010000:00010000:3.0:1789760724.453429:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.453448:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1789760724.453453:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760724.453459:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.453476:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.487179:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760724.568406:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967475 is committed 00002000:00010000:1.0:1789760724.578941:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:1.0:1789760724.578957:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 45065 -> 47113 00010000:00010000:1.0:1789760724.578979:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.578995:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.579006:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.579016:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760724.579021:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.579033:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.579060:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.579069:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cd7bd97/0xc2b9a3a739857f9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760724.579324:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777199616:12345-192.168.203.38@tcp:4:dd.500 Request processed in 126018us (255249us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789760724.579337:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:1.0:1789760724.579348:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400636613099 time 400637470896 state 0x2 ref 0 00000100:00100000:1.0:1789760724.593572:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760724.593683:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777199744 00000100:00100000:0.0:1789760724.593697:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777199744 00000100:00100000:0.0:1789760724.593783:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400636613099 time 400637470896 state 0x0 ref 1 00000100:00100000:0.0:1789760724.593828:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400837470896 time 400637470896 state 0x1 ref 1 00000100:00100000:2.0:1789760724.656353:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400837470896 time 400840547884 state 0x0 ref 1 00000100:00100000:2.0:1789760724.656399:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777199744:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760724.656494:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24117248, mtime: 0x6aad94d3, atime: 0x6aad94cf, ctime: 0x6aad94d3, blocks: 0xb809 00010000:00010000:2.0:1789760724.656506:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.656552:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789760724.656558:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760724.656566:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.656584:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760724.679875:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760724.679915:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798211968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760724.680015:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760724.680132:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798211968 00000100:00100000:2.0:1789760724.680143:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798211968 00000100:00100000:2.0:1789760724.680219:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789760724.680238:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798211968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760724.680284:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3843031040 avail 3840933888 00000100:00100000:2.0:1789760724.680337:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798211968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760724.680345:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1789760724.680373:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760724.680423:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798211968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760724.681086:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760724.681104:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798212096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760724.681154:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760724.681207:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798212096 00000100:00100000:3.0:1789760724.681214:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798212096 00000100:00100000:3.0:1789760724.681270:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789760724.681278:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3463:x1876699798212096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760724.681296:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3843031040 avail 3840933888 00000100:00100000:3.0:1789760724.681355:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3463:x1876699798212096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760724.681362:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1789760724.681385:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760724.681413:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798212096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760724.681691:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798212224:0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.681757:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760724.684899:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798212224 00000100:00100000:3.0:1789760724.684921:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798212224 00000100:00100000:0.0:1789760724.685482:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760724.685506:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798212352:0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.685621:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760724.686506:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798212608:0@lo:400:kworker.0 00000100:00100000:2.0:1789760724.686601:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798212480:0@lo:400:kworker.0 00000100:00100000:2.0:1789760724.686637:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760724.686745:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789760724.686765:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798212224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.686854:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798212224:12345-0@lo:400:kworker.0 Request processed in 98us (5096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760724.686863:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789760724.688474:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798212864:0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.688941:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798212224:0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.688995:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798212736:0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.689205:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798212352 00000100:00100000:0.0:1789760724.689297:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798212352 00000100:00100000:0.0:1789760724.689361:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789760724.689372:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798212352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.689439:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798212352:12345-0@lo:400:kworker.0 Request processed in 68us (3818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760724.689447:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789760724.689741:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798212992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.689742:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760724.689770:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798213120:0@lo:400:kworker.0 00000100:00100000:2.0:1789760724.689773:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760724.689807:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798213504:0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.689818:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760724.689848:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760724.689936:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798213120 00000100:00100000:2.0:1789760724.689941:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798213120 00000100:00100000:2.0:1789760724.689988:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789760724.689995:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798213120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.690041:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760724.690077:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798213248:0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.690103:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760724.690331:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798212352:0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.690376:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798212480 00000100:00100000:0.0:1789760724.690381:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798212480 00000100:00100000:0.0:1789760724.690409:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798212736 00000100:00100000:0.0:1789760724.690413:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798212736 00000100:00100000:0.0:1789760724.690431:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789760724.690439:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3463:x1876699798212480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.690504:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3463:x1876699798212480:12345-0@lo:400:kworker.0 Request processed in 66us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760724.690511:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789760724.690525:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789760724.690532:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798212736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760724.690565:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798212736:12345-0@lo:400:kworker.0 Request processed in 34us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760724.690983:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789760724.691029:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798212736:0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.691913:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798212608 00000100:00100000:3.0:1789760724.691924:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798212608 00000100:00100000:3.0:1789760724.691950:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798212992 00000100:00100000:3.0:1789760724.691952:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798212992 00000100:00100000:3.0:1789760724.691998:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798213504 00000100:00100000:3.0:1789760724.692001:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798213504 00000100:00100000:3.0:1789760724.692025:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789760724.692033:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798212992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.692118:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798212992:12345-0@lo:400:kworker.0 Request processed in 87us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760724.692125:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789760724.692140:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789760724.692146:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798213504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.692186:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798213504:12345-0@lo:400:kworker.0 Request processed in 41us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760724.692192:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:3.0:1789760724.692214:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760724.692218:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760724.692261:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789760724.692266:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798212608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.692303:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798212608:12345-0@lo:400:kworker.0 Request processed in 37us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760724.692321:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789760724.692363:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798212608:0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.692436:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798213248 00000100:00100000:3.0:1789760724.692442:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798213248 00000100:00100000:3.0:1789760724.692491:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789760724.692501:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798213248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.692588:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798213248:12345-0@lo:400:kworker.0 Request processed in 77us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760724.692597:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789760724.692668:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798213248:0@lo:400:kworker.0 00000100:00080000:3.0:1789760724.692697:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760724.693277:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760724.693332:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798213376:0@lo:400:kworker.0 00000100:00100000:1.0:1789760724.693376:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760724.693411:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798212864 00000100:00100000:1.0:1789760724.693416:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798212864 00000100:00100000:1.0:1789760724.693449:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798213376 00000100:00100000:1.0:1789760724.693452:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798213376 00000100:00100000:1.0:1789760724.693474:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789760724.693481:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798212864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760724.693525:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798212864:12345-0@lo:400:kworker.0 Request processed in 44us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760724.693531:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789760724.693560:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789760724.693566:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798213376:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789760724.693834:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760724.693876:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798212480:0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.694308:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798212992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760724.694400:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798213504:0@lo:400:kworker.0 00000100:00100000:1.0:1789760724.694531:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798213376:12345-0@lo:400:kworker.0 Request processed in 964us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760724.694538:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789760724.694608:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798212864:0@lo:400:kworker.0 00000100:00100000:1.0:1789760724.694630:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798213376:0@lo:400:kworker.0 00000100:00100000:2.0:1789760724.718506:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798213120:12345-0@lo:400:kworker.0 Request processed in 28495us (28671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760724.718525:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789760724.718625:0:3464:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967461 gen 2 00000004:00080000:2.0:1789760724.718633:0:3464:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e548823100, transno 4294967460 00000004:00080000:2.0:1789760724.718644:0:3464:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e57fab7480, transno 4294967461 00000100:00100000:2.0:1789760724.718653:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798213120:0@lo:400:kworker.0 00002000:00010000:0.0:1789760724.795946:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:0.0:1789760724.795958:0:13385:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760723 -> 1789760724 00002000:00010000:0.0:1789760724.795962:0:13385:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760723 -> 1789760724 00002000:00010000:0.0:1789760724.795965:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 47113 -> 49161 00010000:00010000:0.0:1789760724.795985:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.796002:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.796012:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.796021:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760724.796027:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.796039:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.796064:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760724.796072:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a739857fa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760724.796416:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777199744:12345-192.168.203.38@tcp:4:dd.500 Request processed in 139872us (202692us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789760724.796432:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:0.0:1789760724.796443:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400837470896 time 400840547884 state 0x2 ref 0 00000001:00080000:1.0:1789760724.796981:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967476 is committed 00000100:00100000:0.0:1789760724.803578:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760724.803765:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777199872 00000100:00100000:2.0:1789760724.803779:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777199872 00000100:00100000:2.0:1789760724.803908:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 400837470896 time 400840547884 state 0x0 ref 1 00000100:00100000:2.0:1789760724.803926:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401040547884 time 400840547884 state 0x1 ref 1 00000100:00100000:2.0:1789760724.856499:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401040547884 time 401040693658 state 0x0 ref 1 00000100:00100000:2.0:1789760724.856551:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777199872:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760724.856637:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25165824, mtime: 0x6aad94d4, atime: 0x6aad94cf, ctime: 0x6aad94d4, blocks: 0xc009 00010000:00010000:2.0:1789760724.856649:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.856689:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:2.0:1789760724.856694:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760724.856702:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.856724:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760724.917967:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967477 is committed 00002000:00010000:3.0:1789760724.918101:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:3.0:1789760724.918107:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 49161 -> 51209 00010000:00010000:3.0:1789760724.918126:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.918141:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.918152:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.918160:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760724.918165:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.918174:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.918198:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760724.918207:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739857fac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760724.918345:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777199872:12345-192.168.203.38@tcp:4:dd.500 Request processed in 61816us (114780us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789760724.918358:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1789760724.918386:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401040547884 time 401040693658 state 0x2 ref 0 00000100:00100000:0.0:1789760724.940074:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760724.940740:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777200000 00000100:00100000:3.0:1789760724.940755:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777200000 00000100:00100000:3.0:1789760724.940862:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401040547884 time 401040693658 state 0x0 ref 1 00000100:00100000:3.0:1789760724.940881:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401240693658 time 401040693658 state 0x1 ref 1 00000100:00100000:0.0:1789760725.056925:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401240693658 time 401241116924 state 0x0 ref 1 00000100:00100000:0.0:1789760725.056976:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777200000:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760725.057064:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26214400, mtime: 0x6aad94d4, atime: 0x6aad94cf, ctime: 0x6aad94d4, blocks: 0xc809 00010000:00010000:0.0:1789760725.057075:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.057095:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1789760725.057101:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760725.057108:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.057125:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760725.175680:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967478 is committed 00002000:00010000:3.0:1789760725.175711:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:3.0:1789760725.175718:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 51209 -> 53257 00010000:00010000:3.0:1789760725.175736:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.175753:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.175763:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.175771:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760725.175777:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.175811:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.175837:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.175871:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a739857fb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760725.176008:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777200000:12345-192.168.203.38@tcp:4:dd.500 Request processed in 119053us (235944us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789760725.176020:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:3.0:1789760725.176031:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401240693658 time 401241116924 state 0x2 ref 0 00000100:00100000:0.0:1789760725.185380:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760725.185691:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777200128 00000100:00100000:1.0:1789760725.186858:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777200128 00000100:00100000:1.0:1789760725.186949:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401240693658 time 401241116924 state 0x0 ref 1 00000100:00100000:1.0:1789760725.186967:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401441116924 time 401241116924 state 0x1 ref 1 00000100:00100000:1.0:1789760725.196650:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798213632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760725.197482:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760725.197727:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798213632 00000100:00100000:0.0:1789760725.197748:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798213632 00000100:00100000:0.0:1789760725.197829:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789760725.197842:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3464:x1876699798213632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760725.198050:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760725.198507:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3464:x1876699798213632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 667us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760725.198516:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789760725.205206:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798213632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760725.257137:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401441116924 time 401441334500 state 0x0 ref 1 00000100:00100000:3.0:1789760725.257175:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777200128:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760725.257261:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 27262976, mtime: 0x6aad94d4, atime: 0x6aad94cf, ctime: 0x6aad94d4, blocks: 0xd009 00010000:00010000:3.0:1789760725.257279:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.257300:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1789760725.257305:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760725.257312:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.257330:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760725.258514:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:1.0:1789760725.258559:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1789760725.258573:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00010000:00010000:1.0:1789760725.258625:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.258638:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.258645:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.258652:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760725.258657:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.258665:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.258689:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:1.0:1789760725.258712:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760725.258719:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.258736:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4200/0xc2b9a3a739857eda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260720:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260751:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260760:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260767:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760725.260773:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260782:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260841:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e544c16400) 00010000:00010000:2.0:1789760725.260845:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760725.260851:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260877:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543e00/0xc2b9a3a739857db4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260906:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260913:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260920:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260925:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760725.260929:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260936:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260946:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:2.0:1789760725.260949:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760725.260952:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260959:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4c00/0xc2b9a3a739857dbb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260979:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.260986:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261000:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261006:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760725.261010:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261017:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261027:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:2.0:1789760725.261030:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789760725.261033:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261039:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543400/0xc2b9a3a739857e16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261055:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261061:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261066:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261072:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760725.261075:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261093:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261103:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:2.0:1789760725.261105:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760725.261108:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261114:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a739857e39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261129:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261136:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261142:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261148:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760725.261151:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261157:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261166:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x4009f790 (ffff97e5489b1400) 00010000:00010000:2.0:1789760725.261168:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760725.261171:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261183:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548543a00/0xc2b9a3a739857e6a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261202:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261208:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261214:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261219:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760725.261232:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261237:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261245:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760725.261248:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760725.261250:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261256:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a739857e7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261273:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261280:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261292:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261297:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760725.261300:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261306:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261315:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760725.261317:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760725.261320:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.261325:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e548542800/0xc2b9a3a739857eb0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760725.304820:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000001:00080000:2.0:1789760725.304859:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00000001:00080000:1.0:1789760725.326650:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967479 is committed 00002000:00010000:3.0:1789760725.326856:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:3.0:1789760725.326871:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 53257 -> 55305 00010000:00010000:3.0:1789760725.327076:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.327091:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.327102:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.327110:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760725.327116:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.327126:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.327151:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.327161:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760725.327449:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777200128:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70278us (142074us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789760725.327463:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1789760725.327476:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401441116924 time 401441334500 state 0x2 ref 0 00000100:00100000:1.0:1789760725.348417:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760725.350763:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777200256 00000100:00100000:0.0:1789760725.350835:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777200256 00000100:00100000:1.0:1789760725.350975:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401441116924 time 401441334500 state 0x0 ref 1 00000100:00100000:1.0:1789760725.350993:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401641334500 time 401441334500 state 0x1 ref 1 00000100:00100000:2.0:1789760725.458892:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401641334500 time 401643086399 state 0x0 ref 1 00000100:00100000:2.0:1789760725.458937:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777200256:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760725.459018:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 28311552, mtime: 0x6aad94d4, atime: 0x6aad94cf, ctime: 0x6aad94d4, blocks: 0xd809 00010000:00010000:2.0:1789760725.459029:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.459049:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:2.0:1789760725.459073:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760725.459081:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.459099:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.510981:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760725.561043:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967480 is committed 00002000:00010000:3.0:1789760725.561257:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:3.0:1789760725.561281:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 55305 -> 57353 00010000:00010000:3.0:1789760725.561301:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.561316:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.561326:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.561335:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760725.561342:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.561351:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.561377:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.561385:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760725.561519:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777200256:12345-192.168.203.38@tcp:4:dd.500 Request processed in 102598us (213112us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789760725.561530:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:3.0:1789760725.561540:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401641334500 time 401643086399 state 0x2 ref 0 00000100:00100000:0.0:1789760725.570399:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760725.570506:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777200384 00000100:00100000:3.0:1789760725.570518:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777200384 00000100:00100000:3.0:1789760725.570590:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401641334500 time 401643086399 state 0x0 ref 1 00000100:00100000:3.0:1789760725.570606:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401843086399 time 401643086399 state 0x1 ref 1 00000100:00100000:2.0:1789760725.659112:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401843086399 time 401843306404 state 0x0 ref 1 00000100:00100000:2.0:1789760725.659161:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777200384:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760725.659260:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 29360128, mtime: 0x6aad94d4, atime: 0x6aad94cf, ctime: 0x6aad94d4, blocks: 0xe009 00010000:00010000:2.0:1789760725.659272:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.659293:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:2.0:1789760725.659299:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760725.659307:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.659325:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760725.703496:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798213760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760725.703594:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760725.703811:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798213760 00000100:00100000:2.0:1789760725.703822:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798213760 00000100:00100000:2.0:1789760725.703897:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789760725.703909:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798213760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760725.703977:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760725.708338:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798213760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4415us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760725.708356:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789760725.709062:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798213760:0@lo:41:osp-pre-1-0.0 00002000:00010000:3.0:1789760725.718449:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:3.0:1789760725.718462:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760724 -> 1789760725 00002000:00010000:3.0:1789760725.718465:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760724 -> 1789760725 00002000:00010000:3.0:1789760725.718468:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 57353 -> 59401 00010000:00010000:3.0:1789760725.718487:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.718503:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.718514:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.718522:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760725.718528:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.718538:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.718586:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760725.718594:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739857fc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760725.718740:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777200384:12345-192.168.203.38@tcp:4:dd.500 Request processed in 59599us (148352us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789760725.718752:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:3.0:1789760725.718762:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401843086399 time 401843306404 state 0x2 ref 0 00000001:00080000:1.0:1789760725.723619:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967481 is committed 00000100:00100000:0.0:1789760725.728016:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760725.728152:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777200512 00000100:00100000:3.0:1789760725.728165:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777200512 00000100:00100000:3.0:1789760725.728275:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 401843086399 time 401843306404 state 0x0 ref 1 00000100:00100000:3.0:1789760725.728293:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402043306404 time 401843306404 state 0x1 ref 1 00000100:00100000:0.0:1789760725.861955:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402043306404 time 402046080899 state 0x0 ref 1 00000100:00100000:2.0:1789760725.864345:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777200512:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760725.864445:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 30408704, mtime: 0x6aad94d5, atime: 0x6aad94cf, ctime: 0x6aad94d5, blocks: 0xe809 00010000:00010000:2.0:1789760725.864458:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.864479:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1789760725.864484:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760725.864492:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.864525:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760726.024035:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967482 is committed 00002000:00010000:3.0:1789760726.024643:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:3.0:1789760726.024650:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 59401 -> 61449 00010000:00010000:3.0:1789760726.024669:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.024684:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.024694:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.024730:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760726.024737:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.024749:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.024776:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.024896:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739857fcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760726.025028:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777200512:12345-192.168.203.38@tcp:4:dd.500 Request processed in 163040us (297019us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789760726.025041:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:3.0:1789760726.025055:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402043306404 time 402046080899 state 0x2 ref 0 00000100:00100000:0.0:1789760726.037384:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760726.037461:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777200640 00000100:00100000:3.0:1789760726.037476:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777200640 00000100:00100000:3.0:1789760726.037581:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402043306404 time 402046080899 state 0x0 ref 1 00000100:00100000:3.0:1789760726.037599:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402246080899 time 402046080899 state 0x1 ref 1 00000100:00080000:0.0:1789760726.037810:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760726.062394:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402246080899 time 402246584286 state 0x0 ref 1 00000100:00100000:3.0:1789760726.062440:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777200640:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760726.062539:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 31457280, mtime: 0x6aad94d5, atime: 0x6aad94cf, ctime: 0x6aad94d5, blocks: 0xf009 00010000:00010000:3.0:1789760726.062552:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.062569:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1789760726.062574:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760726.062581:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.062597:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760726.114451:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967483 is committed 00002000:00010000:0.0:1789760726.114692:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:0.0:1789760726.114775:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 61449 -> 63497 00010000:00010000:0.0:1789760726.114821:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.114836:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.114842:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.115007:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760726.115012:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.115020:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.115043:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.115409:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c39e81a7/0xc2b9a3a739857fd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760726.115594:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777200640:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53171us (78219us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789760726.115609:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1789760726.115620:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402246080899 time 402246584286 state 0x2 ref 0 00000100:00100000:0.0:1789760726.121994:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760726.122060:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777200768 00000100:00100000:3.0:1789760726.122073:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777200768 00000100:00100000:3.0:1789760726.122148:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402246080899 time 402246584286 state 0x0 ref 1 00000100:00100000:3.0:1789760726.122164:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402446584286 time 402246584286 state 0x1 ref 1 00000100:00100000:3.0:1789760726.215410:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798214016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760726.215504:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760726.215616:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798214016 00000100:00100000:3.0:1789760726.215627:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798214016 00000100:00100000:3.0:1789760726.216230:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789760726.216246:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798214016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760726.216395:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798213888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760726.216451:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760726.216517:0:8115:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789760726.216528:0:8115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789760726.216676:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798213888 00000100:00100000:2.0:1789760726.216683:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798213888 00000100:00100000:2.0:1789760726.216878:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789760726.216886:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798213888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760726.216918:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124190720 pending 0 free 3829399552 avail 3825205248 00000100:00100000:2.0:1789760726.216975:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798213888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760726.216982:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789760726.217038:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798213888:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760726.217125:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124190720 pending 0 free 3829399552 avail 3825205248 00000100:00100000:3.0:1789760726.217176:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798214016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 934us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760726.217195:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1789760726.217324:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760726.217762:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798214016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760726.262767:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402446584286 time 402446961792 state 0x0 ref 1 00000100:00100000:0.0:1789760726.262848:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777200768:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760726.262929:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 32505856, mtime: 0x6aad94d5, atime: 0x6aad94cf, ctime: 0x6aad94d5, blocks: 0xf809 00010000:00010000:0.0:1789760726.262940:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.262977:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1789760726.262982:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760726.262990:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.263006:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760726.320357:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967484 is committed 00002000:00010000:3.0:1789760726.320362:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:3.0:1789760726.320369:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 63497 -> 65545 00010000:00010000:3.0:1789760726.320387:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.320403:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.320413:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.320421:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760726.320427:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.320437:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.320532:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.320540:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739857fdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760726.320676:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777200768:12345-192.168.203.38@tcp:4:dd.500 Request processed in 57847us (198687us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789760726.320708:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:3.0:1789760726.320720:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402446584286 time 402446961792 state 0x2 ref 0 00000100:00100000:0.0:1789760726.335343:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760726.335449:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777200896 00000100:00100000:3.0:1789760726.335463:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777200896 00000100:00100000:3.0:1789760726.335603:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402446584286 time 402446961792 state 0x0 ref 1 00000100:00100000:3.0:1789760726.335619:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402646961792 time 402446961792 state 0x1 ref 1 00000100:00100000:3.0:1789760726.463685:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402646961792 time 402647881033 state 0x0 ref 1 00000100:00100000:3.0:1789760726.463741:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777200896:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760726.463881:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 33554432, mtime: 0x6aad94d5, atime: 0x6aad94cf, ctime: 0x6aad94d5, blocks: 0x10009 00010000:00010000:3.0:1789760726.463893:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.463914:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1789760726.463920:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760726.463928:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.463944:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760726.513593:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967485 is committed 00002000:00010000:0.0:1789760726.513777:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:0.0:1789760726.513784:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 65545 -> 67593 00010000:00010000:0.0:1789760726.513919:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.513934:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.513943:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.513950:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760726.513955:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.513964:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.514008:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.514016:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000088c6779/0xc2b9a3a739857fe4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760726.514143:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777200896:12345-192.168.203.38@tcp:4:dd.500 Request processed in 50419us (178808us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789760726.514154:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1789760726.514164:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402646961792 time 402647881033 state 0x2 ref 0 00000100:00100000:1.0:1789760726.519069:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760726.519167:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777201024 00000100:00100000:3.0:1789760726.519178:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777201024 00000100:00100000:3.0:1789760726.519274:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402646961792 time 402647881033 state 0x0 ref 1 00000100:00100000:3.0:1789760726.519290:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402847881033 time 402647881033 state 0x1 ref 1 00010000:00010000:1.0:1789760726.534958:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760726.664358:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402847881033 time 402848550916 state 0x0 ref 1 00000100:00100000:1.0:1789760726.664406:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777201024:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760726.664492:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 34603008, mtime: 0x6aad94d5, atime: 0x6aad94cf, ctime: 0x6aad94d5, blocks: 0x10809 00010000:00010000:1.0:1789760726.664504:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.664525:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1789760726.664531:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760726.664538:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.664581:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760726.736243:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967486 is committed 00002000:00010000:2.0:1789760726.736409:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:2.0:1789760726.736416:0:13385:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760725 -> 1789760726 00002000:00010000:2.0:1789760726.736419:0:13385:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760725 -> 1789760726 00002000:00010000:2.0:1789760726.736422:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 67593 -> 69641 00010000:00010000:2.0:1789760726.736440:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.736457:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.736467:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.736476:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760726.736481:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.736492:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.736544:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.736552:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857feb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760726.736676:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777201024:12345-192.168.203.38@tcp:4:dd.500 Request processed in 72287us (217614us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789760726.736688:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:2.0:1789760726.736699:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402847881033 time 402848550916 state 0x2 ref 0 00000100:00100000:3.0:1789760726.749420:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760726.750420:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777201152 00000100:00100000:0.0:1789760726.750438:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777201152 00000100:00100000:0.0:1789760726.750514:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 402847881033 time 402848550916 state 0x0 ref 1 00000100:00100000:0.0:1789760726.750531:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403048550916 time 402848550916 state 0x1 ref 1 00000020:00080000:1.0:1789760726.813321:0:7272:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4 batchid updated 00000020:00080000:3.0:1789760726.813371:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4 00000004:00080000:3.0:1789760726.813454:0:7284:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e448b03540 with version 11 00000020:00080000:3.0:1789760726.813474:0:7284:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4 cancel update log [0x200000401:0x2:0x0].4: rc = 0 00000020:00080000:3.0:1789760726.814131:0:7284:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4 cancel update log [0x240000400:0x2:0x0].4: rc = 0 00000020:00080000:3.0:1789760726.814144:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4 00000004:00080000:2.0:1789760726.816024:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 11 rpc_version 11 00000020:00100000:2.0:1789760726.816093:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760726.816108:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e449346d80 x1876699798214272/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760726.816141:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449346d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798214272:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789760726.816249:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760726.816344:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57fd8d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760726.816996:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798214272 00000100:00100000:3.0:1789760726.817009:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798214272 00000100:00100000:3.0:1789760726.817095:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789760726.817107:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7275:x1876699798214272:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789760726.817544:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7275:x1876699798214272:12345-0@lo:1000:osp_up0-1.0 Request processed in 437us (1293us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789760726.817554:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789760726.817678:0:7275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967353 gen 2 00000004:00080000:2.0:1789760726.817685:0:7275:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967353 committed transno 4294967353 00000100:00100000:2.0:1789760726.817720:0:7275:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff97e449346d80 x1876699798214272/t4294967354(4294967354) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789760742 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760726.817743:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449346d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798214272:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789760726.864948:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403048550916 time 403049068097 state 0x0 ref 1 00000100:00100000:3.0:1789760726.865003:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777201152:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760726.865092:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 35651584, mtime: 0x6aad94d6, atime: 0x6aad94cf, ctime: 0x6aad94d6, blocks: 0x11009 00010000:00010000:3.0:1789760726.865103:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.865124:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1789760726.865129:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760726.865137:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760726.865180:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760726.936038:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967487 is committed 00002000:00010000:0.0:1789760726.936175:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:0.0:1789760726.936181:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 69641 -> 71689 00010000:00010000:0.0:1789760726.936200:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.936227:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.936238:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.936268:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760726.936275:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.936287:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.936314:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.936324:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a739857ff2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760726.936463:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777201152:12345-192.168.203.38@tcp:4:dd.500 Request processed in 71483us (187049us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789760726.936477:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:0.0:1789760726.936488:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403048550916 time 403049068097 state 0x2 ref 0 00000100:00100000:2.0:1789760726.946588:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760726.946946:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777201280 00000100:00100000:3.0:1789760726.946960:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777201280 00000100:00100000:3.0:1789760726.947043:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403048550916 time 403049068097 state 0x0 ref 1 00000100:00100000:3.0:1789760726.947061:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403249068097 time 403049068097 state 0x1 ref 1 00000100:00100000:1.0:1789760727.065306:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403249068097 time 403249497743 state 0x0 ref 1 00000100:00100000:1.0:1789760727.065356:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777201280:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760727.065443:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 36700160, mtime: 0x6aad94d6, atime: 0x6aad94cf, ctime: 0x6aad94d6, blocks: 0x11809 00010000:00010000:1.0:1789760727.065455:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.065476:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789760727.065480:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760727.065488:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.065676:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760727.176691:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967488 is committed 00002000:00010000:0.0:1789760727.176939:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:0.0:1789760727.176944:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 71689 -> 73737 00010000:00010000:0.0:1789760727.176963:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.176979:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.177005:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.177015:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760727.177021:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.177031:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.177056:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.177065:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005afb507/0xc2b9a3a739857ff9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760727.177185:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777201280:12345-192.168.203.38@tcp:4:dd.500 Request processed in 111848us (230605us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1789760727.177196:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:0.0:1789760727.177216:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403249068097 time 403249497743 state 0x2 ref 0 00000100:00100000:3.0:1789760727.193356:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760727.193947:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777201408 00000100:00100000:0.0:1789760727.193961:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777201408 00000100:00100000:0.0:1789760727.194048:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403249068097 time 403249497743 state 0x0 ref 1 00000100:00100000:0.0:1789760727.194065:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403449497743 time 403249497743 state 0x1 ref 1 00000100:00100000:0.0:1789760727.266500:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403449497743 time 403450695539 state 0x0 ref 1 00000100:00100000:0.0:1789760727.266545:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777201408:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760727.266624:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 37748736, mtime: 0x6aad94d6, atime: 0x6aad94cf, ctime: 0x6aad94d6, blocks: 0x12009 00010000:00010000:0.0:1789760727.266636:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.266656:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789760727.266662:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760727.266669:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.266695:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760727.376167:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967489 is committed 00002000:00010000:1.0:1789760727.378628:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:1.0:1789760727.378643:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 73737 -> 75785 00010000:00010000:1.0:1789760727.378662:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.378769:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.378780:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.378825:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760727.378831:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.378841:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.378868:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.378876:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a739858000 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760727.379008:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777201408:12345-192.168.203.38@tcp:4:dd.500 Request processed in 112480us (186541us total) trans 4294967489 rc 0/0 00000100:00100000:1.0:1789760727.379022:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:1.0:1789760727.379032:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403449497743 time 403450695539 state 0x2 ref 0 00000100:00100000:3.0:1789760727.389986:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760727.390938:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777201536 00000100:00100000:2.0:1789760727.390953:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777201536 00000100:00100000:2.0:1789760727.391031:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403449497743 time 403450695539 state 0x0 ref 1 00000100:00100000:2.0:1789760727.391048:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403650695539 time 403450695539 state 0x1 ref 1 00000100:00100000:1.0:1789760727.468533:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403650695539 time 403652655955 state 0x0 ref 1 00000100:00100000:1.0:1789760727.468999:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777201536:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760727.469136:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 38797312, mtime: 0x6aad94d6, atime: 0x6aad94cf, ctime: 0x6aad94d6, blocks: 0x12809 00010000:00010000:1.0:1789760727.469148:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.469169:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789760727.469174:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760727.469183:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.469202:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760727.534400:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967490 is committed 00002000:00010000:1.0:1789760727.541250:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:1.0:1789760727.541260:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 75785 -> 77833 00010000:00010000:1.0:1789760727.541273:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.541286:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.541294:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.541301:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760727.541306:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.541333:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.541353:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.541362:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a111fb04/0xc2b9a3a739858007 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760727.541460:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777201536:12345-192.168.203.38@tcp:4:dd.500 Request processed in 72478us (151484us total) trans 4294967490 rc 0/0 00000100:00100000:1.0:1789760727.541470:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1789760727.541478:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403650695539 time 403652655955 state 0x2 ref 0 00000100:00100000:3.0:1789760727.552054:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760727.552715:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777201664 00000100:00100000:0.0:1789760727.552733:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777201664 00000100:00100000:0.0:1789760727.552857:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403650695539 time 403652655955 state 0x0 ref 1 00000100:00100000:0.0:1789760727.552872:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403852655955 time 403652655955 state 0x1 ref 1 00010000:00010000:3.0:1789760727.560403:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760727.597380:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760727.597440:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760727.597488:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760727.597682:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777202176 00000100:00100000:0.0:1789760727.597697:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777202176 00000100:00100000:0.0:1789760727.597831:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:0.0:1789760727.597844:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777202176:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760727.597958:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777202176:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 117us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760727.597997:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00080000:2.0:1789760727.598647:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760727.599080:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777201920 00000100:00100000:3.0:1789760727.599090:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777201920 00000100:00100000:1.0:1789760727.599994:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777202432 00000100:00080000:2.0:1789760727.600001:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760727.600011:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777202432 00000100:00080000:2.0:1789760727.600056:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760727.600144:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 388 00000100:00100000:0.0:1789760727.600285:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760727.600324:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760727.600349:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777201792 00000100:00100000:0.0:1789760727.600355:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777201792 00000100:00100000:0.0:1789760727.600404:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 372 00000100:00100000:0.0:1789760727.600413:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777201792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760727.600494:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777201792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760727.600501:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 372 00000100:00100000:0.0:1789760727.600540:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777202048 00000100:00100000:0.0:1789760727.600544:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777202048 00000100:00100000:3.0:1789760727.600577:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2406:x1876699777201920:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760727.600616:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2406:x1876699777201920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 462us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760727.605432:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 389 00000100:00100000:2.0:1789760727.605453:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777202432:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760727.605552:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777202432:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 107us (8063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760727.605561:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 389 00000100:00100000:3.0:1789760727.607508:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 388 00000100:00100000:1.0:1789760727.608216:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760727.608373:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777202304 00000100:00100000:2.0:1789760727.608387:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777202304 00000100:00100000:2.0:1789760727.608531:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 390 00000100:00100000:2.0:1789760727.608544:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777202304:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760727.608644:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777202304:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 104us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760727.608652:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 390 00000100:00100000:0.0:1789760727.609606:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 391 00000100:00100000:0.0:1789760727.609624:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777202048:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760727.609698:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777202048:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (9372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760727.609705:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 391 00000100:00080000:0.0:1789760727.609737:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760727.609742:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760727.668667:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403852655955 time 403852856917 state 0x0 ref 1 00000100:00100000:2.0:1789760727.669510:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777201664:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760727.674081:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 39845888, mtime: 0x6aad94d6, atime: 0x6aad94cf, ctime: 0x6aad94d6, blocks: 0x13009 00010000:00010000:3.0:1789760727.674103:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.674126:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1789760727.674132:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760727.674161:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.674181:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760727.738385:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967491 is committed 00002000:00010000:3.0:1789760727.738546:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:3.0:1789760727.738564:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760726 -> 1789760727 00002000:00010000:3.0:1789760727.738567:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760726 -> 1789760727 00002000:00010000:3.0:1789760727.738570:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 77833 -> 79881 00010000:00010000:3.0:1789760727.738589:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.738605:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.738615:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.738623:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760727.738629:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.738713:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.738738:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.738764:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985800e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760727.739097:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777201664:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70323us (187049us total) trans 4294967491 rc 0/0 00000100:00100000:3.0:1789760727.739110:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:3.0:1789760727.739120:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403852655955 time 403852856917 state 0x2 ref 0 00000100:00100000:0.0:1789760727.747323:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760727.747452:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777202560 00000100:00100000:1.0:1789760727.747466:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777202560 00000100:00100000:1.0:1789760727.747540:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 403852655955 time 403852856917 state 0x0 ref 1 00000100:00100000:1.0:1789760727.747553:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404052856917 time 403852856917 state 0x1 ref 1 00000100:00100000:0.0:1789760727.869073:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404052856917 time 404053264987 state 0x0 ref 1 00000100:00100000:0.0:1789760727.869131:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777202560:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760727.869233:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 40894464, mtime: 0x6aad94d7, atime: 0x6aad94cf, ctime: 0x6aad94d7, blocks: 0x13809 00010000:00010000:0.0:1789760727.869244:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.869294:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1789760727.869300:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760727.869308:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.869328:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760727.925242:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967492 is committed 00002000:00010000:0.0:1789760727.925505:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:0.0:1789760727.925511:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 79881 -> 81929 00010000:00010000:0.0:1789760727.925529:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.925546:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.925556:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.925565:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760727.925572:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.925583:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.925702:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760727.925773:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a739858015 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760727.926371:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777202560:12345-192.168.203.38@tcp:4:dd.500 Request processed in 57265us (179053us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1789760727.926385:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:0.0:1789760727.926396:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404052856917 time 404053264987 state 0x2 ref 0 00000100:00100000:2.0:1789760727.934360:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760727.934628:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777202688 00000100:00100000:1.0:1789760727.939363:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777202688 00000100:00100000:1.0:1789760727.939456:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404052856917 time 404053264987 state 0x0 ref 1 00000100:00100000:1.0:1789760727.939497:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404253264987 time 404053264987 state 0x1 ref 1 00000100:00100000:0.0:1789760728.069515:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404253264987 time 404253712314 state 0x0 ref 1 00000100:00100000:0.0:1789760728.069574:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777202688:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760728.069648:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 41943040, mtime: 0x6aad94d7, atime: 0x6aad94cf, ctime: 0x6aad94d7, blocks: 0x14009 00010000:00010000:0.0:1789760728.069658:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.069677:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1789760728.069690:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760728.069698:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.069715:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760728.070149:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760728.147172:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967493 is committed 00002000:00010000:3.0:1789760728.147604:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:3.0:1789760728.147610:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 81929 -> 83979 00010000:00010000:3.0:1789760728.147629:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.147644:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.147654:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.147662:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760728.147667:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.147676:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.147727:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.147735:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f6872b/0xc2b9a3a73985801c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760728.148431:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777202688:12345-192.168.203.38@tcp:4:dd.500 Request processed in 78886us (214077us total) trans 4294967493 rc 0/0 00000100:00100000:3.0:1789760728.148446:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1789760728.148456:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404253264987 time 404253712314 state 0x2 ref 0 00000100:00100000:2.0:1789760728.154721:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760728.154822:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777202816 00000100:00100000:1.0:1789760728.154836:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777202816 00000100:00100000:1.0:1789760728.154924:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404253264987 time 404253712314 state 0x0 ref 1 00000100:00100000:1.0:1789760728.154941:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404453712314 time 404253712314 state 0x1 ref 1 00000100:00100000:3.0:1789760728.270615:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404453712314 time 404454808770 state 0x0 ref 1 00000100:00100000:3.0:1789760728.270663:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777202816:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760728.270758:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 42991616, mtime: 0x6aad94d7, atime: 0x6aad94cf, ctime: 0x6aad94d7, blocks: 0x1480b 00010000:00010000:3.0:1789760728.270770:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.270821:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789760728.270828:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760728.270836:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.270855:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760728.319718:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967494 is committed 00002000:00010000:3.0:1789760728.319897:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:3.0:1789760728.319903:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 83979 -> 86027 00010000:00010000:3.0:1789760728.319928:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.319945:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.319955:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.319964:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760728.319970:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.319981:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.320007:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.320015:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858023 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760728.320137:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777202816:12345-192.168.203.38@tcp:4:dd.500 Request processed in 49493us (165441us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789760728.320166:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:3.0:1789760728.320176:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404453712314 time 404454808770 state 0x2 ref 0 00000100:00100000:2.0:1789760728.327593:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760728.327667:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777202944 00000100:00100000:3.0:1789760728.327686:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777202944 00000100:00100000:3.0:1789760728.327751:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404453712314 time 404454808770 state 0x0 ref 1 00000100:00100000:3.0:1789760728.327766:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404654808770 time 404454808770 state 0x1 ref 1 00000100:00100000:3.0:1789760728.470768:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404654808770 time 404654961283 state 0x0 ref 1 00000100:00100000:3.0:1789760728.470870:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777202944:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760728.470955:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 44040192, mtime: 0x6aad94d7, atime: 0x6aad94cf, ctime: 0x6aad94d7, blocks: 0x1500b 00010000:00010000:3.0:1789760728.470968:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.470991:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789760728.470997:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760728.471005:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760728.471025:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.582978:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789760728.618507:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:2.0:1789760728.618520:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 86027 -> 88075 00010000:00010000:2.0:1789760728.618605:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760728.618625:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760728.618636:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760728.618645:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760728.618651:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760728.618662:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760728.618755:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760728.618766:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a73985802a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760728.618953:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967495 is committed 00000100:00100000:2.0:1789760728.620448:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777202944:12345-192.168.203.38@tcp:4:dd.500 Request processed in 149605us (292854us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789760728.620465:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:2.0:1789760728.620480:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404654808770 time 404654961283 state 0x2 ref 0 00000100:00100000:1.0:1789760728.629694:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760728.629973:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777203072 00000100:00100000:0.0:1789760728.629986:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777203072 00000100:00100000:0.0:1789760728.630062:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404654808770 time 404654961283 state 0x0 ref 1 00000100:00100000:0.0:1789760728.630080:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404854961283 time 404654961283 state 0x1 ref 1 00000100:00100000:0.0:1789760728.671387:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404854961283 time 404855581750 state 0x0 ref 1 00000100:00100000:0.0:1789760728.671431:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777203072:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760728.671514:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 45088768, mtime: 0x6aad94d7, atime: 0x6aad94cf, ctime: 0x6aad94d7, blocks: 0x1580b 00010000:00010000:0.0:1789760728.671526:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.671545:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1789760728.671550:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760728.671558:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.671575:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760728.773131:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967496 is committed 00002000:00010000:0.0:1789760728.773271:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:0.0:1789760728.773277:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760727 -> 1789760728 00002000:00010000:0.0:1789760728.773280:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760727 -> 1789760728 00002000:00010000:0.0:1789760728.773283:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 88075 -> 90123 00010000:00010000:0.0:1789760728.773311:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.773346:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.773356:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.773364:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760728.773369:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.773380:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.773407:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.773415:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858031 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760728.773554:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777203072:12345-192.168.203.38@tcp:4:dd.500 Request processed in 102131us (143862us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789760728.773566:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:0.0:1789760728.773577:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404854961283 time 404855581750 state 0x2 ref 0 00000100:00100000:0.0:1789760728.786052:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760728.786148:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777203200 00000100:00100000:3.0:1789760728.786162:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777203200 00000100:00100000:3.0:1789760728.786242:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 404854961283 time 404855581750 state 0x0 ref 1 00000100:00100000:3.0:1789760728.786264:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405055581750 time 404855581750 state 0x1 ref 1 00000100:00100000:0.0:1789760728.871584:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405055581750 time 405055774777 state 0x0 ref 1 00000100:00100000:0.0:1789760728.871644:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777203200:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760728.871741:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 46137344, mtime: 0x6aad94d8, atime: 0x6aad94cf, ctime: 0x6aad94d8, blocks: 0x1600b 00010000:00010000:0.0:1789760728.871754:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.871775:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1789760728.871781:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760728.871848:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.871870:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760728.954815:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:1.0:1789760728.954828:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 90123 -> 92171 00010000:00010000:1.0:1789760728.954857:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.954873:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.954884:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.954893:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760728.954900:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.954936:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.954962:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.954976:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858038 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760728.955105:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777203200:12345-192.168.203.38@tcp:4:dd.500 Request processed in 83490us (169063us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789760728.955413:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:1.0:1789760728.955425:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405055581750 time 405055774777 state 0x2 ref 0 00000001:00080000:2.0:1789760728.956582:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967497 is committed 00000100:00100000:1.0:1789760728.968071:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760728.968544:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777203328 00000100:00100000:2.0:1789760728.968557:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777203328 00000100:00100000:2.0:1789760728.968633:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405055581750 time 405055774777 state 0x0 ref 1 00000100:00100000:2.0:1789760728.968650:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405255774777 time 405055774777 state 0x1 ref 1 00000100:00100000:1.0:1789760729.072076:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405255774777 time 405256268486 state 0x0 ref 1 00000100:00100000:1.0:1789760729.072125:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777203328:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760729.072219:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 47185920, mtime: 0x6aad94d8, atime: 0x6aad94cf, ctime: 0x6aad94d8, blocks: 0x1680b 00010000:00010000:1.0:1789760729.072230:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.072498:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1789760729.072503:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760729.072511:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.072547:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760729.139393:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967498 is committed 00002000:00010000:1.0:1789760729.139738:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:1.0:1789760729.139744:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 92171 -> 94219 00010000:00010000:1.0:1789760729.139761:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.139776:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.139809:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.139818:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760729.139823:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.139833:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.139913:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.139933:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985803f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760729.140296:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777203328:12345-192.168.203.38@tcp:4:dd.500 Request processed in 68190us (172232us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789760729.140309:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:1.0:1789760729.140319:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405255774777 time 405256268486 state 0x2 ref 0 00000100:00100000:2.0:1789760729.149203:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760729.149460:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777203456 00000100:00100000:0.0:1789760729.149474:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777203456 00000100:00100000:0.0:1789760729.149547:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405255774777 time 405256268486 state 0x0 ref 1 00000100:00100000:0.0:1789760729.149562:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405456268486 time 405256268486 state 0x1 ref 1 00000100:00100000:2.0:1789760729.272523:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405456268486 time 405456716917 state 0x0 ref 1 00000100:00100000:2.0:1789760729.272582:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777203456:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760729.272670:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 48234496, mtime: 0x6aad94d8, atime: 0x6aad94cf, ctime: 0x6aad94d8, blocks: 0x1700b 00010000:00010000:2.0:1789760729.272694:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760729.272717:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:2.0:1789760729.272723:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760729.272730:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760729.272778:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760729.359633:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967499 is committed 00002000:00010000:3.0:1789760729.359970:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789760729.359978:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 94219 -> 96267 00010000:00010000:3.0:1789760729.360003:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.360020:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.360033:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.360043:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760729.360048:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.360059:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.360085:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.360094:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858046 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760729.360314:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777203456:12345-192.168.203.38@tcp:4:dd.500 Request processed in 87753us (211127us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789760729.360346:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:3.0:1789760729.360357:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405456268486 time 405456716917 state 0x2 ref 0 00000100:00100000:1.0:1789760729.368554:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760729.368740:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777203584 00000100:00100000:0.0:1789760729.368753:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777203584 00000100:00100000:0.0:1789760729.368870:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405456268486 time 405456716917 state 0x0 ref 1 00000100:00100000:0.0:1789760729.368886:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405656716917 time 405456716917 state 0x1 ref 1 00000100:00100000:1.0:1789760729.472676:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405656716917 time 405656870930 state 0x0 ref 1 00000100:00100000:1.0:1789760729.472723:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777203584:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760729.472837:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 49283072, mtime: 0x6aad94d8, atime: 0x6aad94cf, ctime: 0x6aad94d8, blocks: 0x1780b 00010000:00010000:1.0:1789760729.472854:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.472875:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1789760729.472881:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760729.472888:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.472906:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760729.552777:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967500 is committed 00002000:00010000:1.0:1789760729.553359:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:1.0:1789760729.553366:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 96267 -> 98315 00010000:00010000:1.0:1789760729.553387:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.553418:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.553430:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.553439:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760729.553445:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.553457:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.553487:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760729.553495:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a73985804d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760729.553996:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777203584:12345-192.168.203.38@tcp:4:dd.500 Request processed in 81289us (185447us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789760729.554009:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1789760729.554019:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405656716917 time 405656870930 state 0x2 ref 0 00000100:00100000:0.0:1789760729.563074:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760729.563378:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777203712 00000100:00100000:1.0:1789760729.563407:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777203712 00000100:00100000:1.0:1789760729.563485:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405656716917 time 405656870930 state 0x0 ref 1 00000100:00100000:1.0:1789760729.563502:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405856870930 time 405656870930 state 0x1 ref 1 00010000:00010000:1.0:1789760729.607502:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760729.672955:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405856870930 time 405857155937 state 0x0 ref 1 00000100:00100000:3.0:1789760729.672988:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777203712:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760729.673043:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 50331648, mtime: 0x6aad94d8, atime: 0x6aad94cf, ctime: 0x6aad94d8, blocks: 0x1800b 00010000:00010000:3.0:1789760729.673052:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.673067:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:3.0:1789760729.673071:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760729.673078:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.673092:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760729.743197:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967501 is committed 00002000:00010000:3.0:1789760729.743293:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:3.0:1789760729.743298:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760728 -> 1789760729 00002000:00010000:3.0:1789760729.743301:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760728 -> 1789760729 00002000:00010000:3.0:1789760729.743303:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 98315 -> 100363 00010000:00010000:3.0:1789760729.743318:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.743330:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.743356:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.743364:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760729.743369:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.743378:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.743401:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.743409:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858054 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760729.743574:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777203712:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70596us (180511us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789760729.743585:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1789760729.743592:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405856870930 time 405857155937 state 0x2 ref 0 00000100:00100000:1.0:1789760729.751429:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760729.751518:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777203840 00000100:00100000:0.0:1789760729.751528:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777203840 00000100:00100000:0.0:1789760729.751584:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 405856870930 time 405857155937 state 0x0 ref 1 00000100:00100000:0.0:1789760729.751597:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406057155937 time 405857155937 state 0x1 ref 1 00000100:00100000:2.0:1789760729.799103:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798214400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760729.799106:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798214528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760729.799977:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798214656:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.802963:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760729.803081:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.803099:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798214912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760729.803141:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798215168:0@lo:400:kworker.0 00000100:00100000:0.0:1789760729.803148:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798214656 00000100:00100000:0.0:1789760729.803156:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798214656 00000100:00100000:3.0:1789760729.803172:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760729.803218:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789760729.803231:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798214656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803253:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798215424:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803301:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760729.803319:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798214656:12345-0@lo:400:kworker.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760729.803329:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789760729.803333:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798215936:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803370:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.803400:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789760729.803407:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798214784:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803432:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.803464:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798215296:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803488:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.803506:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798215808:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803527:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.803566:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798215424 00000100:00100000:3.0:1789760729.803573:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798215424 00000100:00100000:3.0:1789760729.803622:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798215936 00000100:00100000:3.0:1789760729.803625:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798215936 00000100:00100000:3.0:1789760729.803639:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798214784 00000100:00100000:3.0:1789760729.803642:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798214784 00000100:00100000:3.0:1789760729.803654:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798215296 00000100:00100000:3.0:1789760729.803656:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798215296 00000100:00100000:3.0:1789760729.803672:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798215808 00000100:00100000:3.0:1789760729.803674:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798215808 00000100:00100000:3.0:1789760729.803690:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789760729.803697:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798215424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803750:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798215424:12345-0@lo:400:kworker.0 Request processed in 53us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760729.803760:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00080000:1.0:1789760729.803769:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760729.803779:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760729.803821:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789760729.803830:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798215936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760729.803859:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789760729.803876:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798214784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803883:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798215936:12345-0@lo:400:kworker.0 Request processed in 49us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760729.803898:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789760729.803916:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789760729.803924:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798215296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.803953:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798215296:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760729.803960:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789760729.803972:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789760729.803978:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798215808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.804039:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798215808:12345-0@lo:400:kworker.0 Request processed in 53us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760729.804040:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798214784:12345-0@lo:400:kworker.0 Request processed in 162us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760729.804059:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789760729.804074:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789760729.804102:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760729.804130:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798214912 00000100:00100000:1.0:1789760729.804140:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798214912 00000100:00100000:3.0:1789760729.804147:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798215680:0@lo:400:kworker.0 00000100:00100000:1.0:1789760729.804183:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798215168 00000100:00100000:1.0:1789760729.804199:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798215168 00000100:00100000:3.0:1789760729.804200:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.804228:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798216192:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.804250:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.804292:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798214656:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.804315:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789760729.804321:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798215040:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.804347:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.804364:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798215552:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.804383:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760729.804411:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798216064:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.804434:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760729.804455:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789760729.804468:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3464:x1876699798214912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.804486:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789760729.804500:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798215168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760729.804536:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3464:x1876699798214912:12345-0@lo:400:kworker.0 Request processed in 68us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760729.804545:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789760729.804581:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798214528 00000100:00100000:1.0:1789760729.804587:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798214528 00000100:00100000:1.0:1789760729.804638:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789760729.804645:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798214528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789760729.804674:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760729.804714:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798214528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760729.804721:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1789760729.804747:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760729.804839:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760729.804896:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798215680 00000100:00100000:2.0:1789760729.804900:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798215680 00000100:00100000:1.0:1789760729.804998:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798214400 00000100:00100000:1.0:1789760729.805003:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798214400 00000100:00100000:1.0:1789760729.805032:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789760729.805038:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798214400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760729.805050:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760729.805082:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798214400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760729.805089:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1789760729.805102:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760729.805169:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798216192 00000100:00100000:2.0:1789760729.805172:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798216192 00000100:00100000:2.0:1789760729.805184:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798215552 00000100:00100000:2.0:1789760729.805199:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798215552 00000100:00100000:2.0:1789760729.805323:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798216064 00000100:00100000:2.0:1789760729.805327:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798216064 00000100:00100000:2.0:1789760729.805342:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789760729.805348:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798215680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805382:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798215680:12345-0@lo:400:kworker.0 Request processed in 34us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760729.805388:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789760729.805399:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789760729.805405:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798216192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805430:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798216192:12345-0@lo:400:kworker.0 Request processed in 25us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760729.805435:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789760729.805445:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789760729.805450:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798215552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805489:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798215552:12345-0@lo:400:kworker.0 Request processed in 38us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760729.805496:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789760729.805507:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789760729.805513:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798216064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760729.805521:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798215040 00000100:00100000:0.0:1789760729.805525:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798215040 00000100:00100000:2.0:1789760729.805537:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798216064:12345-0@lo:400:kworker.0 Request processed in 26us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760729.805543:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789760729.805553:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789760729.805561:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798215040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805589:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798214400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760729.805603:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798215040:12345-0@lo:400:kworker.0 Request processed in 44us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760729.805608:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789760729.805652:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798214784:0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805665:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798215296:0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805675:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798215808:0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805686:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798214912:0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805698:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798215424:0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805709:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798215936:0@lo:400:kworker.0 00000100:00100000:2.0:1789760729.805719:0:3464:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1789760729.805723:0:3464:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e57fc4a300, transno 4294967346 00000100:00100000:3.0:1789760729.806354:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798215168:12345-0@lo:400:kworker.0 Request processed in 70us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760729.806371:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789760729.806482:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798215040:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.806497:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798215552:0@lo:400:kworker.0 00000100:00080000:1.0:1789760729.806610:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789760729.806697:0:3464:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e57fc49180, transno 4294967347 00000100:00100000:2.0:1789760729.808804:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798214528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760729.810836:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798216064:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.810896:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798215168:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.810922:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798215680:0@lo:400:kworker.0 00000100:00100000:3.0:1789760729.810939:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798216192:0@lo:400:kworker.0 00000100:00100000:0.0:1789760729.873067:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406057155937 time 406057260257 state 0x0 ref 1 00000100:00100000:0.0:1789760729.873117:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777203840:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760729.873207:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 51380224, mtime: 0x6aad94d9, atime: 0x6aad94cf, ctime: 0x6aad94d9, blocks: 0x1880b 00010000:00010000:0.0:1789760729.873220:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760729.873265:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1789760729.873271:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760729.873279:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760729.873299:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760729.975965:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:3.0:1789760729.975978:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 100363 -> 102411 00010000:00010000:3.0:1789760729.975998:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.976014:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.976025:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.976059:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760729.976065:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.976076:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.976104:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760729.976124:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985805b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760729.976366:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777203840:12345-192.168.203.38@tcp:4:dd.500 Request processed in 103267us (224937us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789760729.976380:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:3.0:1789760729.976391:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406057155937 time 406057260257 state 0x2 ref 0 00000001:00080000:3.0:1789760729.976924:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967502 is committed 00000100:00100000:2.0:1789760729.987835:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760729.988019:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777203968 00000100:00100000:3.0:1789760729.988033:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777203968 00000100:00100000:3.0:1789760729.988123:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406057155937 time 406057260257 state 0x0 ref 1 00000100:00100000:3.0:1789760729.988140:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406257260257 time 406057260257 state 0x1 ref 1 00000100:00100000:3.0:1789760730.075029:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406257260257 time 406259224977 state 0x0 ref 1 00000100:00100000:3.0:1789760730.075119:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777203968:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760730.075216:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 52428800, mtime: 0x6aad94d9, atime: 0x6aad94cf, ctime: 0x6aad94d9, blocks: 0x1900b 00010000:00010000:3.0:1789760730.075227:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.075246:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789760730.075251:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760730.075259:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.075276:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760730.076034:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760730.162210:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967503 is committed 00002000:00010000:3.0:1789760730.162410:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:3.0:1789760730.162416:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 102411 -> 104459 00010000:00010000:3.0:1789760730.162436:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.162453:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.162464:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.162473:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760730.162478:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.162509:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.162535:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.162544:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858062 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760730.162714:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777203968:12345-192.168.203.38@tcp:4:dd.500 Request processed in 87642us (174895us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789760730.162727:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:3.0:1789760730.162738:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406257260257 time 406259224977 state 0x2 ref 0 00000100:00100000:0.0:1789760730.186429:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760730.186566:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777204096 00000100:00100000:3.0:1789760730.186581:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777204096 00000100:00100000:3.0:1789760730.186656:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406257260257 time 406259224977 state 0x0 ref 1 00000100:00100000:3.0:1789760730.186682:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406459224977 time 406259224977 state 0x1 ref 1 00000100:00100000:3.0:1789760730.276008:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406459224977 time 406460206242 state 0x0 ref 1 00000100:00100000:3.0:1789760730.276048:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777204096:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760730.276145:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 53477376, mtime: 0x6aad94d9, atime: 0x6aad94cf, ctime: 0x6aad94d9, blocks: 0x1980b 00010000:00010000:3.0:1789760730.276157:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.276207:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789760730.276213:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760730.276221:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.276239:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760730.311300:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760730.311330:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798216320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760730.311421:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760730.311730:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798216320 00000100:00100000:3.0:1789760730.311740:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798216320 00000100:00100000:3.0:1789760730.311813:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789760730.311824:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3464:x1876699798216320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789760730.311874:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789760730.311933:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3464:x1876699798216320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760730.311941:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789760730.311999:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798216320:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789760730.348830:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967504 is committed 00002000:00010000:3.0:1789760730.350507:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:3.0:1789760730.350518:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 104459 -> 106507 00010000:00010000:3.0:1789760730.350538:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.350582:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.350592:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.350601:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760730.350607:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.350618:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.350642:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.350650:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858069 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760730.351725:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777204096:12345-192.168.203.38@tcp:4:dd.500 Request processed in 75680us (165295us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789760730.351741:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:3.0:1789760730.351752:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406459224977 time 406460206242 state 0x2 ref 0 00000100:00100000:1.0:1789760730.358006:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760730.358044:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777204224 00000100:00100000:1.0:1789760730.358054:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777204224 00000100:00100000:1.0:1789760730.358106:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406459224977 time 406460206242 state 0x0 ref 1 00000100:00100000:1.0:1789760730.358119:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406660206242 time 406460206242 state 0x1 ref 1 00000001:00080000:2.0:1789760730.363779:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:3.0:1789760730.477483:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406660206242 time 406661676242 state 0x0 ref 1 00000100:00100000:3.0:1789760730.477553:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777204224:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760730.477632:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 54525952, mtime: 0x6aad94d9, atime: 0x6aad94cf, ctime: 0x6aad94d9, blocks: 0x1a00b 00010000:00010000:3.0:1789760730.477644:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.477665:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789760730.477671:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760730.477679:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.477697:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760730.532759:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967505 is committed 00002000:00010000:1.0:1789760730.532872:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:1.0:1789760730.532878:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 106507 -> 108555 00010000:00010000:1.0:1789760730.532896:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760730.532928:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760730.532938:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760730.532947:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760730.532952:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760730.532962:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760730.532985:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760730.532993:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858070 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760730.533115:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777204224:12345-192.168.203.38@tcp:4:dd.500 Request processed in 55575us (175319us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789760730.533127:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:1.0:1789760730.533137:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406660206242 time 406661676242 state 0x2 ref 0 00000100:00100000:1.0:1789760730.538903:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760730.539094:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777204352 00000100:00100000:0.0:1789760730.539106:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777204352 00000100:00100000:0.0:1789760730.539177:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406660206242 time 406661676242 state 0x0 ref 1 00000100:00100000:0.0:1789760730.539209:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406861676242 time 406661676242 state 0x1 ref 1 00010000:00010000:3.0:1789760730.631113:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760730.678057:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406861676242 time 406862250922 state 0x0 ref 1 00000100:00100000:2.0:1789760730.678122:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204352:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760730.678215:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 55574528, mtime: 0x6aad94d9, atime: 0x6aad94cf, ctime: 0x6aad94d9, blocks: 0x1a80b 00010000:00010000:2.0:1789760730.678227:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760730.678247:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:2.0:1789760730.678253:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760730.678261:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760730.678277:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760730.748047:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967506 is committed 00002000:00010000:3.0:1789760730.748263:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:3.0:1789760730.748276:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760729 -> 1789760730 00002000:00010000:3.0:1789760730.748279:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760729 -> 1789760730 00002000:00010000:3.0:1789760730.748282:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 108555 -> 110603 00010000:00010000:3.0:1789760730.748300:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.748315:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.748326:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.748351:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760730.748356:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.748368:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.748394:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.748402:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858077 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760730.748541:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204352:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70431us (209648us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789760730.748554:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:3.0:1789760730.748564:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406861676242 time 406862250922 state 0x2 ref 0 00000100:00100000:1.0:1789760730.757243:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760730.758570:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777204480 00000100:00100000:3.0:1789760730.758586:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777204480 00000100:00100000:3.0:1789760730.758666:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 406861676242 time 406862250922 state 0x0 ref 1 00000100:00100000:3.0:1789760730.758682:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407062250922 time 406862250922 state 0x1 ref 1 00000100:00100000:3.0:1789760730.823293:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798216448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760730.823392:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760730.823776:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798216448 00000100:00100000:0.0:1789760730.823853:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798216448 00000100:00100000:0.0:1789760730.823919:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789760730.823932:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798216448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760730.823983:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760730.824132:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798216448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760730.824141:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789760730.824347:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798216448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760730.878377:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407062250922 time 407062569536 state 0x0 ref 1 00000100:00100000:0.0:1789760730.878426:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204480:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760730.878696:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 56623104, mtime: 0x6aad94da, atime: 0x6aad94cf, ctime: 0x6aad94da, blocks: 0x1b00b 00010000:00010000:0.0:1789760730.878709:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760730.878731:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1789760730.878736:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760730.878744:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760730.878766:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760730.940064:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967507 is committed 00002000:00010000:3.0:1789760730.940238:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:3.0:1789760730.940244:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 110603 -> 112651 00010000:00010000:3.0:1789760730.940259:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.940272:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.940280:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.940286:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760730.940290:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.940299:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.940319:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760730.940327:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985807e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760730.940431:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204480:12345-192.168.203.38@tcp:4:dd.500 Request processed in 62025us (183197us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789760730.940443:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:3.0:1789760730.940465:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407062250922 time 407062569536 state 0x2 ref 0 00000100:00100000:1.0:1789760730.946927:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760730.947287:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777204608 00000100:00100000:3.0:1789760730.947297:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777204608 00000100:00100000:3.0:1789760730.947349:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407062250922 time 407062569536 state 0x0 ref 1 00000100:00100000:3.0:1789760730.947361:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407262569536 time 407062569536 state 0x1 ref 1 00000100:00100000:0.0:1789760731.078509:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407262569536 time 407262709837 state 0x0 ref 1 00000100:00100000:0.0:1789760731.078541:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777204608:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760731.078596:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 57671680, mtime: 0x6aad94da, atime: 0x6aad94cf, ctime: 0x6aad94da, blocks: 0x1b80b 00010000:00010000:0.0:1789760731.078605:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.078621:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1789760731.078625:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760731.078631:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.078645:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760731.168858:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:2.0:1789760731.168873:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 112651 -> 114699 00010000:00010000:2.0:1789760731.168893:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.168909:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.168956:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.168966:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760731.168973:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.169017:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.169063:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.169072:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a739858085 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760731.169412:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777204608:12345-192.168.203.38@tcp:4:dd.500 Request processed in 90878us (222489us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789760731.169461:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:2.0:1789760731.169472:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407262569536 time 407262709837 state 0x2 ref 0 00000001:00080000:3.0:1789760731.169708:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967508 is committed 00000100:00100000:1.0:1789760731.176301:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760731.176557:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777204736 00000100:00100000:0.0:1789760731.176570:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777204736 00000100:00100000:0.0:1789760731.176643:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407262569536 time 407262709837 state 0x0 ref 1 00000100:00100000:0.0:1789760731.176657:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407462709837 time 407262709837 state 0x1 ref 1 00000100:00100000:3.0:1789760731.282810:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407462709837 time 407466986594 state 0x0 ref 1 00000100:00100000:2.0:1789760731.283015:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204736:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760731.283160:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 58720256, mtime: 0x6aad94da, atime: 0x6aad94cf, ctime: 0x6aad94da, blocks: 0x1c00b 00010000:00010000:2.0:1789760731.283173:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.283201:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1789760731.283206:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760731.283214:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.283231:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760731.337017:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798216576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760731.337116:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.337275:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798216576 00000100:00100000:2.0:1789760731.337285:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798216576 00000100:00100000:2.0:1789760731.337351:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789760731.337362:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798216576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760731.337393:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 170196992 pending 1703936 free 3808428032 avail 3798990848 00000100:00100000:3.0:1789760731.337918:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798216704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760731.337958:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.338167:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798216576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.338185:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789760731.338210:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798216704 00000100:00100000:2.0:1789760731.338216:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798216704 00000100:00100000:2.0:1789760731.338240:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789760731.338253:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798216704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760731.338739:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 170196992 pending 1703936 free 3808428032 avail 3798990848 00000100:00100000:2.0:1789760731.338827:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798216704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 578us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.338833:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1789760731.338857:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760731.338905:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798216576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760731.339348:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798216704:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789760731.356055:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967509 is committed 00002000:00010000:2.0:1789760731.356282:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:2.0:1789760731.356288:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 114699 -> 116747 00010000:00010000:2.0:1789760731.356304:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.356343:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.356352:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.356361:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760731.356366:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.356377:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.356401:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.356411:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a73985808c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760731.356534:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204736:12345-192.168.203.38@tcp:4:dd.500 Request processed in 73695us (180239us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789760731.360216:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:2.0:1789760731.360229:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407462709837 time 407466986594 state 0x2 ref 0 00000100:00100000:1.0:1789760731.362151:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760731.362250:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777204864 00000100:00100000:3.0:1789760731.362264:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777204864 00000100:00100000:3.0:1789760731.362331:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407462709837 time 407466986594 state 0x0 ref 1 00000100:00100000:3.0:1789760731.362346:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407666986594 time 407466986594 state 0x1 ref 1 00000100:00100000:1.0:1789760731.487301:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407666986594 time 407671495663 state 0x0 ref 1 00000100:00100000:1.0:1789760731.487349:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204864:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760731.488918:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 59768832, mtime: 0x6aad94da, atime: 0x6aad94cf, ctime: 0x6aad94da, blocks: 0x1c80b 00010000:00010000:1.0:1789760731.488938:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.488960:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1789760731.488965:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760731.489042:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.489063:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760731.545077:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967510 is committed 00002000:00010000:0.0:1789760731.545140:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:0.0:1789760731.545146:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 116747 -> 118795 00010000:00010000:0.0:1789760731.545164:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.545196:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.545208:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.545218:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760731.545231:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.545242:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.545267:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.545296:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffd215b9/0xc2b9a3a739858093 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.545458:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204864:12345-192.168.203.38@tcp:4:dd.500 Request processed in 58127us (183313us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1789760731.545472:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:0.0:1789760731.545488:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407666986594 time 407671495663 state 0x2 ref 0 00000100:00100000:1.0:1789760731.551047:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760731.551136:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777204992 00000100:00100000:3.0:1789760731.551149:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777204992 00000100:00100000:3.0:1789760731.551229:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407666986594 time 407671495663 state 0x0 ref 1 00000100:00100000:3.0:1789760731.551245:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407871495663 time 407671495663 state 0x1 ref 1 00010000:00010000:1.0:1789760731.655031:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760731.688465:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407871495663 time 407872660286 state 0x0 ref 1 00000100:00100000:1.0:1789760731.688511:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204992:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760731.688608:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 60817408, mtime: 0x6aad94da, atime: 0x6aad94cf, ctime: 0x6aad94da, blocks: 0x1d00b 00010000:00010000:1.0:1789760731.688619:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.688637:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1789760731.688642:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760731.688650:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.688666:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760731.774641:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967511 is committed 00002000:00010000:1.0:1789760731.774775:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:1.0:1789760731.774781:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760730 -> 1789760731 00002000:00010000:1.0:1789760731.774784:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760730 -> 1789760731 00002000:00010000:1.0:1789760731.774820:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 118795 -> 120843 00010000:00010000:1.0:1789760731.774846:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.774861:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.774871:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.774880:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760731.774893:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.774905:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.774930:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.774940:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985809a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.775059:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777204992:12345-192.168.203.38@tcp:4:dd.500 Request processed in 86562us (224017us total) trans 4294967511 rc 0/0 00000100:00100000:1.0:1789760731.775070:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:1.0:1789760731.775080:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407871495663 time 407872660286 state 0x2 ref 0 00000100:00100000:3.0:1789760731.780850:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760731.781235:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777205120 00000100:00100000:2.0:1789760731.781250:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777205120 00000100:00100000:2.0:1789760731.781322:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 407871495663 time 407872660286 state 0x0 ref 1 00000100:00100000:2.0:1789760731.781339:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408072660286 time 407872660286 state 0x1 ref 1 00000100:00100000:0.0:1789760731.889939:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408072660286 time 408074135373 state 0x0 ref 1 00000100:00100000:0.0:1789760731.889982:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777205120:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760731.890054:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 61865984, mtime: 0x6aad94db, atime: 0x6aad94cf, ctime: 0x6aad94db, blocks: 0x1d80b 00010000:00010000:0.0:1789760731.890066:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.890087:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1789760731.890092:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760731.890100:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.890121:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760731.937516:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:0.0:1789760731.937530:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 120843 -> 122891 00010000:00010000:0.0:1789760731.937569:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.937584:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.937594:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.937604:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760731.937610:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.937620:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.937647:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.937655:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.937839:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777205120:12345-192.168.203.38@tcp:4:dd.500 Request processed in 47821us (156953us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1789760731.937852:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:0.0:1789760731.937862:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408072660286 time 408074135373 state 0x2 ref 0 00000001:00080000:2.0:1789760731.938018:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967512 is committed 00000100:00100000:1.0:1789760731.945420:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760731.945560:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777205248 00000100:00100000:2.0:1789760731.945573:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777205248 00000100:00100000:2.0:1789760731.945645:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408072660286 time 408074135373 state 0x0 ref 1 00000100:00100000:2.0:1789760731.945661:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408274135373 time 408074135373 state 0x1 ref 1 00000100:00100000:1.0:1789760732.091265:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408274135373 time 408275459947 state 0x0 ref 1 00000100:00100000:1.0:1789760732.091382:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777205248:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760732.091465:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 62914560, mtime: 0x6aad94db, atime: 0x6aad94cf, ctime: 0x6aad94db, blocks: 0x1e00b 00010000:00010000:1.0:1789760732.091477:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760732.091498:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1789760732.091503:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760732.091529:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760732.091547:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760732.092386:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760732.136733:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967513 is committed 00002000:00010000:0.0:1789760732.136974:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:0.0:1789760732.136996:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 122891 -> 124939 00010000:00010000:0.0:1789760732.137016:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.137038:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.137047:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.137054:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760732.137061:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.137070:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.137097:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.137105:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcba4811/0xc2b9a3a7398580a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760732.137243:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777205248:12345-192.168.203.38@tcp:4:dd.500 Request processed in 45947us (191833us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789760732.137254:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:0.0:1789760732.137264:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408274135373 time 408275459947 state 0x2 ref 0 00000100:00100000:1.0:1789760732.149575:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760732.149998:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777205376 00000100:00100000:0.0:1789760732.150013:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777205376 00000100:00100000:0.0:1789760732.150089:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408274135373 time 408275459947 state 0x0 ref 1 00000100:00100000:0.0:1789760732.150105:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408475459947 time 408275459947 state 0x1 ref 1 00000100:00100000:0.0:1789760732.291500:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408475459947 time 408475695504 state 0x0 ref 1 00000100:00100000:0.0:1789760732.291548:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777205376:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760732.291628:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 63963136, mtime: 0x6aad94db, atime: 0x6aad94cf, ctime: 0x6aad94db, blocks: 0x1e80b 00010000:00010000:0.0:1789760732.291643:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.291664:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1789760732.291670:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760732.291686:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.291705:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760732.400464:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967514 is committed 00002000:00010000:0.0:1789760732.400894:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:0.0:1789760732.400901:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 124939 -> 126987 00010000:00010000:0.0:1789760732.400921:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.400935:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.401028:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.401038:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760732.401044:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.401055:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.401080:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.401089:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398580af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760732.401231:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777205376:12345-192.168.203.38@tcp:4:dd.500 Request processed in 109702us (251663us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789760732.401243:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:0.0:1789760732.401253:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408475459947 time 408475695504 state 0x2 ref 0 00000100:00100000:1.0:1789760732.418703:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760732.418863:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777205504 00000100:00100000:2.0:1789760732.418876:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777205504 00000100:00100000:2.0:1789760732.418946:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408475459947 time 408475695504 state 0x0 ref 1 00000100:00100000:2.0:1789760732.418962:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408675695504 time 408475695504 state 0x1 ref 1 00000100:00100000:3.0:1789760732.495329:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408675695504 time 408679524745 state 0x0 ref 1 00000100:00100000:3.0:1789760732.495399:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777205504:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760732.495483:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 65011712, mtime: 0x6aad94db, atime: 0x6aad94cf, ctime: 0x6aad94db, blocks: 0x1f00b 00010000:00010000:3.0:1789760732.495495:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.495515:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1789760732.495521:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.495529:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.495545:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760732.593366:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:3.0:1789760732.593375:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 126987 -> 129035 00010000:00010000:3.0:1789760732.593390:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.593402:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.593411:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.593418:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760732.593423:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.593448:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.593469:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.593477:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.593596:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777205504:12345-192.168.203.38@tcp:4:dd.500 Request processed in 98213us (174903us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789760732.593608:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:3.0:1789760732.593617:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408675695504 time 408679524745 state 0x2 ref 0 00000001:00080000:1.0:1789760732.593846:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967515 is committed 00000100:00100000:1.0:1789760732.599723:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760732.599826:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777205632 00000100:00100000:0.0:1789760732.599837:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777205632 00000100:00100000:0.0:1789760732.599900:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408675695504 time 408679524745 state 0x0 ref 1 00000100:00100000:0.0:1789760732.599913:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408879524745 time 408679524745 state 0x1 ref 1 00010000:00010000:1.0:1789760732.679938:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760732.696144:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408879524745 time 408880337215 state 0x0 ref 1 00000100:00100000:3.0:1789760732.696191:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777205632:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760732.696268:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 66060288, mtime: 0x6aad94db, atime: 0x6aad94cf, ctime: 0x6aad94db, blocks: 0x1f80b 00010000:00010000:3.0:1789760732.696278:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.696295:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1789760732.696299:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760732.696306:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.696338:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760732.721176:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760732.721244:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760732.721272:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760732.721302:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760732.721326:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760732.721345:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760732.721390:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760732.721428:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777205888 00000100:00100000:1.0:1789760732.721440:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777205888 00000100:00100000:1.0:1789760732.721520:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777206400 00000100:00100000:1.0:1789760732.721524:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777206400 00000100:00100000:1.0:1789760732.721543:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777206016 00000100:00100000:1.0:1789760732.721545:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777206016 00000100:00100000:1.0:1789760732.721558:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777206528 00000100:00100000:1.0:1789760732.721561:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777206528 00000100:00100000:1.0:1789760732.721579:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 398 00000100:00100000:1.0:1789760732.721590:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2404:x1876699777205888:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760732.722080:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2404:x1876699777205888:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 490us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760732.722090:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 398 00000100:00100000:1.0:1789760732.722384:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 399 00000100:00100000:1.0:1789760732.722393:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777206400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760732.722469:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777206400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760732.722476:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 399 00000100:00100000:0.0:1789760732.722568:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 400 00000100:00100000:0.0:1789760732.722589:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777206016:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760732.722665:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777206016:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 84us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760732.722673:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 400 00000100:00100000:0.0:1789760732.722699:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 401 00000100:00100000:0.0:1789760732.722706:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777206528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760732.722732:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777206528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760732.722740:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 401 00000100:00080000:1.0:1789760732.722835:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760732.722842:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760732.722867:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777206144 00000100:00100000:0.0:1789760732.722876:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777206144 00000100:00100000:0.0:1789760732.722929:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777206272 00000100:00100000:0.0:1789760732.722934:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777206272 00000100:00100000:0.0:1789760732.722972:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:0.0:1789760732.722982:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777206144:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760732.723015:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777206144:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760732.723022:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:0.0:1789760732.723036:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:0.0:1789760732.723042:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777206272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760732.723065:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777206272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760732.723071:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:0.0:1789760732.723102:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777205760 00000100:00100000:0.0:1789760732.723106:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777205760 00000100:00100000:0.0:1789760732.723130:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 374 00000100:00100000:0.0:1789760732.723137:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777205760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760732.723175:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777205760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760732.723182:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 374 00000100:00080000:0.0:1789760732.723234:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789760732.799141:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967516 is committed 00002000:00010000:3.0:1789760732.799744:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:3.0:1789760732.799754:0:8120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760731 -> 1789760732 00002000:00010000:3.0:1789760732.799757:0:8120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760731 -> 1789760732 00002000:00010000:3.0:1789760732.799759:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 129035 -> 131083 00010000:00010000:3.0:1789760732.799781:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.799831:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.799842:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.799853:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760732.799861:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.799872:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.799900:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760732.799941:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760732.800109:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777205632:12345-192.168.203.38@tcp:4:dd.500 Request processed in 103928us (200377us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789760732.800123:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:3.0:1789760732.800136:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408879524745 time 408880337215 state 0x2 ref 0 00000100:00100000:1.0:1789760732.811661:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760732.811759:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777206656 00000100:00100000:0.0:1789760732.811773:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777206656 00000100:00100000:0.0:1789760732.811872:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 408879524745 time 408880337215 state 0x0 ref 1 00000100:00100000:0.0:1789760732.811885:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409080337215 time 408880337215 state 0x1 ref 1 00000100:00100000:0.0:1789760732.896261:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409080337215 time 409080461144 state 0x0 ref 1 00000100:00100000:0.0:1789760732.896306:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777206656:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760732.896364:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 67108864, mtime: 0x6aad94dc, atime: 0x6aad94cf, ctime: 0x6aad94dc, blocks: 0x2000b 00010000:00010000:0.0:1789760732.896374:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.896392:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1789760732.896396:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760732.896403:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.896420:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760732.960712:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:0.0:1789760732.960723:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 131083 -> 133131 00010000:00010000:0.0:1789760732.960738:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.960751:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.960760:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.960767:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760732.960771:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.960780:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.960994:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760732.961003:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760732.961159:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967517 is committed 00000100:00100000:0.0:1789760732.961226:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777206656:12345-192.168.203.38@tcp:4:dd.500 Request processed in 64931us (149585us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789760732.961251:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:0.0:1789760732.961260:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409080337215 time 409080461144 state 0x2 ref 0 00000100:00100000:0.0:1789760732.969499:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760732.969577:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777206784 00000100:00100000:2.0:1789760732.969588:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777206784 00000100:00100000:2.0:1789760732.969651:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409080337215 time 409080461144 state 0x0 ref 1 00000100:00100000:2.0:1789760732.969664:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409280461144 time 409080461144 state 0x1 ref 1 00000100:00100000:0.0:1789760733.096808:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409280461144 time 409280987088 state 0x0 ref 1 00000100:00100000:0.0:1789760733.096842:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777206784:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760733.096900:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 68157440, mtime: 0x6aad94dc, atime: 0x6aad94cf, ctime: 0x6aad94dc, blocks: 0x2080b 00010000:00010000:0.0:1789760733.096910:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760733.096926:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1789760733.096931:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760733.096937:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760733.096952:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760733.172743:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:2.0:1789760733.172753:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 133131 -> 135179 00010000:00010000:2.0:1789760733.172768:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.172781:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.172843:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.172851:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760733.172856:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.172865:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.172883:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.172891:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398580cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760733.173205:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777206784:12345-192.168.203.38@tcp:4:dd.500 Request processed in 76374us (203713us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789760733.173216:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:2.0:1789760733.173662:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409280461144 time 409280987088 state 0x2 ref 0 00000001:00080000:2.0:1789760733.174075:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967518 is committed 00000100:00100000:0.0:1789760733.181001:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760733.181210:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777206912 00000100:00100000:3.0:1789760733.181220:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777206912 00000100:00100000:3.0:1789760733.181390:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409280461144 time 409280987088 state 0x0 ref 1 00000100:00100000:3.0:1789760733.181404:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409480987088 time 409280987088 state 0x1 ref 1 00000100:00100000:0.0:1789760733.297663:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409480987088 time 409481862162 state 0x0 ref 1 00000100:00100000:0.0:1789760733.297697:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777206912:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760733.298463:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 69206016, mtime: 0x6aad94dc, atime: 0x6aad94cf, ctime: 0x6aad94dc, blocks: 0x2100b 00010000:00010000:0.0:1789760733.298475:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760733.298505:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1789760733.298510:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760733.298517:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760733.298533:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760733.371132:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967519 is committed 00002000:00010000:3.0:1789760733.373422:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:3.0:1789760733.373430:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 135179 -> 137229 00010000:00010000:3.0:1789760733.373445:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.373457:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.373466:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.373474:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760733.373497:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.373506:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.373529:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.373536:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a7398580d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760733.373826:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777206912:12345-192.168.203.38@tcp:4:dd.500 Request processed in 76107us (192798us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789760733.373838:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:3.0:1789760733.373846:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409480987088 time 409481862162 state 0x2 ref 0 00000100:00100000:0.0:1789760733.384537:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760733.384830:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777207040 00000100:00100000:3.0:1789760733.384840:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777207040 00000100:00100000:3.0:1789760733.384894:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409480987088 time 409481862162 state 0x0 ref 1 00000100:00100000:3.0:1789760733.384907:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409681862162 time 409481862162 state 0x1 ref 1 00000100:00100000:3.0:1789760733.497774:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409681862162 time 409681974122 state 0x0 ref 1 00000100:00100000:3.0:1789760733.497862:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777207040:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760733.497920:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 70254592, mtime: 0x6aad94dc, atime: 0x6aad94cf, ctime: 0x6aad94dc, blocks: 0x2180d 00010000:00010000:3.0:1789760733.497930:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.497960:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1789760733.497964:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760733.497970:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.497984:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760733.558076:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967520 is committed 00002000:00010000:2.0:1789760733.560449:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:2.0:1789760733.560459:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 137229 -> 139277 00010000:00010000:2.0:1789760733.560489:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.560503:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.560512:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.560520:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760733.560525:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.560534:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.560553:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.560561:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000737325dc/0xc2b9a3a7398580d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760733.560678:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777207040:12345-192.168.203.38@tcp:4:dd.500 Request processed in 62832us (176146us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789760733.560688:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:2.0:1789760733.560696:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409681862162 time 409681974122 state 0x2 ref 0 00000100:00100000:2.0:1789760733.569032:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760733.569184:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777207168 00000100:00100000:0.0:1789760733.569195:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777207168 00000100:00100000:0.0:1789760733.569249:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409681862162 time 409681974122 state 0x0 ref 1 00000100:00100000:0.0:1789760733.569262:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409881974122 time 409681974122 state 0x1 ref 1 00000100:00100000:1.0:1789760733.697992:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409881974122 time 409882189613 state 0x0 ref 1 00000100:00100000:1.0:1789760733.698027:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777207168:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760733.698086:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 71303168, mtime: 0x6aad94dc, atime: 0x6aad94cf, ctime: 0x6aad94dc, blocks: 0x2200d 00010000:00010000:1.0:1789760733.698096:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.698112:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1789760733.698117:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760733.698124:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.698139:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760733.705410:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760733.742879:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967521 is committed 00002000:00010000:1.0:1789760733.742960:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:1.0:1789760733.742965:0:13393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760732 -> 1789760733 00002000:00010000:1.0:1789760733.742968:0:13393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760732 -> 1789760733 00002000:00010000:1.0:1789760733.742971:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 139277 -> 141325 00010000:00010000:1.0:1789760733.742984:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.742997:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.743008:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.743015:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760733.743020:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.743029:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.743048:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.743056:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a7398580e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760733.743254:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777207168:12345-192.168.203.38@tcp:4:dd.500 Request processed in 45240us (174228us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789760733.743264:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:1.0:1789760733.743272:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409881974122 time 409882189613 state 0x2 ref 0 00000100:00100000:2.0:1789760733.753322:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760733.753423:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777207296 00000100:00100000:0.0:1789760733.753431:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777207296 00000100:00100000:0.0:1789760733.753482:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 409881974122 time 409882189613 state 0x0 ref 1 00000100:00100000:0.0:1789760733.753495:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410082189613 time 409882189613 state 0x1 ref 1 00000100:00100000:2.0:1789760733.898154:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410082189613 time 410082354327 state 0x0 ref 1 00000100:00100000:2.0:1789760733.898198:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777207296:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760733.898255:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 72351744, mtime: 0x6aad94dd, atime: 0x6aad94cf, ctime: 0x6aad94dd, blocks: 0x2280d 00010000:00010000:2.0:1789760733.898264:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.898279:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1789760733.898283:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760733.898289:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760733.898306:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760733.958098:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967522 is committed 00002000:00010000:1.0:1789760733.958269:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:1.0:1789760733.958274:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 141325 -> 143373 00010000:00010000:1.0:1789760733.958289:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.958301:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.958310:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.958318:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760733.958322:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.958331:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.958350:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760733.958375:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76488b2/0xc2b9a3a7398580e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760733.958480:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777207296:12345-192.168.203.38@tcp:4:dd.500 Request processed in 60294us (205164us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789760733.958491:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:1.0:1789760733.958499:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410082189613 time 410082354327 state 0x2 ref 0 00000100:00100000:0.0:1789760733.964608:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760733.964940:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777207424 00000100:00100000:3.0:1789760733.964949:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777207424 00000100:00100000:3.0:1789760733.964998:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410082189613 time 410082354327 state 0x0 ref 1 00000100:00100000:3.0:1789760733.965010:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410282354327 time 410082354327 state 0x1 ref 1 00000100:00100000:0.0:1789760734.098296:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410282354327 time 410282495204 state 0x0 ref 1 00000100:00100000:0.0:1789760734.098352:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777207424:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760734.098409:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 73400320, mtime: 0x6aad94dd, atime: 0x6aad94cf, ctime: 0x6aad94dd, blocks: 0x2300d 00010000:00010000:0.0:1789760734.098418:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760734.098447:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1789760734.098451:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760734.098457:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760734.098473:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760734.098699:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760734.210055:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967523 is committed 00002000:00010000:1.0:1789760734.210405:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:1.0:1789760734.210410:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 143373 -> 145421 00010000:00010000:1.0:1789760734.210424:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760734.210437:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760734.210447:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760734.210454:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760734.210471:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760734.210482:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760734.210522:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760734.210540:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d0b0179/0xc2b9a3a7398580ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760734.210650:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777207424:12345-192.168.203.38@tcp:4:dd.500 Request processed in 112331us (246047us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789760734.210661:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:1.0:1789760734.210670:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410282354327 time 410282495204 state 0x2 ref 0 00000100:00100000:0.0:1789760734.222692:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760734.222840:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777207552 00000100:00100000:2.0:1789760734.222851:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777207552 00000100:00100000:2.0:1789760734.222905:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410282354327 time 410282495204 state 0x0 ref 1 00000100:00100000:2.0:1789760734.222917:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410482495204 time 410282495204 state 0x1 ref 1 00000100:00100000:2.0:1789760734.298421:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410482495204 time 410482620726 state 0x0 ref 1 00000100:00100000:2.0:1789760734.298456:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777207552:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760734.298518:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 74448896, mtime: 0x6aad94dd, atime: 0x6aad94cf, ctime: 0x6aad94dd, blocks: 0x2380d 00010000:00010000:2.0:1789760734.298527:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760734.300498:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1789760734.300504:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760734.300513:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760734.300531:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760734.340209:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967524 is committed 00002000:00010000:3.0:1789760734.340309:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:3.0:1789760734.340314:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 145421 -> 147469 00010000:00010000:3.0:1789760734.340399:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.340413:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.340423:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.340447:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760734.340452:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.340461:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.340481:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.340489:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398580f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.340584:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777207552:12345-192.168.203.38@tcp:4:dd.500 Request processed in 42141us (117898us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789760734.340595:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:3.0:1789760734.340603:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410482495204 time 410482620726 state 0x2 ref 0 00000100:00100000:1.0:1789760734.346722:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760734.346865:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777207680 00000100:00100000:2.0:1789760734.346875:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777207680 00000100:00100000:2.0:1789760734.346928:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410482495204 time 410482620726 state 0x0 ref 1 00000100:00100000:2.0:1789760734.346941:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410682620726 time 410482620726 state 0x1 ref 1 00000100:00100000:3.0:1789760734.502089:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410682620726 time 410686288530 state 0x0 ref 1 00000100:00100000:3.0:1789760734.502126:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777207680:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760734.502197:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 75497472, mtime: 0x6aad94dd, atime: 0x6aad94cf, ctime: 0x6aad94dd, blocks: 0x2400d 00010000:00010000:3.0:1789760734.502207:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.502241:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:3.0:1789760734.502246:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.502253:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.502269:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760734.564634:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967525 is committed 00002000:00010000:3.0:1789760734.564977:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:3.0:1789760734.564983:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 147469 -> 149517 00010000:00010000:3.0:1789760734.564997:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.565012:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.565022:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.565029:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760734.565034:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.565043:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.565083:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.565091:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398580fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.565239:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777207680:12345-192.168.203.38@tcp:4:dd.500 Request processed in 63127us (218522us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789760734.565257:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:3.0:1789760734.565265:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410682620726 time 410686288530 state 0x2 ref 0 00000100:00100000:0.0:1789760734.578374:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760734.580751:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777207808 00000100:00100000:1.0:1789760734.580767:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777207808 00000100:00100000:1.0:1789760734.580850:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410682620726 time 410686288530 state 0x0 ref 1 00000100:00100000:1.0:1789760734.580865:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410886288530 time 410686288530 state 0x1 ref 1 00000100:00100000:3.0:1789760734.704264:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410886288530 time 410888462487 state 0x0 ref 1 00000100:00100000:3.0:1789760734.704296:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777207808:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760734.704356:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 76546048, mtime: 0x6aad94dd, atime: 0x6aad94cf, ctime: 0x6aad94dd, blocks: 0x2480d 00010000:00010000:3.0:1789760734.704366:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.704382:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:3.0:1789760734.704387:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760734.704393:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.704408:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760734.728201:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760734.756553:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967526 is committed 00002000:00010000:3.0:1789760734.756663:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:3.0:1789760734.756668:0:13392:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760733 -> 1789760734 00002000:00010000:3.0:1789760734.756671:0:13392:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760733 -> 1789760734 00002000:00010000:3.0:1789760734.756673:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 149517 -> 151565 00010000:00010000:3.0:1789760734.756688:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.756701:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.756711:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.756719:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760734.756724:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.756732:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.756752:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760734.756760:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858103 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760734.757054:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777207808:12345-192.168.203.38@tcp:4:dd.500 Request processed in 52768us (178685us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789760734.757066:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:3.0:1789760734.757074:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410886288530 time 410888462487 state 0x2 ref 0 00000100:00100000:0.0:1789760734.762528:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760734.762747:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777207936 00000100:00100000:2.0:1789760734.762757:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777207936 00000100:00100000:2.0:1789760734.762974:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 410886288530 time 410888462487 state 0x0 ref 1 00000100:00100000:2.0:1789760734.762987:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411088462487 time 410888462487 state 0x1 ref 1 00000100:00100000:0.0:1789760734.904520:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411088462487 time 411088719958 state 0x0 ref 1 00000100:00100000:0.0:1789760734.904570:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777207936:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760734.904653:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 77594624, mtime: 0x6aad94de, atime: 0x6aad94cf, ctime: 0x6aad94de, blocks: 0x2500d 00010000:00010000:0.0:1789760734.904663:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760734.904680:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1789760734.904685:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760734.904691:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760734.904912:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760734.919033:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798217088:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.919050:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f90a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798216832:0@lo:400:kworker.0 00000100:00100000:3.0:1789760734.920303:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f90ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798216960:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.924480:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760734.924614:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798217216:0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.924665:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760734.924687:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798217728:0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.924713:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760734.924732:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798218240:0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.924753:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760734.925195:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798217344:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.925228:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760734.925673:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798217856:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.925701:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760734.925742:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798218368:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.925766:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760734.926047:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798217216 00000100:00100000:0.0:1789760734.926056:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798217216 00000100:00100000:0.0:1789760734.926107:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789760734.926118:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798217216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.926183:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798217216:12345-0@lo:400:kworker.0 Request processed in 67us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760734.926190:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789760734.926213:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798217728 00000100:00100000:0.0:1789760734.926217:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798217728 00000100:00100000:2.0:1789760734.926773:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798217344 00000100:00100000:2.0:1789760734.926777:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798217344 00000100:00100000:0.0:1789760734.927779:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798218240 00000100:00100000:0.0:1789760734.927799:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798218240 00000100:00100000:0.0:1789760734.927834:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798217856 00000100:00100000:0.0:1789760734.927837:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798217856 00000100:00100000:0.0:1789760734.927851:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798218368 00000100:00100000:0.0:1789760734.927854:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798218368 00000100:00100000:0.0:1789760734.927869:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789760734.927887:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798217728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.927953:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798217728:12345-0@lo:400:kworker.0 Request processed in 67us (3239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760734.927975:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789760734.927992:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789760734.927998:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798218240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.928028:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798218240:12345-0@lo:400:kworker.0 Request processed in 31us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760734.928033:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789760734.928044:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789760734.928048:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798217856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.928076:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798217856:12345-0@lo:400:kworker.0 Request processed in 27us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760734.928081:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789760734.928090:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789760734.928094:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798218368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.928118:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798218368:12345-0@lo:400:kworker.0 Request processed in 24us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760734.928123:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1789760734.928162:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760734.928166:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760734.928211:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798217216:0@lo:400:kworker.0 00000100:00100000:0.0:1789760734.928224:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798217728:0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.928331:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760734.928365:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798217600:0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.928397:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760734.928416:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798218112:0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.928447:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760734.928470:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798218624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760734.928492:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760734.928523:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798216832 00000100:00100000:1.0:1789760734.928527:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798216832 00000100:00100000:1.0:1789760734.928556:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789760734.928562:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798216832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.928591:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798216832:12345-0@lo:400:kworker.0 Request processed in 29us (4118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760734.928597:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789760734.928622:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798217600 00000100:00100000:2.0:1789760734.928652:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798217088 00000100:00100000:2.0:1789760734.928656:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798217088 00000100:00100000:2.0:1789760734.928672:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789760734.928679:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798217344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.928717:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798217344:12345-0@lo:400:kworker.0 Request processed in 40us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760734.928723:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789760734.928735:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789760734.928740:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798217600 00000100:00100000:2.0:1789760734.928741:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798217088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.928767:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798218112 00000100:00100000:1.0:1789760734.928770:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798218112 00000100:00100000:2.0:1789760734.928771:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798217088:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760734.928776:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789760734.928802:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789760734.928809:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798217600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.928840:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798217600:12345-0@lo:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760734.928845:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789760734.928856:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789760734.928860:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798218112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.928885:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798218112:12345-0@lo:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760734.928892:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789760734.928919:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798218624 00000100:00100000:1.0:1789760734.928923:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798218624 00000100:00100000:1.0:1789760734.928950:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789760734.928967:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798218624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760734.929070:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760734.929102:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798218624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760734.929107:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789760734.929141:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798218624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760734.929162:0:3461:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967354 gen 2 00000004:00080000:1.0:1789760734.929167:0:3461:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967354 committed transno 4294967354 00000100:00100000:1.0:1789760734.929246:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798217088:0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.929263:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798217600:0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.929272:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798218112:0@lo:400:kworker.0 00000100:00080000:1.0:1789760734.929330:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760734.930381:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798218240:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.931222:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f90a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798216832:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.931246:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798217344:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.931266:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798217856:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.931277:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798218368:0@lo:400:kworker.0 00000100:00100000:2.0:1789760734.931295:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760734.931305:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798218496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760734.931356:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760734.931458:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760734.931497:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798217472:0@lo:400:kworker.0 00000100:00100000:3.0:1789760734.931524:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760734.931546:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798217984:0@lo:400:kworker.0 00000100:00100000:3.0:1789760734.931567:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760734.931603:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798216960 00000100:00100000:3.0:1789760734.931654:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798216960 00000100:00100000:3.0:1789760734.931696:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798217472 00000100:00100000:3.0:1789760734.931700:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798217472 00000100:00100000:0.0:1789760734.931782:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798218496 00000100:00100000:0.0:1789760734.931812:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798218496 00000100:00100000:0.0:1789760734.931846:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789760734.931868:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798218496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760734.931903:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760734.931947:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798218496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760734.931954:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789760734.932574:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798217984 00000100:00100000:3.0:1789760734.932581:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798217984 00000100:00100000:0.0:1789760734.932858:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798218496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760734.935530:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789760734.935639:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798216960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.935741:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798216960:12345-0@lo:400:kworker.0 Request processed in 199us (4283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760734.935748:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789760734.935771:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789760734.935779:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798217472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.935837:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798217472:12345-0@lo:400:kworker.0 Request processed in 59us (4312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760734.935844:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789760734.935855:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789760734.935863:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798217984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.935918:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798217984:12345-0@lo:400:kworker.0 Request processed in 56us (4349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760734.935925:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789760734.935973:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f90ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798216960:0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.935987:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798217472:0@lo:400:kworker.0 00000100:00100000:1.0:1789760734.935997:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798217984:0@lo:400:kworker.0 00000100:00080000:1.0:1789760734.936046:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789760735.006965:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967527 is committed 00002000:00010000:0.0:1789760735.007177:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:0.0:1789760735.007182:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 151565 -> 153613 00010000:00010000:0.0:1789760735.007196:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.007209:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.007218:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.007225:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760735.007230:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.007239:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.007258:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.007284:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a73985810a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760735.007426:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777207936:12345-192.168.203.38@tcp:4:dd.500 Request processed in 102882us (244902us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789760735.007436:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:0.0:1789760735.007445:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411088462487 time 411088719958 state 0x2 ref 0 00000100:00100000:2.0:1789760735.013333:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760735.013421:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777208064 00000100:00100000:3.0:1789760735.013431:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777208064 00000100:00100000:3.0:1789760735.013481:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411088462487 time 411088719958 state 0x0 ref 1 00000100:00100000:3.0:1789760735.013494:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411288719958 time 411088719958 state 0x1 ref 1 00000100:00100000:2.0:1789760735.104684:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411288719958 time 411288884984 state 0x0 ref 1 00000100:00100000:2.0:1789760735.104740:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777208064:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760735.108478:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 78643200, mtime: 0x6aad94de, atime: 0x6aad94cf, ctime: 0x6aad94de, blocks: 0x2580d 00010000:00010000:2.0:1789760735.108498:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.108515:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1789760735.108520:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760735.108527:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.108543:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760735.180748:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789760735.180758:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 153613 -> 155661 00010000:00010000:3.0:1789760735.180772:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.180934:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.180945:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.180952:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760735.180957:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.180966:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.180988:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.180995:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd33ea97/0xc2b9a3a739858111 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.181089:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777208064:12345-192.168.203.38@tcp:4:dd.500 Request processed in 76368us (167762us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789760735.181099:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:3.0:1789760735.181107:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411288719958 time 411288884984 state 0x2 ref 0 00000001:00080000:3.0:1789760735.181652:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967528 is committed 00000100:00100000:0.0:1789760735.191247:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760735.191386:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777208192 00000100:00100000:3.0:1789760735.191396:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777208192 00000100:00100000:3.0:1789760735.191451:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411288719958 time 411288884984 state 0x0 ref 1 00000100:00100000:3.0:1789760735.191463:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411488884984 time 411288884984 state 0x1 ref 1 00000100:00100000:0.0:1789760735.305054:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411488884984 time 411489254034 state 0x0 ref 1 00000100:00100000:0.0:1789760735.305087:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777208192:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760735.305157:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 79691776, mtime: 0x6aad94de, atime: 0x6aad94cf, ctime: 0x6aad94de, blocks: 0x2600d 00010000:00010000:0.0:1789760735.305167:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.305182:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1789760735.305186:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760735.305193:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.305206:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760735.387573:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:3.0:1789760735.387585:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 155661 -> 157709 00010000:00010000:3.0:1789760735.387601:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.387615:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.387625:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.387701:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760735.387706:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.387752:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.387774:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760735.387782:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e577096/0xc2b9a3a739858118 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760735.387959:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967529 is committed 00000100:00100000:3.0:1789760735.388218:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777208192:12345-192.168.203.38@tcp:4:dd.500 Request processed in 83141us (196975us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1789760735.388230:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:3.0:1789760735.388239:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411488884984 time 411489254034 state 0x2 ref 0 00000100:00100000:3.0:1789760735.395842:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760735.396041:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777208320 00000100:00100000:2.0:1789760735.396051:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777208320 00000100:00100000:2.0:1789760735.396102:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411488884984 time 411489254034 state 0x0 ref 1 00000100:00100000:2.0:1789760735.396116:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411689254034 time 411489254034 state 0x1 ref 1 00000100:00100000:0.0:1789760735.439036:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760735.439076:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798218752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760735.439161:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760735.439233:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798218752 00000100:00100000:0.0:1789760735.439241:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798218752 00000100:00100000:0.0:1789760735.439285:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789760735.439294:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798218752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760735.439330:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760735.439387:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798218752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760735.439395:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789760735.439449:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798218752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760735.506890:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411689254034 time 411691090869 state 0x0 ref 1 00000100:00100000:2.0:1789760735.506925:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777208320:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760735.506984:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 80740352, mtime: 0x6aad94de, atime: 0x6aad94cf, ctime: 0x6aad94de, blocks: 0x2680d 00010000:00010000:2.0:1789760735.506993:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.507027:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1789760735.507032:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760735.507038:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.507052:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760735.565931:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967530 is committed 00002000:00010000:2.0:1789760735.566173:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:2.0:1789760735.566178:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 157709 -> 159757 00010000:00010000:2.0:1789760735.566192:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.566204:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.566213:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.566220:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760735.566224:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.566232:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.566272:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760735.566281:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985811f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760735.566412:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777208320:12345-192.168.203.38@tcp:4:dd.500 Request processed in 59498us (170575us total) trans 4294967530 rc 0/0 00000100:00100000:2.0:1789760735.566422:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:2.0:1789760735.566430:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411689254034 time 411691090869 state 0x2 ref 0 00000100:00100000:3.0:1789760735.572242:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760735.572304:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777208448 00000100:00100000:0.0:1789760735.572313:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777208448 00000100:00100000:0.0:1789760735.572359:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411689254034 time 411691090869 state 0x0 ref 1 00000100:00100000:0.0:1789760735.572371:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411891090869 time 411691090869 state 0x1 ref 1 00000100:00100000:0.0:1789760735.707161:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411891090869 time 411891349427 state 0x0 ref 1 00000100:00100000:0.0:1789760735.707196:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777208448:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760735.707479:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 81788928, mtime: 0x6aad94de, atime: 0x6aad94cf, ctime: 0x6aad94de, blocks: 0x2700d 00010000:00010000:0.0:1789760735.707490:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.707506:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1789760735.707510:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760735.707532:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.707546:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760735.753631:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760735.799696:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967531 is committed 00002000:00010000:0.0:1789760735.799920:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:0.0:1789760735.799924:0:8119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760734 -> 1789760735 00002000:00010000:0.0:1789760735.799927:0:8119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760734 -> 1789760735 00002000:00010000:0.0:1789760735.799930:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 159757 -> 161805 00010000:00010000:0.0:1789760735.799944:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.799956:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.799966:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.799973:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760735.799978:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.799986:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.800006:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760735.800134:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ebf32d/0xc2b9a3a739858126 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760735.800281:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777208448:12345-192.168.203.38@tcp:4:dd.500 Request processed in 93097us (228042us total) trans 4294967531 rc 0/0 00000100:00100000:0.0:1789760735.800292:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:0.0:1789760735.800299:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411891090869 time 411891349427 state 0x2 ref 0 00000100:00100000:3.0:1789760735.809442:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760735.809987:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777208576 00000100:00100000:2.0:1789760735.810000:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777208576 00000100:00100000:2.0:1789760735.810086:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 411891090869 time 411891349427 state 0x0 ref 1 00000100:00100000:2.0:1789760735.810101:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412091349427 time 411891349427 state 0x1 ref 1 00000100:00100000:1.0:1789760735.912166:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412091349427 time 412096366852 state 0x0 ref 1 00000100:00100000:1.0:1789760735.912200:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777208576:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760735.912257:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 82837504, mtime: 0x6aad94df, atime: 0x6aad94cf, ctime: 0x6aad94df, blocks: 0x2780d 00010000:00010000:1.0:1789760735.912267:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760735.912283:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789760735.912288:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760735.912294:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760735.912312:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760735.943412:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760735.952839:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798218880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760735.952936:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760735.953208:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798218880 00000100:00100000:0.0:1789760735.953217:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798218880 00000100:00100000:0.0:1789760735.953272:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789760735.953282:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798218880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760735.953321:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760735.953369:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798218880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760735.953376:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789760735.953476:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798218880:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1789760736.030597:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967532 is committed 00002000:00010000:1.0:1789760736.030602:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:1.0:1789760736.030606:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 161805 -> 163853 00010000:00010000:1.0:1789760736.030641:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760736.030653:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760736.030661:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760736.030668:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760736.030673:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760736.030682:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760736.030703:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760736.030710:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a73985812d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760736.030855:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777208576:12345-192.168.203.38@tcp:4:dd.500 Request processed in 118666us (221418us total) trans 4294967532 rc 0/0 00000100:00100000:1.0:1789760736.030865:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:1.0:1789760736.030873:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412091349427 time 412096366852 state 0x2 ref 0 00000100:00100000:3.0:1789760736.039137:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760736.039246:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777208704 00000100:00100000:0.0:1789760736.039256:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777208704 00000100:00100000:0.0:1789760736.039330:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412091349427 time 412096366852 state 0x0 ref 1 00000100:00100000:0.0:1789760736.039343:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412296366852 time 412096366852 state 0x1 ref 1 00000100:00080000:1.0:1789760736.039429:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760736.112757:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412296366852 time 412296956599 state 0x0 ref 1 00000100:00100000:1.0:1789760736.112838:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777208704:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760736.112900:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 83886080, mtime: 0x6aad94df, atime: 0x6aad94cf, ctime: 0x6aad94df, blocks: 0x2800d 00010000:00010000:1.0:1789760736.112910:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760736.112925:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789760736.112939:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760736.112945:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760736.112960:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760736.182011:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967533 is committed 00002000:00010000:3.0:1789760736.182135:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:3.0:1789760736.182150:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 163853 -> 165901 00010000:00010000:3.0:1789760736.182233:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.182247:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.182256:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.182283:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760736.182288:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.182297:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.182316:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.182323:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b50dd0/0xc2b9a3a739858134 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760736.182460:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777208704:12345-192.168.203.38@tcp:4:dd.500 Request processed in 69678us (143329us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1789760736.182471:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:3.0:1789760736.182478:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412296366852 time 412296956599 state 0x2 ref 0 00000100:00100000:2.0:1789760736.190529:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760736.190652:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777208832 00000100:00100000:0.0:1789760736.190663:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777208832 00000100:00100000:0.0:1789760736.190720:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412296366852 time 412296956599 state 0x0 ref 1 00000100:00100000:0.0:1789760736.190751:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412496956599 time 412296956599 state 0x1 ref 1 00000100:00100000:2.0:1789760736.312921:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412496956599 time 412497121772 state 0x0 ref 1 00000100:00100000:2.0:1789760736.312953:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777208832:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760736.313012:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 84934656, mtime: 0x6aad94df, atime: 0x6aad94cf, ctime: 0x6aad94df, blocks: 0x2880d 00010000:00010000:2.0:1789760736.313022:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760736.313038:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789760736.313058:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760736.313065:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760736.313080:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760736.366460:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967534 is committed 00002000:00010000:3.0:1789760736.366561:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:3.0:1789760736.366566:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 165901 -> 167949 00010000:00010000:3.0:1789760736.366579:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.366592:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.366623:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.366630:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760736.366636:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.366644:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.366665:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.366672:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a73985813b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760736.366771:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777208832:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53828us (176247us total) trans 4294967534 rc 0/0 00000100:00100000:3.0:1789760736.366781:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:3.0:1789760736.366838:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412496956599 time 412497121772 state 0x2 ref 0 00000100:00100000:2.0:1789760736.375315:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760736.375412:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777208960 00000100:00100000:0.0:1789760736.375422:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777208960 00000100:00100000:0.0:1789760736.375476:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412496956599 time 412497121772 state 0x0 ref 1 00000100:00100000:0.0:1789760736.375489:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412697121772 time 412497121772 state 0x1 ref 1 00000100:00100000:3.0:1789760736.455900:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798219008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760736.455972:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760736.456752:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798219008 00000100:00100000:1.0:1789760736.456761:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798219008 00000100:00100000:1.0:1789760736.456859:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789760736.457025:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798219008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760736.457049:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211091456 pending 0 free 3776970752 avail 3771727872 00000100:00080000:0.0:1789760736.457094:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760736.457110:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798219008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760736.457246:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789760736.458339:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798219136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760736.458397:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760736.458740:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798219008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760736.459256:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798219136 00000100:00100000:1.0:1789760736.459264:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798219136 00000100:00080000:0.0:1789760736.459543:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760736.459578:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789760736.459589:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798219136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760736.459612:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211091456 pending 0 free 3776970752 avail 3771727872 00000100:00100000:1.0:1789760736.459675:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798219136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760736.459682:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789760736.459750:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798219136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760736.515222:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412697121772 time 412699421992 state 0x0 ref 1 00000100:00100000:3.0:1789760736.515255:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777208960:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760736.515316:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 85983232, mtime: 0x6aad94df, atime: 0x6aad94cf, ctime: 0x6aad94df, blocks: 0x2900d 00010000:00010000:3.0:1789760736.515337:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.515354:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:3.0:1789760736.515358:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760736.515365:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.515380:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760736.598478:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:3.0:1789760736.598487:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 167949 -> 169997 00010000:00010000:3.0:1789760736.598502:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.598514:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.598523:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.598544:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760736.598549:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.598559:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.598579:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.598587:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858142 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760736.600571:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777208960:12345-192.168.203.38@tcp:4:dd.500 Request processed in 85318us (225252us total) trans 4294967535 rc 0/0 00000100:00100000:3.0:1789760736.600586:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:3.0:1789760736.600595:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412697121772 time 412699421992 state 0x2 ref 0 00000001:00080000:2.0:1789760736.600945:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967535 is committed 00000100:00100000:3.0:1789760736.617401:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760736.618034:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777209088 00000100:00100000:1.0:1789760736.618045:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777209088 00000100:00100000:1.0:1789760736.618106:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412697121772 time 412699421992 state 0x0 ref 1 00000100:00100000:1.0:1789760736.618119:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412899421992 time 412699421992 state 0x1 ref 1 00000100:00100000:2.0:1789760736.715399:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412899421992 time 412899597872 state 0x0 ref 1 00000100:00100000:2.0:1789760736.715441:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777209088:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760736.715500:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 87031808, mtime: 0x6aad94df, atime: 0x6aad94cf, ctime: 0x6aad94df, blocks: 0x2980d 00010000:00010000:2.0:1789760736.715509:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760736.715526:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789760736.715531:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760736.715537:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760736.715551:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760736.758620:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:3.0:1789760736.758631:0:13392:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760735 -> 1789760736 00002000:00010000:3.0:1789760736.758634:0:13392:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760735 -> 1789760736 00002000:00010000:3.0:1789760736.758636:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 169997 -> 172045 00010000:00010000:3.0:1789760736.758652:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.758686:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.758695:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.758702:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760736.758707:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.758716:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.758736:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760736.758744:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858149 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760736.758889:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777209088:12345-192.168.203.38@tcp:4:dd.500 Request processed in 43468us (141493us total) trans 4294967536 rc 0/0 00000100:00100000:3.0:1789760736.758900:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:3.0:1789760736.758908:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412899421992 time 412899597872 state 0x2 ref 0 00000001:00080000:0.0:1789760736.759130:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967536 is committed 00000100:00100000:0.0:1789760736.769925:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760736.770100:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777209216 00000100:00100000:3.0:1789760736.770123:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777209216 00000100:00100000:3.0:1789760736.770186:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 412899421992 time 412899597872 state 0x0 ref 1 00000100:00100000:3.0:1789760736.770200:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413099597872 time 412899597872 state 0x1 ref 1 00010000:00010000:3.0:1789760736.775010:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760736.915845:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413099597872 time 413100044354 state 0x0 ref 1 00000100:00100000:2.0:1789760736.915880:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777209216:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760736.915954:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 88080384, mtime: 0x6aad94e0, atime: 0x6aad94cf, ctime: 0x6aad94e0, blocks: 0x2a00d 00010000:00010000:2.0:1789760736.915964:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760736.915981:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789760736.915985:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760736.915992:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760736.916008:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760737.016176:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967537 is committed 00002000:00010000:3.0:1789760737.016412:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:3.0:1789760737.016417:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 172045 -> 174093 00010000:00010000:3.0:1789760737.016432:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.016446:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.016455:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.016464:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760737.016468:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.016479:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.016502:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760737.016510:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858150 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760737.016735:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777209216:12345-192.168.203.38@tcp:4:dd.500 Request processed in 100866us (246815us total) trans 4294967537 rc 0/0 00000100:00100000:3.0:1789760737.016747:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:3.0:1789760737.016755:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413099597872 time 413100044354 state 0x2 ref 0 00000100:00100000:1.0:1789760737.037244:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760737.037470:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777209344 00000100:00100000:3.0:1789760737.037480:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777209344 00000100:00100000:3.0:1789760737.037535:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413099597872 time 413100044354 state 0x0 ref 1 00000100:00100000:3.0:1789760737.037548:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413300044354 time 413100044354 state 0x1 ref 1 00000100:00100000:2.0:1789760737.115989:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413300044354 time 413300190259 state 0x0 ref 1 00000100:00100000:2.0:1789760737.116019:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777209344:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760737.116075:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 89128960, mtime: 0x6aad94e0, atime: 0x6aad94cf, ctime: 0x6aad94e0, blocks: 0x2a80d 00010000:00010000:2.0:1789760737.116084:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760737.116099:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789760737.116103:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760737.116108:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760737.116121:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760737.213179:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967538 is committed 00002000:00010000:0.0:1789760737.213236:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:0.0:1789760737.213241:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 174093 -> 176141 00010000:00010000:0.0:1789760737.213256:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.213268:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.213277:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.213285:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760737.213308:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.213318:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.213364:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.213371:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c154ac/0xc2b9a3a739858157 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760737.213465:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777209344:12345-192.168.203.38@tcp:4:dd.500 Request processed in 97456us (176227us total) trans 4294967538 rc 0/0 00000100:00100000:0.0:1789760737.213475:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:0.0:1789760737.213483:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413300044354 time 413300190259 state 0x2 ref 0 00000100:00100000:0.0:1789760737.219540:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760737.219835:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777209472 00000100:00100000:3.0:1789760737.219846:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777209472 00000100:00100000:3.0:1789760737.219901:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413300044354 time 413300190259 state 0x0 ref 1 00000100:00100000:3.0:1789760737.219914:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413500190259 time 413300190259 state 0x1 ref 1 00000100:00100000:0.0:1789760737.318314:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413500190259 time 413502513960 state 0x0 ref 1 00000100:00100000:0.0:1789760737.318357:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777209472:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760737.318412:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 90177536, mtime: 0x6aad94e0, atime: 0x6aad94cf, ctime: 0x6aad94e0, blocks: 0x2b00d 00010000:00010000:0.0:1789760737.318420:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.318433:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789760737.318437:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760737.318444:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.318459:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760737.377120:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967539 is committed 00002000:00010000:0.0:1789760737.377254:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:0.0:1789760737.377259:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 176141 -> 178189 00010000:00010000:0.0:1789760737.377273:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.377286:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.377296:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.377303:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760737.377308:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.377317:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.377336:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.377344:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985815e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760737.377448:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777209472:12345-192.168.203.38@tcp:4:dd.500 Request processed in 59103us (157913us total) trans 4294967539 rc 0/0 00000100:00100000:0.0:1789760737.377473:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:0.0:1789760737.377480:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413500190259 time 413502513960 state 0x2 ref 0 00000100:00100000:1.0:1789760737.383668:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760737.384092:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777209600 00000100:00100000:3.0:1789760737.384101:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777209600 00000100:00100000:3.0:1789760737.384229:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413500190259 time 413502513960 state 0x0 ref 1 00000100:00100000:3.0:1789760737.384243:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413702513960 time 413502513960 state 0x1 ref 1 00000100:00100000:0.0:1789760737.519265:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413702513960 time 413703464577 state 0x0 ref 1 00000100:00100000:0.0:1789760737.519299:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777209600:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760737.519375:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 91226112, mtime: 0x6aad94e0, atime: 0x6aad94cf, ctime: 0x6aad94e0, blocks: 0x2b80d 00010000:00010000:0.0:1789760737.519385:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.519400:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789760737.519405:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760737.519412:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.519427:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760737.577745:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967540 is committed 00002000:00010000:0.0:1789760737.578036:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:0.0:1789760737.578042:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 178189 -> 180237 00010000:00010000:0.0:1789760737.578056:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.578070:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.578101:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.578108:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760737.578113:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.578122:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.578153:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.578161:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858165 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760737.578292:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777209600:12345-192.168.203.38@tcp:4:dd.500 Request processed in 59006us (194683us total) trans 4294967540 rc 0/0 00000100:00100000:0.0:1789760737.578302:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:0.0:1789760737.578310:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413702513960 time 413703464577 state 0x2 ref 0 00000100:00100000:1.0:1789760737.591072:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760737.596722:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777209728 00000100:00100000:2.0:1789760737.596737:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777209728 00000100:00100000:0.0:1789760737.598187:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413702513960 time 413703464577 state 0x0 ref 1 00000100:00100000:0.0:1789760737.598200:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413903464577 time 413703464577 state 0x1 ref 1 00000100:00100000:0.0:1789760737.719546:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413903464577 time 413903745637 state 0x0 ref 1 00000100:00100000:0.0:1789760737.719593:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777209728:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760737.719652:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 92274688, mtime: 0x6aad94e0, atime: 0x6aad94cf, ctime: 0x6aad94e0, blocks: 0x2c00d 00010000:00010000:0.0:1789760737.719661:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.719675:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1789760737.719680:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760737.719686:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.719700:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760737.792968:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:0.0:1789760737.792978:0:8119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760736 -> 1789760737 00002000:00010000:0.0:1789760737.792981:0:8119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760736 -> 1789760737 00002000:00010000:0.0:1789760737.792983:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 180237 -> 182285 00010000:00010000:0.0:1789760737.792997:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.793010:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.793018:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.793040:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760737.793045:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.793054:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.793074:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760737.793082:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985816c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760737.793182:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777209728:12345-192.168.203.38@tcp:4:dd.500 Request processed in 73598us (202117us total) trans 4294967541 rc 0/0 00000100:00100000:0.0:1789760737.793196:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:0.0:1789760737.793204:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413903464577 time 413903745637 state 0x2 ref 0 00000001:00080000:3.0:1789760737.794666:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967541 is committed 00010000:00010000:1.0:1789760737.798937:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760737.800379:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760737.800474:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777209856 00000100:00100000:0.0:1789760737.800484:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777209856 00000100:00100000:0.0:1789760737.800536:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 413903464577 time 413903745637 state 0x0 ref 1 00000100:00100000:0.0:1789760737.800549:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414103745637 time 413903745637 state 0x1 ref 1 00000100:00100000:3.0:1789760737.837051:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760737.837112:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760737.837154:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760737.837200:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760737.837252:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777210112 00000100:00100000:2.0:1789760737.837262:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777210112 00000100:00100000:3.0:1789760737.837271:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760737.837307:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760737.837317:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777210240 00000100:00100000:2.0:1789760737.837320:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777210240 00000100:00100000:3.0:1789760737.837327:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777210496 00000100:00100000:3.0:1789760737.837329:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777210496 00000100:00100000:2.0:1789760737.837333:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777210624 00000100:00100000:2.0:1789760737.837334:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777210624 00000100:00100000:3.0:1789760737.837351:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 408 00000100:00100000:2.0:1789760737.837358:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 409 00000100:00100000:3.0:1789760737.837360:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2404:x1876699777210112:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760737.837364:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777210240:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760737.837451:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777209984 00000100:00100000:0.0:1789760737.837456:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777209984 00000100:00100000:0.0:1789760737.837487:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 376 00000100:00100000:0.0:1789760737.837500:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777209984:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760737.837556:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2404:x1876699777210112:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 196us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760737.837565:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 408 00000100:00100000:3.0:1789760737.837582:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 410 00000100:00100000:3.0:1789760737.837588:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777210496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760737.837664:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 411 00000100:00100000:1.0:1789760737.837673:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777210624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760737.838389:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2403:x1876699777209984:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 886us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760737.838397:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 376 00000100:00100000:2.0:1789760737.838417:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777210240:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1052us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760737.838424:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 409 00000100:00080000:2.0:1789760737.838440:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760737.838444:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760737.838617:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777210496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1026us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760737.838625:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 410 00000100:00100000:3.0:1789760737.838648:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777210368 00000100:00100000:3.0:1789760737.838653:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777210368 00000100:00080000:2.0:1789760737.838762:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760737.838996:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:3.0:1789760737.839006:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777210368:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760737.839056:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777210368:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 53us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760737.839063:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:0.0:1789760737.839417:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777210624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1558us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760737.839426:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 411 00000100:00100000:1.0:1789760737.920896:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414103745637 time 414105096759 state 0x0 ref 1 00000100:00100000:1.0:1789760737.920929:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777209856:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760737.920989:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 93323264, mtime: 0x6aad94e1, atime: 0x6aad94cf, ctime: 0x6aad94e1, blocks: 0x2c80d 00010000:00010000:1.0:1789760737.920998:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760737.921014:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1789760737.921032:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760737.921039:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760737.921057:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760738.003740:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:3.0:1789760738.003751:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 182285 -> 184333 00010000:00010000:3.0:1789760738.003764:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.004107:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.004117:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.004135:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f5800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760738.004140:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.004148:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.004169:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.004177:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125765e5/0xc2b9a3a739858173 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.004343:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777209856:12345-192.168.203.38@tcp:4:dd.500 Request processed in 83425us (203967us total) trans 4294967542 rc 0/0 00000100:00100000:3.0:1789760738.004354:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:3.0:1789760738.004362:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414103745637 time 414105096759 state 0x2 ref 0 00000001:00080000:3.0:1789760738.004401:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967542 is committed 00000100:00100000:2.0:1789760738.014020:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760738.014142:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777210752 00000100:00100000:0.0:1789760738.014151:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777210752 00000100:00100000:0.0:1789760738.014217:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414103745637 time 414105096759 state 0x0 ref 1 00000100:00100000:0.0:1789760738.014230:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414305096759 time 414105096759 state 0x1 ref 1 00000100:00080000:2.0:1789760738.014600:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760738.122646:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414305096759 time 414306844455 state 0x0 ref 1 00000100:00100000:3.0:1789760738.122683:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777210752:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760738.122742:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 94371840, mtime: 0x6aad94e1, atime: 0x6aad94cf, ctime: 0x6aad94e1, blocks: 0x2d00d 00010000:00010000:3.0:1789760738.122752:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.122768:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1789760738.122773:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.122812:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.122832:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760738.184277:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967543 is committed 00002000:00010000:3.0:1789760738.186408:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:3.0:1789760738.186415:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 184333 -> 186381 00010000:00010000:3.0:1789760738.186428:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.186441:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.186450:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.186457:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760738.186477:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.186486:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.186507:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.186515:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a73985817a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760738.186631:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777210752:12345-192.168.203.38@tcp:4:dd.500 Request processed in 63964us (172616us total) trans 4294967543 rc 0/0 00000100:00100000:3.0:1789760738.186642:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:3.0:1789760738.186650:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414305096759 time 414306844455 state 0x2 ref 0 00000100:00100000:1.0:1789760738.195603:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760738.195713:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777210880 00000100:00100000:0.0:1789760738.195722:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777210880 00000100:00100000:0.0:1789760738.195776:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414305096759 time 414306844455 state 0x0 ref 1 00000100:00100000:0.0:1789760738.195827:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414506844455 time 414306844455 state 0x1 ref 1 00000100:00100000:0.0:1789760738.323458:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414506844455 time 414507657740 state 0x0 ref 1 00000100:00100000:0.0:1789760738.323493:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777210880:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760738.323554:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 95420416, mtime: 0x6aad94e1, atime: 0x6aad94cf, ctime: 0x6aad94e1, blocks: 0x2d80d 00010000:00010000:0.0:1789760738.323563:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.323579:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1789760738.323584:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760738.323604:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.323618:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760738.391414:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967544 is committed 00002000:00010000:0.0:1789760738.393752:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:0.0:1789760738.393761:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 186381 -> 188429 00010000:00010000:0.0:1789760738.394119:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.394144:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.394154:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.394162:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760738.394167:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.394177:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.394197:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.394229:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a739858181 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760738.394404:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777210880:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70921us (198815us total) trans 4294967544 rc 0/0 00000100:00100000:1.0:1789760738.394422:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:1.0:1789760738.394429:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414506844455 time 414507657740 state 0x2 ref 0 00000100:00100000:0.0:1789760738.404443:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760738.404566:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777211008 00000100:00100000:2.0:1789760738.404577:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777211008 00000100:00100000:2.0:1789760738.404630:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414506844455 time 414507657740 state 0x0 ref 1 00000100:00100000:2.0:1789760738.404644:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414707657740 time 414507657740 state 0x1 ref 1 00000100:00100000:3.0:1789760738.524055:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414707657740 time 414708254563 state 0x0 ref 1 00000100:00100000:3.0:1789760738.524088:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777211008:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760738.524156:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 96468992, mtime: 0x6aad94e1, atime: 0x6aad94cf, ctime: 0x6aad94e1, blocks: 0x2e00d 00010000:00010000:3.0:1789760738.524165:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.524180:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1789760738.524185:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.524191:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.524235:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760738.594933:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967545 is committed 00002000:00010000:2.0:1789760738.595667:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:2.0:1789760738.595673:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 188429 -> 190477 00010000:00010000:2.0:1789760738.595687:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760738.595717:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760738.595726:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760738.595733:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760738.595738:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760738.595748:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760738.595769:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760738.595777:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a739858188 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760738.595908:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777211008:12345-192.168.203.38@tcp:4:dd.500 Request processed in 71831us (191470us total) trans 4294967545 rc 0/0 00000100:00100000:2.0:1789760738.595918:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1789760738.595925:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414707657740 time 414708254563 state 0x2 ref 0 00000100:00100000:0.0:1789760738.600645:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760738.600728:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777211136 00000100:00100000:3.0:1789760738.600738:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777211136 00000100:00100000:3.0:1789760738.600831:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414707657740 time 414708254563 state 0x0 ref 1 00000100:00100000:3.0:1789760738.600843:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414908254563 time 414708254563 state 0x1 ref 1 00000100:00100000:1.0:1789760738.724237:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414908254563 time 414908435922 state 0x0 ref 1 00000100:00100000:1.0:1789760738.724270:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777211136:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760738.724331:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 97517568, mtime: 0x6aad94e1, atime: 0x6aad94cf, ctime: 0x6aad94e1, blocks: 0x2e80d 00010000:00010000:1.0:1789760738.724342:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760738.724359:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1789760738.724363:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760738.724369:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760738.724405:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760738.800098:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967546 is committed 00002000:00010000:1.0:1789760738.801209:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:1.0:1789760738.801216:0:13391:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760737 -> 1789760738 00002000:00010000:1.0:1789760738.801219:0:13391:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760737 -> 1789760738 00002000:00010000:1.0:1789760738.801221:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 190477 -> 192525 00010000:00010000:1.0:1789760738.801236:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760738.801249:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760738.801259:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760738.801267:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760738.801271:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760738.801280:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760738.801300:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760738.801330:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a73985818f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760738.801441:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777211136:12345-192.168.203.38@tcp:4:dd.500 Request processed in 77183us (200804us total) trans 4294967546 rc 0/0 00000100:00100000:1.0:1789760738.801451:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:1.0:1789760738.801459:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414908254563 time 414908435922 state 0x2 ref 0 00010000:00010000:1.0:1789760738.823837:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760738.827432:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760738.827553:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777211264 00000100:00100000:3.0:1789760738.827562:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777211264 00000100:00100000:3.0:1789760738.827615:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 414908254563 time 414908435922 state 0x0 ref 1 00000100:00100000:3.0:1789760738.827627:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415108435922 time 414908435922 state 0x1 ref 1 00000100:00100000:3.0:1789760738.924302:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415108435922 time 415108503022 state 0x0 ref 1 00000100:00100000:3.0:1789760738.924333:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777211264:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760738.924381:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 98566144, mtime: 0x6aad94e2, atime: 0x6aad94cf, ctime: 0x6aad94e2, blocks: 0x2f00d 00010000:00010000:3.0:1789760738.924389:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.924402:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1789760738.924405:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760738.924409:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760738.924438:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760738.977514:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967547 is committed 00002000:00010000:0.0:1789760738.977988:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:0.0:1789760738.977993:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 192525 -> 194575 00010000:00010000:0.0:1789760738.978007:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.978020:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.978029:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.978036:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760738.978040:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.978050:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.978069:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760738.978093:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858196 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760738.978246:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777211264:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53923us (150818us total) trans 4294967547 rc 0/0 00000100:00100000:0.0:1789760738.978256:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:0.0:1789760738.978265:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415108435922 time 415108503022 state 0x2 ref 0 00000100:00100000:2.0:1789760738.986275:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760738.987500:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777211392 00000100:00100000:1.0:1789760738.987512:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777211392 00000100:00100000:1.0:1789760738.987566:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415108435922 time 415108503022 state 0x0 ref 1 00000100:00100000:1.0:1789760738.987732:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415308503022 time 415108503022 state 0x1 ref 1 00000100:00100000:0.0:1789760739.124848:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415308503022 time 415309048100 state 0x0 ref 1 00000100:00100000:0.0:1789760739.124882:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777211392:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760739.124939:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 99614720, mtime: 0x6aad94e2, atime: 0x6aad94cf, ctime: 0x6aad94e2, blocks: 0x2f80f 00010000:00010000:0.0:1789760739.124949:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.124964:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1789760739.124968:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760739.124975:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.124990:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760739.176523:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:0.0:1789760739.176533:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 194575 -> 196623 00010000:00010000:0.0:1789760739.176560:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.176572:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.176581:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.176589:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760739.176594:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.176604:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.176623:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.176631:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a73985819d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760739.176729:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777211392:12345-192.168.203.38@tcp:4:dd.500 Request processed in 51860us (190460us total) trans 4294967548 rc 0/0 00000100:00100000:0.0:1789760739.176740:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:0.0:1789760739.176749:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415308503022 time 415309048100 state 0x2 ref 0 00000001:00080000:3.0:1789760739.176937:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967548 is committed 00000100:00100000:3.0:1789760739.186320:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760739.186483:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777211520 00000100:00100000:0.0:1789760739.186493:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777211520 00000100:00100000:0.0:1789760739.186551:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415308503022 time 415309048100 state 0x0 ref 1 00000100:00100000:0.0:1789760739.186564:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415509048100 time 415309048100 state 0x1 ref 1 00000100:00100000:0.0:1789760739.324961:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415509048100 time 415509161322 state 0x0 ref 1 00000100:00100000:0.0:1789760739.324994:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777211520:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760739.325055:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 100663296, mtime: 0x6aad94e2, atime: 0x6aad94cf, ctime: 0x6aad94e2, blocks: 0x3000f 00010000:00010000:0.0:1789760739.325064:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.325080:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1789760739.325085:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760739.325091:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.325105:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760739.392592:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:0.0:1789760739.392601:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 196623 -> 198671 00010000:00010000:0.0:1789760739.392616:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.392641:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.392663:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.392672:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760739.392677:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.392686:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.392706:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.392715:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760739.392961:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777211520:12345-192.168.203.38@tcp:4:dd.500 Request processed in 67977us (206646us total) trans 4294967549 rc 0/0 00000100:00100000:0.0:1789760739.392972:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:0.0:1789760739.392980:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415509048100 time 415509161322 state 0x2 ref 0 00000001:00080000:3.0:1789760739.393550:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967549 is committed 00000100:00100000:2.0:1789760739.398246:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760739.398347:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777211648 00000100:00100000:1.0:1789760739.398357:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777211648 00000100:00100000:1.0:1789760739.398412:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415509048100 time 415509161322 state 0x0 ref 1 00000100:00100000:1.0:1789760739.398427:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415709161322 time 415509161322 state 0x1 ref 1 00000100:00100000:0.0:1789760739.525126:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415709161322 time 415709318204 state 0x0 ref 1 00000100:00100000:0.0:1789760739.525159:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777211648:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760739.525211:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 101711872, mtime: 0x6aad94e2, atime: 0x6aad94cf, ctime: 0x6aad94e2, blocks: 0x3080f 00010000:00010000:0.0:1789760739.525234:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.525249:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1789760739.525253:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760739.525259:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760739.525274:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760739.582565:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967550 is committed 00002000:00010000:1.0:1789760739.582860:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:1.0:1789760739.582866:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 198671 -> 200719 00010000:00010000:1.0:1789760739.582881:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.582895:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.582925:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.582933:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760739.582939:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.582948:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.582967:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.582974:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a7398581ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760739.583061:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777211648:12345-192.168.203.38@tcp:4:dd.500 Request processed in 57912us (184821us total) trans 4294967550 rc 0/0 00000100:00100000:1.0:1789760739.583070:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:1.0:1789760739.583149:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415709161322 time 415709318204 state 0x2 ref 0 00000100:00100000:2.0:1789760739.590131:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760739.590249:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777211776 00000100:00100000:0.0:1789760739.590257:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777211776 00000100:00100000:0.0:1789760739.590305:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415709161322 time 415709318204 state 0x0 ref 1 00000100:00100000:0.0:1789760739.590317:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415909318204 time 415709318204 state 0x1 ref 1 00000100:00100000:1.0:1789760739.725667:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415909318204 time 415909867645 state 0x0 ref 1 00000100:00100000:1.0:1789760739.725698:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777211776:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760739.725756:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 102760448, mtime: 0x6aad94e2, atime: 0x6aad94cf, ctime: 0x6aad94e2, blocks: 0x3100f 00010000:00010000:1.0:1789760739.725778:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.725831:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1789760739.725836:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760739.725842:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.725857:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760739.812001:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967551 is committed 00002000:00010000:1.0:1789760739.812147:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:1.0:1789760739.812152:0:13388:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760738 -> 1789760739 00002000:00010000:1.0:1789760739.812155:0:13388:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760738 -> 1789760739 00002000:00010000:1.0:1789760739.812158:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 200719 -> 202767 00010000:00010000:1.0:1789760739.812171:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.812184:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.812194:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.812202:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760739.812208:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.812234:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.812255:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760739.812263:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1fcef97/0xc2b9a3a7398581b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760739.812356:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777211776:12345-192.168.203.38@tcp:4:dd.500 Request processed in 86667us (222239us total) trans 4294967551 rc 0/0 00000100:00100000:1.0:1789760739.812366:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1789760739.812374:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415909318204 time 415909867645 state 0x2 ref 0 00000100:00100000:2.0:1789760739.818004:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760739.821577:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777211904 00000100:00100000:0.0:1789760739.821649:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777211904 00000100:00100000:0.0:1789760739.821709:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 415909318204 time 415909867645 state 0x0 ref 1 00000100:00100000:0.0:1789760739.821722:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416109867645 time 415909867645 state 0x1 ref 1 00010000:00010000:3.0:1789760739.847058:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760739.925850:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416109867645 time 416110050729 state 0x0 ref 1 00000100:00100000:3.0:1789760739.925882:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777211904:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760739.925937:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 103809024, mtime: 0x6aad94e3, atime: 0x6aad94cf, ctime: 0x6aad94e3, blocks: 0x3180f 00010000:00010000:3.0:1789760739.925946:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.925961:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1789760739.925966:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760739.925972:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760739.925989:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760740.004358:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:0.0:1789760740.004367:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 202767 -> 204815 00010000:00010000:0.0:1789760740.004381:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.004395:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.004417:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.004426:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760740.004440:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.004450:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.004469:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.004476:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a7398581b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760740.004567:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777211904:12345-192.168.203.38@tcp:4:dd.500 Request processed in 78696us (186569us total) trans 4294967552 rc 0/0 00000100:00100000:0.0:1789760740.004577:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:0.0:1789760740.004585:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416109867645 time 416110050729 state 0x2 ref 0 00000001:00080000:2.0:1789760740.005106:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967552 is committed 00000100:00100000:2.0:1789760740.010300:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760740.010403:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777212160 00000100:00100000:3.0:1789760740.010413:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777212160 00000100:00100000:3.0:1789760740.010485:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:3.0:1789760740.010507:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:11999:x1876699777212160:12345-192.168.203.38@tcp:35:dd.500 00000100:00080000:2.0:1789760740.010943:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789760740.011348:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967355 00000100:00100000:3.0:1789760740.011941:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11999:x1876699777212160:12345-192.168.203.38@tcp:35:dd.500 Request processed in 1431us (1645us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789760740.011951:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000020:00080000:3.0:1789760740.011957:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789760740.039125:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760740.039148:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57acafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798219264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760740.039217:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760740.039346:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798219264 00000100:00100000:2.0:1789760740.039355:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798219264 00000100:00100000:2.0:1789760740.039419:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789760740.039441:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798219264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760740.039476:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760740.039523:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798219264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760740.039531:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789760740.039579:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57acafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798219264:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789760740.039767:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760740.040209:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798219648:0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.040243:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760740.040273:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798220160:0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.040299:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760740.040315:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798220672:0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.040334:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760740.040351:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789760740.040371:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798219776:0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.040393:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760740.040409:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798220288:0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.040440:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760740.040456:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798220800:0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.040475:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760740.040507:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798220160 00000100:00100000:2.0:1789760740.040512:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798220160 00000100:00100000:2.0:1789760740.040547:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798220672 00000100:00100000:2.0:1789760740.040550:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798220672 00000100:00100000:2.0:1789760740.040568:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798219776 00000100:00100000:2.0:1789760740.040571:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798219776 00000100:00100000:2.0:1789760740.040584:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789760740.040591:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798220160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760740.040761:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798219520:0@lo:400:kworker.0 00000100:00100000:3.0:1789760740.040857:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798219648 00000100:00100000:3.0:1789760740.040862:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798219648 00000100:00100000:3.0:1789760740.040889:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789760740.040895:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798219648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.043160:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798219392:0@lo:400:kworker.0 00000100:00100000:1.0:1789760740.045980:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760740.046022:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798220032:0@lo:400:kworker.0 00000100:00100000:1.0:1789760740.046050:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760740.046063:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798220544:0@lo:400:kworker.0 00000100:00100000:1.0:1789760740.046084:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760740.046832:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798220160:12345-0@lo:400:kworker.0 Request processed in 6237us (6527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760740.046843:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789760740.046871:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798219520 00000100:00100000:2.0:1789760740.046878:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798219520 00000100:00100000:2.0:1789760740.046905:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798220032 00000100:00100000:2.0:1789760740.046908:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798220032 00000100:00100000:2.0:1789760740.046925:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798220544 00000100:00100000:2.0:1789760740.046928:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798220544 00000100:00100000:2.0:1789760740.046945:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789760740.046953:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798220672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.046998:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798220672:12345-0@lo:400:kworker.0 Request processed in 46us (6662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760740.047004:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789760740.047026:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789760740.047033:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798219776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.047065:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798219776:12345-0@lo:400:kworker.0 Request processed in 33us (6671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760740.047071:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789760740.047083:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789760740.047089:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798219520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.047136:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798219520:12345-0@lo:400:kworker.0 Request processed in 48us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760740.047143:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789760740.047154:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789760740.047160:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798220032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.047187:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798220032:12345-0@lo:400:kworker.0 Request processed in 27us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760740.047192:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789760740.047203:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789760740.047209:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798220544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.047233:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798220544:12345-0@lo:400:kworker.0 Request processed in 25us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760740.047239:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789760740.047266:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798220288 00000100:00100000:2.0:1789760740.047269:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798220288 00000100:00100000:2.0:1789760740.047295:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798220800 00000100:00100000:2.0:1789760740.047298:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798220800 00000100:00100000:2.0:1789760740.047315:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789760740.047435:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798219776:0@lo:400:kworker.0 00000100:00100000:1.0:1789760740.047450:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798220160:0@lo:400:kworker.0 00000100:00100000:1.0:1789760740.047459:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798220672:0@lo:400:kworker.0 00000100:00100000:3.0:1789760740.047579:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798219648:12345-0@lo:400:kworker.0 Request processed in 6683us (7334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760740.047588:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789760740.047658:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798219648:0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.047745:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760740.047783:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798219904:0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.047831:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760740.047855:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f51d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798220416:0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.047876:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760740.047895:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57acafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798220928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760740.047915:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760740.047945:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798219904 00000100:00100000:0.0:1789760740.047949:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798219904 00000100:00100000:0.0:1789760740.047974:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789760740.047980:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798219904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.048016:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798219904:12345-0@lo:400:kworker.0 Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760740.048022:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789760740.048037:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798220416 00000100:00100000:0.0:1789760740.048041:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798220416 00000100:00100000:0.0:1789760740.048058:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789760740.048064:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798220800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.048097:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798220800:12345-0@lo:400:kworker.0 Request processed in 33us (7621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760740.048103:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789760740.048125:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789760740.048130:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798220416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.048154:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798220416:12345-0@lo:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760740.048159:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789760740.048173:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798220928 00000100:00100000:0.0:1789760740.048176:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798220928 00000100:00100000:0.0:1789760740.048204:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789760740.048209:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798220928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760740.048221:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71368704 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760740.048251:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798220928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760740.048256:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789760740.048290:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798219904:0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.048300:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798220416:0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.048316:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57acafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798220928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760740.048393:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798220288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.048435:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798220288:12345-0@lo:400:kworker.0 Request processed in 1114us (7994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760740.048442:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1789760740.048473:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760740.048477:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760740.048479:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760740.048481:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760740.048505:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798219520:0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.048517:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798220032:0@lo:400:kworker.0 00000100:00100000:2.0:1789760740.048527:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798220544:0@lo:400:kworker.0 00000100:00100000:1.0:1789760740.049163:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798219392 00000100:00100000:1.0:1789760740.049169:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798219392 00000100:00100000:1.0:1789760740.049210:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789760740.049218:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798219392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760740.049256:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798219392:12345-0@lo:400:kworker.0 Request processed in 40us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760740.049262:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789760740.049446:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798220288:0@lo:400:kworker.0 00000100:00100000:3.0:1789760740.049458:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798220800:0@lo:400:kworker.0 00000100:00100000:0.0:1789760740.049529:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798219392:0@lo:400:kworker.0 00000100:00100000:3.0:1789760740.159085:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760740.159175:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777212416 00000100:00100000:2.0:1789760740.159184:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777212416 00000100:00100000:2.0:1789760740.159245:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1789760740.159254:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:12017:x1876699777212416:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:2.0:1789760740.159276:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760740.159294:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a7398581c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c19 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.159363:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.159376:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.159387:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.159401:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.159421:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.159429:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160241:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398581d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160252:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398581d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160260:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398581d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760740.160270:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 104857600 00010000:00010000:2.0:1789760740.160347:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160354:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160361:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160367:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760740.160370:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160378:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160398:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:2.0:1789760740.160401:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760740.160406:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160413:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00600/0xc2b9a3a7398581c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160424:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160430:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160436:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160441:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760740.160444:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160449:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160455:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x4009f790 (ffff97e543c0a300) 00010000:00010000:2.0:1789760740.160457:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760740.160459:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160465:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398581ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160510:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00c00/0xc2b9a3a7398581c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c19 expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160521:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398581d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c19 expref: 12 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760740.160529:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760740.160531:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760740.160533:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00e00, rc 0) 00000100:00100000:2.0:1789760740.160698:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+12:12017:x1876699777212416:12345-192.168.203.38@tcp:101:dd.500 Request processed in 1444us (1621us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1789760740.160705:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:1.0:1789760740.164772:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760740.164941:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777212544 00000100:00100000:0.0:1789760740.164951:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777212544 00000100:00100000:0.0:1789760740.165075:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:0.0:1789760740.165085:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777212544:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760740.165102:0:9533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760740.165133:0:9533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a7398581e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c20 expref: -99 pid: 9533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760740.165158:0:9533:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 104857600, mtime: 0x6aad94e3, atime: 0x6aad94cf, ctime: 0x6aad94e3, blocks: 0x3200f 00010000:00010000:0.0:1789760740.165177:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1789760740.165181:0:9533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760740.165190:0:9533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a7398581e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c20 expref: 6 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.165227:0:9533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a7398581e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c20 expref: 6 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.165241:0:9533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e548542000, rc 0) 00000100:00100000:0.0:1789760740.165302:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777212544:12345-192.168.203.38@tcp:101:dd.500 Request processed in 219us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760740.165310:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00080000:2.0:1789760740.165708:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760740.172501:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760740.173098:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777212672 00000100:00100000:0.0:1789760740.173117:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777212672 00000100:00100000:0.0:1789760740.173176:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416109867645 time 416110050729 state 0x0 ref 1 00000100:00100000:0.0:1789760740.173188:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416310050729 time 416110050729 state 0x1 ref 1 00000100:00100000:0.0:1789760740.173267:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416310050729 time 416357476105 state 0x0 ref 1 00000100:00100000:0.0:1789760740.173281:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777212672:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760740.173316:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.173334:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760740.173339:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760740.173345:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.173360:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.191447:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.191469:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.191479:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.191489:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760740.191494:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.191503:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.191523:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.191531:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760740.191748:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777212672:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18465us (19253us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760740.191758:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:0.0:1789760740.192549:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416310050729 time 416357476105 state 0x2 ref 0 00000100:00100000:2.0:1789760740.196566:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760740.196703:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777212800 00000100:00100000:3.0:1789760740.196715:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777212800 00000100:00100000:3.0:1789760740.196782:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416310050729 time 416357476105 state 0x0 ref 1 00000100:00100000:3.0:1789760740.196812:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416557476105 time 416357476105 state 0x1 ref 1 00000100:00100000:0.0:1789760740.373623:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416557476105 time 416557822996 state 0x0 ref 1 00000100:00100000:0.0:1789760740.373658:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777212800:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760740.373714:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.373733:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760740.373737:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760740.373743:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.373757:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.393411:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.393431:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.393441:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.393448:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760740.393453:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.393482:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.393605:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760740.393615:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e16e811/0xc2b9a3a7398581f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760740.393750:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777212800:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20104us (197191us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760740.393760:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:0.0:1789760740.393779:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416557476105 time 416557822996 state 0x2 ref 0 00000100:00100000:0.0:1789760740.400596:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760740.400696:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777212928 00000100:00100000:2.0:1789760740.400708:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777212928 00000100:00100000:2.0:1789760740.400761:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416557476105 time 416557822996 state 0x0 ref 1 00000100:00100000:2.0:1789760740.400803:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416757822996 time 416557822996 state 0x1 ref 1 00000100:00100000:0.0:1789760740.551727:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760740.551750:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798221056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760740.551835:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760740.551897:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798221056 00000100:00100000:0.0:1789760740.551905:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798221056 00000100:00100000:0.0:1789760740.551948:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789760740.551956:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798221056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760740.551989:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760740.552036:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798221056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760740.552055:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789760740.552118:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798221056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760740.573721:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416757822996 time 416757923084 state 0x0 ref 1 00000100:00100000:3.0:1789760740.573749:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777212928:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760740.573965:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.573992:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.573997:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760740.574004:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.574019:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760740.599113:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00010000:00010000:3.0:1789760740.599457:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.599473:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.599482:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.599489:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760740.599494:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.599503:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.599524:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.599547:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a7398581f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.599627:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777212928:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25885us (199037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760740.599637:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:3.0:1789760740.599645:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416757822996 time 416757923084 state 0x2 ref 0 00000100:00100000:1.0:1789760740.606941:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760740.607355:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777213056 00000100:00100000:0.0:1789760740.607366:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777213056 00000100:00100000:0.0:1789760740.607419:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416757822996 time 416757923084 state 0x0 ref 1 00000100:00100000:0.0:1789760740.607432:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416957923084 time 416757923084 state 0x1 ref 1 00000100:00100000:1.0:1789760740.774087:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416957923084 time 416958288723 state 0x0 ref 1 00000100:00100000:1.0:1789760740.774129:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777213056:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760740.774169:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.774186:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760740.774191:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760740.774196:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.774210:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.790990:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.791009:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.791018:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.791025:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8e200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760740.791030:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.791038:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.791059:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760740.791088:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dbca594/0xc2b9a3a7398581ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760740.791205:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777213056:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17096us (184270us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760740.791215:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:3.0:1789760740.791223:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416957923084 time 416958288723 state 0x2 ref 0 00000100:00100000:2.0:1789760740.801967:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760740.802822:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777213184 00000100:00100000:0.0:1789760740.802951:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777213184 00000100:00100000:0.0:1789760740.803012:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 416957923084 time 416958288723 state 0x0 ref 1 00000100:00100000:0.0:1789760740.803025:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417158288723 time 416958288723 state 0x1 ref 1 00010000:00010000:1.0:1789760740.870939:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760740.974557:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417158288723 time 417158757344 state 0x0 ref 1 00000100:00100000:1.0:1789760740.974589:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777213184:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760740.974631:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.974648:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760740.974653:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760740.974659:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.974672:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.991343:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.991364:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.991373:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.991381:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760740.991401:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.991411:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.991431:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760740.991439:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a739858206 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760740.991515:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777213184:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16936us (189552us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760740.991526:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:1.0:1789760740.991533:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417158288723 time 417158757344 state 0x2 ref 0 00000100:00100000:1.0:1789760740.996947:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760740.997038:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777213312 00000100:00100000:0.0:1789760740.997048:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777213312 00000100:00100000:0.0:1789760740.997100:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417158288723 time 417158757344 state 0x0 ref 1 00000100:00100000:0.0:1789760740.997124:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417358757344 time 417158757344 state 0x1 ref 1 00000100:00100000:0.0:1789760741.063049:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760741.063071:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798221184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760741.063149:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760741.063382:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798221184 00000100:00100000:3.0:1789760741.063390:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798221184 00000100:00100000:3.0:1789760741.063707:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789760741.063720:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798221184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789760741.063758:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760741.063843:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798221184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760741.063851:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789760741.063945:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798221184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760741.176183:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417358757344 time 417360382573 state 0x0 ref 1 00000100:00100000:1.0:1789760741.176218:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777213312:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760741.176261:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.176280:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760741.176284:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760741.176304:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.176319:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.188258:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.188278:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.188286:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.188293:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760741.188298:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.188307:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.188325:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760741.188333:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985820d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760741.188449:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777213312:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12242us (191505us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760741.188460:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:1.0:1789760741.188468:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417358757344 time 417360382573 state 0x2 ref 0 00000100:00100000:1.0:1789760741.201729:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760741.201866:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777213440 00000100:00100000:3.0:1789760741.201877:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777213440 00000100:00100000:3.0:1789760741.201927:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417358757344 time 417360382573 state 0x0 ref 1 00000100:00100000:3.0:1789760741.201940:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417560382573 time 417360382573 state 0x1 ref 1 00000100:00100000:0.0:1789760741.376946:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417560382573 time 417561145842 state 0x0 ref 1 00000100:00100000:0.0:1789760741.377038:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777213440:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760741.377153:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.377188:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760741.377193:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760741.377199:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.377213:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.392715:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.392744:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.392753:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.392762:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ed400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760741.392767:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.392777:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.392828:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.392853:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858214 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760741.392935:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777213440:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15965us (191209us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760741.392946:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:0.0:1789760741.392954:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417560382573 time 417561145842 state 0x2 ref 0 00000100:00100000:2.0:1789760741.402228:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760741.402385:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777213568 00000100:00100000:3.0:1789760741.402395:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777213568 00000100:00100000:3.0:1789760741.402451:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417560382573 time 417561145842 state 0x0 ref 1 00000100:00100000:3.0:1789760741.402465:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417761145842 time 417561145842 state 0x1 ref 1 00000100:00100000:1.0:1789760741.575144:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798221440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760741.575144:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798221312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760741.576868:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760741.576971:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798221440 00000100:00100000:3.0:1789760741.576981:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798221440 00000100:00100000:3.0:1789760741.577038:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789760741.577049:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798221440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760741.577077:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3755999232 avail 3752853504 00000100:00100000:3.0:1789760741.577155:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798221440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760741.577161:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789760741.577260:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798221440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760741.578505:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760741.578689:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798221312 00000100:00100000:1.0:1789760741.578696:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798221312 00000100:00100000:1.0:1789760741.578743:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789760741.578752:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798221312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760741.578775:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3755999232 avail 3752853504 00000100:00100000:1.0:1789760741.578844:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798221312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760741.578850:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789760741.579406:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417761145842 time 417763610206 state 0x0 ref 1 00000100:00100000:0.0:1789760741.579424:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777213568:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760741.579456:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.579472:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760741.579475:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760741.579481:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.579506:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760741.580537:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798221312:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789760741.596335:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.596356:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.596380:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.596388:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ed400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760741.596393:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.596401:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.596422:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.596430:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985821b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760741.596520:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777213568:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17097us (194298us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760741.596531:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:0.0:1789760741.596539:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417761145842 time 417763610206 state 0x2 ref 0 00000100:00100000:3.0:1789760741.602424:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760741.602532:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777213696 00000100:00100000:1.0:1789760741.602542:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777213696 00000100:00100000:1.0:1789760741.602602:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417761145842 time 417763610206 state 0x0 ref 1 00000100:00100000:1.0:1789760741.602615:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417963610206 time 417763610206 state 0x1 ref 1 00000100:00100000:2.0:1789760741.779723:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417963610206 time 417963922109 state 0x0 ref 1 00000100:00100000:2.0:1789760741.779756:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777213696:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760741.779838:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.779857:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760741.779861:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760741.779866:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.779881:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.791876:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.791897:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.791905:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.791913:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8ea00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760741.791918:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.791943:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.791964:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760741.791972:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f14bf8/0xc2b9a3a739858222 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760741.792077:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777213696:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12331us (189658us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760741.792088:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:2.0:1789760741.792105:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417963610206 time 417963922109 state 0x2 ref 0 00000100:00100000:3.0:1789760741.805542:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760741.805652:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777213824 00000100:00100000:1.0:1789760741.805662:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777213824 00000100:00100000:1.0:1789760741.805713:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 417963610206 time 417963922109 state 0x0 ref 1 00000100:00100000:1.0:1789760741.805738:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418163922109 time 417963922109 state 0x1 ref 1 00010000:00010000:1.0:1789760741.895043:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760741.979885:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418163922109 time 418164085144 state 0x0 ref 1 00000100:00100000:3.0:1789760741.979918:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777213824:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760741.979962:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.979982:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760741.979986:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760741.979992:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760741.980006:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.995149:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.995170:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.995201:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.995209:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f0c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760741.995214:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.995223:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.995245:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760741.995254:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edcc46af/0xc2b9a3a739858229 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760741.995345:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777213824:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15437us (189809us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760741.995357:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:0.0:1789760741.995366:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418163922109 time 418164085144 state 0x2 ref 0 00000100:00100000:1.0:1789760742.012144:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760742.012267:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777213952 00000100:00100000:0.0:1789760742.012277:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777213952 00000100:00100000:0.0:1789760742.012350:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418163922109 time 418164085144 state 0x0 ref 1 00000100:00100000:0.0:1789760742.012363:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418364085144 time 418164085144 state 0x1 ref 1 00000100:00080000:2.0:1789760742.012494:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760742.180039:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418364085144 time 418364239603 state 0x0 ref 1 00000100:00100000:3.0:1789760742.180072:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777213952:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760742.180139:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.180157:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.180161:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760742.180168:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.180181:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.192524:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.192545:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.192555:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.192563:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5427f1400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760742.192567:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.192578:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.192621:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.192629:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acfab28c/0xc2b9a3a739858230 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.192718:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777213952:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12657us (180580us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760742.192728:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:3.0:1789760742.192736:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418364085144 time 418364239603 state 0x2 ref 0 00000100:00100000:2.0:1789760742.201416:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760742.201595:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777214080 00000100:00100000:0.0:1789760742.201605:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777214080 00000100:00100000:0.0:1789760742.201683:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418364085144 time 418364239603 state 0x0 ref 1 00000100:00100000:0.0:1789760742.201696:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418564239603 time 418364239603 state 0x1 ref 1 00000100:00100000:0.0:1789760742.380286:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418564239603 time 418564486164 state 0x0 ref 1 00000100:00100000:0.0:1789760742.380320:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777214080:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760742.380363:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.380380:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760742.380385:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760742.380391:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.380404:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.397161:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.397285:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.397297:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.397325:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ed400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760742.397330:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.397340:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.397362:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.397371:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a739858237 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760742.397457:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777214080:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17148us (196046us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760742.397467:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:0.0:1789760742.397475:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418564239603 time 418564486164 state 0x2 ref 0 00000100:00100000:1.0:1789760742.408272:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760742.408371:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777214208 00000100:00100000:2.0:1789760742.408381:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777214208 00000100:00100000:2.0:1789760742.408439:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418564239603 time 418564486164 state 0x0 ref 1 00000100:00100000:2.0:1789760742.408452:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418764486164 time 418564486164 state 0x1 ref 1 00000100:00100000:0.0:1789760742.583952:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418764486164 time 418768152659 state 0x0 ref 1 00000100:00100000:0.0:1789760742.583985:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777214208:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760742.584042:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.584059:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760742.584077:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760742.584085:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.584109:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.596391:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.596410:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.596418:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.596425:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ed400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760742.596430:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.596438:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.596468:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.596480:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e672949/0xc2b9a3a73985823e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760742.596564:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777214208:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12590us (188369us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760742.596574:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:3.0:1789760742.596980:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418764486164 time 418768152659 state 0x2 ref 0 00000100:00100000:0.0:1789760742.601922:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760742.602021:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777214336 00000100:00100000:3.0:1789760742.602031:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777214336 00000100:00100000:3.0:1789760742.602083:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418764486164 time 418768152659 state 0x0 ref 1 00000100:00100000:3.0:1789760742.602105:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418968152659 time 418768152659 state 0x1 ref 1 00000100:00100000:0.0:1789760742.785259:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418968152659 time 418969457430 state 0x0 ref 1 00000100:00100000:0.0:1789760742.785297:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777214336:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760742.785341:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.785357:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760742.785361:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760742.785367:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760742.785380:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760742.810257:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760742.810276:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760742.810305:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760742.810313:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3eda00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760742.810318:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760742.810326:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760742.810346:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760742.810354:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e966e041/0xc2b9a3a739858245 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760742.810441:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777214336:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25157us (208524us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760742.810450:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:2.0:1789760742.810457:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418968152659 time 418969457430 state 0x2 ref 0 00000100:00100000:1.0:1789760742.820233:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760742.821157:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777214464 00000100:00100000:3.0:1789760742.821169:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777214464 00000100:00100000:3.0:1789760742.821228:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 418968152659 time 418969457430 state 0x0 ref 1 00000100:00100000:3.0:1789760742.821241:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419169457430 time 418969457430 state 0x1 ref 1 00010000:00010000:3.0:1789760742.924687:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760742.957524:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760742.957571:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760742.957606:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760742.957755:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777214848 00000100:00100000:3.0:1789760742.957765:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777214848 00000100:00100000:3.0:1789760742.957849:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777214720 00000100:00100000:3.0:1789760742.957853:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777214720 00000100:00100000:3.0:1789760742.957892:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 418 00000100:00100000:3.0:1789760742.957902:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777214848:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760742.957974:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777214848:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760742.957982:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 418 00000100:00100000:3.0:1789760742.957999:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 419 00000100:00100000:3.0:1789760742.958006:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2405:x1876699777214720:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760742.958035:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2405:x1876699777214720:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760742.958042:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 419 00000100:00080000:3.0:1789760742.958058:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760742.958061:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760742.958308:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777214592 00000100:00100000:1.0:1789760742.958314:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777214592 00000100:00100000:1.0:1789760742.958353:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 378 00000100:00100000:1.0:1789760742.958361:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777214592:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760742.958389:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54322a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777214592:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760742.958396:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 378 00000100:00100000:1.0:1789760742.965934:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760742.965980:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760742.966030:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760742.966110:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777215104 00000100:00100000:3.0:1789760742.966120:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777215104 00000100:00100000:3.0:1789760742.966189:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777215232 00000100:00100000:3.0:1789760742.966193:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777215232 00000100:00100000:3.0:1789760742.966219:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 420 00000100:00100000:3.0:1789760742.966228:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777215104:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760742.966301:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777215104:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760742.966308:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 420 00000100:00100000:3.0:1789760742.966324:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 421 00000100:00100000:3.0:1789760742.966330:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777215232:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760742.966355:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777215232:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760742.966373:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 421 00000100:00100000:2.0:1789760742.966561:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777214976 00000100:00100000:2.0:1789760742.966566:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777214976 00000100:00100000:2.0:1789760742.966608:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:2.0:1789760742.966615:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2402:x1876699777214976:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1789760742.966643:0:8112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2b9a3a739857b29 00000100:00080000:2.0:1789760742.966652:0:8112:0:(import.c:65:import_set_state_nolock()) ffff97e54991f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789760742.966687:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967347 00000100:00100000:2.0:1789760742.966960:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+2:2402:x1876699777214976:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 344us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760742.966967:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00080000:1.0:1789760742.967323:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760742.967328:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760742.967331:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789760742.967340:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760742.985588:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419169457430 time 419169788887 state 0x0 ref 1 00000100:00100000:1.0:1789760742.985623:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777214464:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760742.985676:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.985694:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760742.985718:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760742.985725:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.985740:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.993434:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.993455:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.993464:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.993472:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac98400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760742.993477:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.993486:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.993505:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760742.993513:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000975b0275/0xc2b9a3a73985824c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760742.993616:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777214464:12345-192.168.203.38@tcp:3:dd.500 Request processed in 8005us (173388us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760742.993626:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:1.0:1789760742.993634:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419169457430 time 419169788887 state 0x2 ref 0 00000100:00100000:1.0:1789760743.005252:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760743.005495:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777215360 00000100:00100000:0.0:1789760743.005506:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777215360 00000100:00100000:0.0:1789760743.005572:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419169457430 time 419169788887 state 0x0 ref 1 00000100:00100000:0.0:1789760743.005586:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419369788887 time 419169788887 state 0x1 ref 1 00000100:00100000:2.0:1789760743.185756:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419369788887 time 419369956194 state 0x0 ref 1 00000100:00100000:2.0:1789760743.185819:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777215360:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760743.185862:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.185878:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760743.185882:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760743.185888:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.185902:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.205907:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.205927:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.205937:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.205962:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760743.205968:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.205978:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.205997:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.206006:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aaf74b8/0xc2b9a3a739858253 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760743.206145:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777215360:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20367us (200896us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760743.206155:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:2.0:1789760743.206163:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419369788887 time 419369956194 state 0x2 ref 0 00000100:00100000:2.0:1789760743.218226:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760743.218307:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777215488 00000100:00100000:3.0:1789760743.218317:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777215488 00000100:00100000:3.0:1789760743.218373:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419369788887 time 419369956194 state 0x0 ref 1 00000100:00100000:3.0:1789760743.218386:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419569956194 time 419369956194 state 0x1 ref 1 00000100:00100000:3.0:1789760743.387175:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419569956194 time 419571375354 state 0x0 ref 1 00000100:00100000:3.0:1789760743.387209:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777215488:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760743.387254:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.387271:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.387276:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.387282:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.387297:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.400400:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.400420:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.400451:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.400458:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760743.400463:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.400473:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.400493:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.400501:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db1b896/0xc2b9a3a73985825a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.400724:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777215488:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13525us (182501us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760743.400734:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:3.0:1789760743.400743:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419569956194 time 419571375354 state 0x2 ref 0 00000100:00100000:3.0:1789760743.413567:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760743.413763:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777215616 00000100:00100000:2.0:1789760743.413772:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777215616 00000100:00100000:2.0:1789760743.413856:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419569956194 time 419571375354 state 0x0 ref 1 00000100:00100000:2.0:1789760743.413869:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419771375354 time 419571375354 state 0x1 ref 1 00000100:00100000:0.0:1789760743.588065:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419771375354 time 419772262524 state 0x0 ref 1 00000100:00100000:0.0:1789760743.588111:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777215616:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760743.588157:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.588174:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760743.588179:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760743.588185:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.588200:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.601063:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.601091:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.601100:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.601108:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f3ede00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760743.601126:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.601135:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.601220:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.601229:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000824f0ff/0xc2b9a3a739858261 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760743.601345:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777215616:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13256us (187785us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760743.601355:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:0.0:1789760743.601373:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419771375354 time 419772262524 state 0x2 ref 0 00000100:00100000:1.0:1789760743.606956:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760743.607441:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777215744 00000100:00100000:0.0:1789760743.607452:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777215744 00000100:00100000:0.0:1789760743.607506:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419771375354 time 419772262524 state 0x0 ref 1 00000100:00100000:0.0:1789760743.607520:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419972262524 time 419772262524 state 0x1 ref 1 00000100:00100000:1.0:1789760743.788267:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419972262524 time 419972466982 state 0x0 ref 1 00000100:00100000:1.0:1789760743.788300:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777215744:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760743.788339:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.788355:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760743.788360:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760743.788366:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.788381:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.819722:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.819755:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.819764:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.819772:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760743.819777:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.819819:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.819847:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.819856:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3152902/0xc2b9a3a739858268 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760743.819966:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777215744:12345-192.168.203.38@tcp:3:dd.500 Request processed in 31675us (213012us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760743.819977:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:2.0:1789760743.819988:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419972262524 time 419972466982 state 0x2 ref 0 00000100:00100000:3.0:1789760743.826147:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760743.826288:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777215872 00000100:00100000:2.0:1789760743.826313:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777215872 00000100:00100000:2.0:1789760743.826380:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 419972262524 time 419972466982 state 0x0 ref 1 00000100:00100000:2.0:1789760743.826392:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420172466982 time 419972466982 state 0x1 ref 1 00010000:00010000:1.0:1789760743.943848:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760743.988426:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420172466982 time 420172627812 state 0x0 ref 1 00000100:00100000:3.0:1789760743.988460:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777215872:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760743.988512:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.988961:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760743.988965:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760743.988974:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.988992:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.010499:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.010518:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.010547:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.010555:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760744.010560:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.010570:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.010596:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.010604:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5b8c361/0xc2b9a3a73985826f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760744.010708:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777215872:12345-192.168.203.38@tcp:3:dd.500 Request processed in 22259us (184565us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760744.010719:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:0.0:1789760744.010727:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420172466982 time 420172627812 state 0x2 ref 0 00000100:00100000:3.0:1789760744.017256:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760744.017374:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777216000 00000100:00100000:0.0:1789760744.017385:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777216000 00000100:00100000:0.0:1789760744.017469:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420172466982 time 420172627812 state 0x0 ref 1 00000100:00100000:0.0:1789760744.017487:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420372627812 time 420172627812 state 0x1 ref 1 00000100:00080000:1.0:1789760744.017656:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760744.189324:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420372627812 time 420373523798 state 0x0 ref 1 00000100:00100000:3.0:1789760744.189357:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777216000:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760744.189400:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.189416:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.189421:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.189427:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.189443:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.209844:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.209881:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.209889:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.209897:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760744.209901:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.209910:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.209929:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.209936:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e993e75/0xc2b9a3a739858276 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760744.210023:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777216000:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20677us (192773us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760744.210032:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:1.0:1789760744.210041:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420372627812 time 420373523798 state 0x2 ref 0 00000100:00100000:1.0:1789760744.228821:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760744.229130:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777216128 00000100:00100000:0.0:1789760744.229141:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777216128 00000100:00100000:0.0:1789760744.229194:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420372627812 time 420373523798 state 0x0 ref 1 00000100:00100000:0.0:1789760744.229208:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420573523798 time 420373523798 state 0x1 ref 1 00000100:00100000:3.0:1789760744.390271:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420573523798 time 420574471256 state 0x0 ref 1 00000100:00100000:3.0:1789760744.390319:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777216128:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760744.390358:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.390375:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.390379:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760744.390385:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.390400:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.441645:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.441667:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.441675:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.441683:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760744.441688:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.441697:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.442429:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760744.442442:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e0118c/0xc2b9a3a73985827d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760744.442540:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777216128:12345-192.168.203.38@tcp:3:dd.500 Request processed in 52229us (213752us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760744.442552:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:3.0:1789760744.442560:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420573523798 time 420574471256 state 0x2 ref 0 00000100:00100000:1.0:1789760744.451199:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760744.451480:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777216256 00000100:00100000:2.0:1789760744.451491:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777216256 00000100:00100000:2.0:1789760744.451550:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420573523798 time 420574471256 state 0x0 ref 1 00000100:00100000:2.0:1789760744.451564:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420774471256 time 420574471256 state 0x1 ref 1 00000100:00100000:1.0:1789760744.594347:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420774471256 time 420778547277 state 0x0 ref 1 00000100:00100000:1.0:1789760744.594382:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777216256:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760744.594438:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.594455:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760744.594459:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760744.594466:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.594480:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.616430:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.616450:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.616469:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.616477:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540031c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760744.616482:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.616491:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.616522:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.616530:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054d1b0e6/0xc2b9a3a739858284 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760744.616703:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777216256:12345-192.168.203.38@tcp:3:dd.500 Request processed in 22334us (165508us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760744.616713:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:0.0:1789760744.616721:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420774471256 time 420778547277 state 0x2 ref 0 00000100:00100000:1.0:1789760744.628904:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760744.629004:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777216384 00000100:00100000:0.0:1789760744.629016:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777216384 00000100:00100000:0.0:1789760744.629092:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420774471256 time 420778547277 state 0x0 ref 1 00000100:00100000:0.0:1789760744.629105:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420978547277 time 420778547277 state 0x1 ref 1 00000100:00100000:0.0:1789760744.794447:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420978547277 time 420978648714 state 0x0 ref 1 00000100:00100000:0.0:1789760744.794478:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777216384:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760744.794517:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.794533:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760744.794538:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760744.794543:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.794571:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.843297:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.843325:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.843333:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.843340:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac95600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760744.843345:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.843354:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.843376:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760744.843384:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4be9109/0xc2b9a3a73985828b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760744.843487:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777216384:12345-192.168.203.38@tcp:3:dd.500 Request processed in 49017us (214587us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760744.843497:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:0.0:1789760744.843506:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420978547277 time 420978648714 state 0x2 ref 0 00000100:00100000:3.0:1789760744.852306:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760744.852773:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777216512 00000100:00100000:1.0:1789760744.852783:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777216512 00000100:00100000:1.0:1789760744.852879:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 420978547277 time 420978648714 state 0x0 ref 1 00000100:00100000:1.0:1789760744.852892:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421178648714 time 420978648714 state 0x1 ref 1 00010000:00010000:3.0:1789760744.967168:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760744.994573:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421178648714 time 421178772572 state 0x0 ref 1 00000100:00100000:1.0:1789760744.994605:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777216512:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760744.994649:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.994685:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760744.994689:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760744.994695:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760744.994709:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.011994:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.012031:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.012039:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.012046:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dcc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760745.012050:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.012058:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.012089:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.012097:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b763a0/0xc2b9a3a739858292 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760745.012360:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777216512:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17757us (160052us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760745.012378:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:0.0:1789760745.012387:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421178648714 time 421178772572 state 0x2 ref 0 00000100:00100000:3.0:1789760745.026003:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760745.026762:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777216640 00000100:00100000:0.0:1789760745.026829:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777216640 00000100:00100000:0.0:1789760745.026886:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421178648714 time 421178772572 state 0x0 ref 1 00000100:00100000:0.0:1789760745.026901:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421378772572 time 421178772572 state 0x1 ref 1 00000100:00100000:0.0:1789760745.159391:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798221952:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159462:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159521:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798222464:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159547:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159567:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798222976:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159587:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159613:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789760745.159619:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798221568:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159647:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159667:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798222080:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159686:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159699:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798222592:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159715:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159738:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798223104:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159757:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159779:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798221824:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159820:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159835:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798222336:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159855:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159869:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798222848:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159902:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159922:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789760745.159927:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798221696:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159951:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159966:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798222208:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.159984:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.159997:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798222720:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160015:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760745.160037:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798221952 00000100:00100000:0.0:1789760745.160044:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798221952 00000100:00100000:0.0:1789760745.160092:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798222336 00000100:00100000:0.0:1789760745.160095:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798222336 00000100:00100000:0.0:1789760745.160121:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798222848 00000100:00100000:0.0:1789760745.160135:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798222848 00000100:00100000:0.0:1789760745.160150:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798221696 00000100:00100000:0.0:1789760745.160153:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798221696 00000100:00100000:0.0:1789760745.160163:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798222208 00000100:00100000:0.0:1789760745.160165:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798222208 00000100:00100000:0.0:1789760745.160175:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798222720 00000100:00100000:0.0:1789760745.160178:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798222720 00000100:00100000:0.0:1789760745.160195:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1789760745.160202:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798221952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160249:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798221952:12345-0@lo:400:kworker.0 Request processed in 47us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160257:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1789760745.160273:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1789760745.160278:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798222336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160307:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798222336:12345-0@lo:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160321:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1789760745.160334:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1789760745.160340:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798222848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160368:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798222848:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160374:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1789760745.160386:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789760745.160392:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798221696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160417:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798221696:12345-0@lo:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160422:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789760745.160433:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1789760745.160438:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798222208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160461:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798222208:12345-0@lo:400:kworker.0 Request processed in 23us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160466:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1789760745.160476:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1789760745.160481:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798222720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160501:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798222720:12345-0@lo:400:kworker.0 Request processed in 20us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160506:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1789760745.160522:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798222464 00000100:00100000:0.0:1789760745.160525:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798222464 00000100:00100000:0.0:1789760745.160545:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798222976 00000100:00100000:0.0:1789760745.160547:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798222976 00000100:00100000:0.0:1789760745.160570:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798222592 00000100:00100000:0.0:1789760745.160573:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798222592 00000100:00100000:0.0:1789760745.160583:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798223104 00000100:00100000:0.0:1789760745.160585:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798223104 00000100:00100000:0.0:1789760745.160597:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789760745.160602:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798222464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160633:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798222464:12345-0@lo:400:kworker.0 Request processed in 31us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160639:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789760745.160649:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789760745.160654:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798222976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160676:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798222976:12345-0@lo:400:kworker.0 Request processed in 23us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160682:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789760745.160690:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789760745.160695:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798222592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160714:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798222592:12345-0@lo:400:kworker.0 Request processed in 19us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160720:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789760745.160728:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789760745.160732:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798223104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160750:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798223104:12345-0@lo:400:kworker.0 Request processed in 18us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160756:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789760745.160771:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798221568 00000100:00100000:0.0:1789760745.160774:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798221568 00000100:00100000:0.0:1789760745.160820:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789760745.160832:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798221568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160863:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798221568:12345-0@lo:400:kworker.0 Request processed in 32us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160870:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789760745.160898:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798222080 00000100:00100000:0.0:1789760745.160902:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798222080 00000100:00100000:0.0:1789760745.160922:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798221824 00000100:00100000:0.0:1789760745.160924:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798221824 00000100:00100000:0.0:1789760745.160935:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789760745.160940:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798222080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.160967:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798222080:12345-0@lo:400:kworker.0 Request processed in 27us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.160973:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789760745.160982:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789760745.160987:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798221824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161007:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798221824:12345-0@lo:400:kworker.0 Request processed in 21us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760745.161012:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:0.0:1789760745.161041:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760745.161045:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760745.161047:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760745.161049:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760745.161100:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798221696:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161114:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798222208:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161125:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798222720:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161136:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798221824:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161157:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798222336:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161166:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798222848:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161221:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798221568:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161231:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798222080:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161240:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798222592:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161250:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798223104:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161260:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798221952:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161269:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798222464:0@lo:400:kworker.0 00000100:00100000:0.0:1789760745.161278:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798222976:0@lo:400:kworker.0 00000100:00100000:2.0:1789760745.161682:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760745.161695:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798223232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760745.161751:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760745.161941:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798223232 00000100:00100000:3.0:1789760745.161947:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798223232 00000100:00100000:3.0:1789760745.161989:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789760745.161998:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798223232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760745.162033:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760745.162093:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798223232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760745.162099:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789760745.162665:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798223232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760745.163818:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798223360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760745.163878:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760745.164095:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798223360 00000100:00100000:1.0:1789760745.164102:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798223360 00000100:00100000:1.0:1789760745.164164:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789760745.164174:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798223360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760745.164194:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760745.172279:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798223360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8097us (8390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760745.172293:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789760745.172809:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798223360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760745.194688:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421378772572 time 421378887283 state 0x0 ref 1 00000100:00100000:0.0:1789760745.194722:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777216640:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760745.194764:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.194782:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760745.194828:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760745.194835:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.194851:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.220160:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.220185:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.220195:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.220203:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760745.220208:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.220218:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.220250:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.220260:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858299 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760745.220369:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777216640:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25657us (194370us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760745.220381:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:0.0:1789760745.220409:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421378772572 time 421378887283 state 0x2 ref 0 00000100:00100000:1.0:1789760745.233207:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760745.233519:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777216768 00000100:00100000:0.0:1789760745.233532:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777216768 00000100:00100000:0.0:1789760745.233605:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421378772572 time 421378887283 state 0x0 ref 1 00000100:00100000:0.0:1789760745.233621:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421578887283 time 421378887283 state 0x1 ref 1 00000100:00100000:2.0:1789760745.394882:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421578887283 time 421579078650 state 0x0 ref 1 00000100:00100000:2.0:1789760745.394923:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777216768:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760745.394973:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.394990:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760745.394993:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760745.395000:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.395043:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.423346:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.423373:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.423382:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.423390:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760745.423396:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.423406:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.423431:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760745.423439:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760745.423570:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777216768:12345-192.168.203.38@tcp:3:dd.500 Request processed in 28662us (190372us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760745.423582:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:2.0:1789760745.423592:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421578887283 time 421579078650 state 0x2 ref 0 00000100:00100000:1.0:1789760745.432649:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760745.432767:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777216896 00000100:00100000:0.0:1789760745.432781:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777216896 00000100:00100000:0.0:1789760745.432907:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421578887283 time 421579078650 state 0x0 ref 1 00000100:00100000:0.0:1789760745.432923:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421779078650 time 421579078650 state 0x1 ref 1 00000100:00100000:0.0:1789760745.595104:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421779078650 time 421779295951 state 0x0 ref 1 00000100:00100000:0.0:1789760745.595154:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777216896:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760745.595212:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.595235:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760745.595241:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760745.595250:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.595268:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.611109:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.611164:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.611173:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.611182:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760745.611188:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.611211:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.611238:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.611247:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760745.611374:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777216896:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16239us (178747us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760745.611386:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:0.0:1789760745.611396:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421779078650 time 421779295951 state 0x2 ref 0 00000100:00100000:3.0:1789760745.620404:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760745.622666:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777217024 00000100:00100000:0.0:1789760745.622891:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777217024 00000100:00100000:0.0:1789760745.622979:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421779078650 time 421779295951 state 0x0 ref 1 00000100:00100000:0.0:1789760745.622997:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421979295951 time 421779295951 state 0x1 ref 1 00000100:00100000:1.0:1789760745.675005:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760745.675038:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798223488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760745.675149:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760745.675715:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798223488 00000100:00100000:2.0:1789760745.675738:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798223488 00000100:00100000:2.0:1789760745.675824:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789760745.675836:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798223488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760745.675888:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760745.675967:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798223488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760745.675974:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789760745.676058:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798223488:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1789760745.746409:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:1.0:1789760745.746420:0:9084:0:(genops.c:885:class_export_put()) final put ffff97e54991b800/ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:0.0:1789760745.746487:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97e54991b800/ac82f857-edfe-4201-bbe8-4599ba569acb for lustre-OST0001 00000020:00000080:0.0:1789760745.746537:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e54991f800 for lustre-OST0001 00000100:00100000:0.0:1789760745.795216:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421979295951 time 421979415811 state 0x0 ref 1 00000100:00100000:0.0:1789760745.795258:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777217024:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760745.795305:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.795322:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760745.795326:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760745.795332:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.795347:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.808290:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.808310:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.808319:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.808341:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760745.808347:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.808355:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.808376:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760745.808384:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d941ac68/0xc2b9a3a7398582ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760745.808481:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777217024:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13244us (188090us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760745.808491:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:0.0:1789760745.808499:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421979295951 time 421979415811 state 0x2 ref 0 00000100:00100000:1.0:1789760745.814884:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760745.818995:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777217152 00000100:00100000:2.0:1789760745.819010:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777217152 00000100:00100000:2.0:1789760745.819192:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 421979295951 time 421979415811 state 0x0 ref 1 00000100:00100000:2.0:1789760745.819208:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422179415811 time 421979415811 state 0x1 ref 1 00010000:00010000:1.0:1789760745.991314:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760745.998325:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422179415811 time 422182521290 state 0x0 ref 1 00000100:00100000:3.0:1789760745.998361:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777217152:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760745.998420:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.998437:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760745.998444:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760745.998449:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760745.998463:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.034481:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.034516:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.034526:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.034534:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dce00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760746.034540:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.034561:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.034616:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.034624:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.034749:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777217152:12345-192.168.203.38@tcp:3:dd.500 Request processed in 36398us (219872us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760746.034761:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 165 00000100:00100000:3.0:1789760746.034771:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422179415811 time 422182521290 state 0x2 ref 0 00000100:00100000:1.0:1789760746.044648:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760746.045008:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777217280 00000100:00100000:2.0:1789760746.045023:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777217280 00000100:00100000:2.0:1789760746.045114:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422179415811 time 422182521290 state 0x0 ref 1 00000100:00100000:2.0:1789760746.045127:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422382521290 time 422182521290 state 0x1 ref 1 00000100:00080000:0.0:1789760746.045400:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760746.183315:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760746.183346:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798223616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760746.183443:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760746.183509:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798223616 00000100:00100000:0.0:1789760746.183533:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798223616 00000100:00100000:0.0:1789760746.183600:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789760746.183609:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798223616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760746.183649:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760746.183740:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798223616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760746.183760:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789760746.183902:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798223616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789760746.198567:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422382521290 time 422382766929 state 0x0 ref 1 00000100:00100000:1.0:1789760746.198600:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777217280:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760746.198644:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760746.198661:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760746.198665:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760746.198671:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760746.198686:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.224563:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.224582:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.224592:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.224600:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760746.224619:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.224628:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.224649:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.224657:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6ad57c9/0xc2b9a3a7398582bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.224755:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777217280:12345-192.168.203.38@tcp:3:dd.500 Request processed in 26166us (180230us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760746.224765:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:3.0:1789760746.224773:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422382521290 time 422382766929 state 0x2 ref 0 00000100:00100000:1.0:1789760746.232730:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760746.232826:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777217408 00000100:00100000:0.0:1789760746.232836:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777217408 00000100:00100000:0.0:1789760746.232889:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422382521290 time 422382766929 state 0x0 ref 1 00000100:00100000:0.0:1789760746.232902:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422582766929 time 422382766929 state 0x1 ref 1 00000100:00100000:0.0:1789760746.398679:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422582766929 time 422582880128 state 0x0 ref 1 00000100:00100000:0.0:1789760746.398711:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777217408:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760746.398761:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.398778:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760746.398782:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760746.399090:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.399110:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.459762:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.459882:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.459915:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.459924:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac90e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760746.459929:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.459938:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.459958:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760746.459967:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003b16c0f/0xc2b9a3a7398582c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760746.460085:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777217408:12345-192.168.203.38@tcp:3:dd.500 Request processed in 61384us (227368us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760746.460094:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 167 00000100:00100000:0.0:1789760746.460102:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422582766929 time 422582880128 state 0x2 ref 0 00000100:00100000:0.0:1789760746.469402:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760746.469530:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777217536 00000100:00100000:3.0:1789760746.469540:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777217536 00000100:00100000:3.0:1789760746.469606:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422582766929 time 422582880128 state 0x0 ref 1 00000100:00100000:3.0:1789760746.469618:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422782880128 time 422582880128 state 0x1 ref 1 00000100:00100000:2.0:1789760746.598887:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422782880128 time 422783087883 state 0x0 ref 1 00000100:00100000:2.0:1789760746.598933:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777217536:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760746.598974:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.599002:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760746.599006:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760746.599012:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.599026:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.607489:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.607510:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.607529:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.607537:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760746.607541:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.607550:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.607583:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.607591:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760746.607727:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777217536:12345-192.168.203.38@tcp:3:dd.500 Request processed in 8801us (138329us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760746.607737:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:2.0:1789760746.607744:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422782880128 time 422783087883 state 0x2 ref 0 00000100:00100000:0.0:1789760746.617938:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760746.618018:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777217664 00000100:00100000:3.0:1789760746.618029:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777217664 00000100:00100000:3.0:1789760746.618097:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422782880128 time 422783087883 state 0x0 ref 1 00000100:00100000:3.0:1789760746.618110:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422983087883 time 422783087883 state 0x1 ref 1 00000100:00100000:2.0:1789760746.695265:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760746.695289:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798223744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760746.695356:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760746.695414:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798223744 00000100:00100000:1.0:1789760746.695422:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798223744 00000100:00100000:2.0:1789760746.695422:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798223872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760746.695444:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760746.695466:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798223872 00000100:00100000:1.0:1789760746.695469:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798223872 00000100:00100000:1.0:1789760746.695485:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789760746.695493:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798223744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789760746.695527:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:1.0:1789760746.695582:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798223744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760746.695645:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798223744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760746.699374:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789760746.699400:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798223872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760746.699430:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789760746.699512:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798223872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760746.699519:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789760746.700884:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798223872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760746.703724:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789760746.799096:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422983087883 time 422983296014 state 0x0 ref 1 00000100:00100000:3.0:1789760746.799132:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777217664:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760746.799177:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.799196:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.799200:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760746.799205:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.799219:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.820389:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.820425:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.820435:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.820442:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e4486dce00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760746.820448:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.820477:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.820504:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760746.820512:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7e2b51/0xc2b9a3a7398582d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760746.820859:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777217664:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21735us (202920us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760746.820871:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:3.0:1789760746.820882:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422983087883 time 422983296014 state 0x2 ref 0 00000100:00100000:1.0:1789760746.828182:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760746.828283:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777217792 00000100:00100000:3.0:1789760746.828298:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777217792 00000100:00100000:3.0:1789760746.828372:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 422983087883 time 422983296014 state 0x0 ref 1 00000100:00100000:3.0:1789760746.828389:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423183296014 time 422983296014 state 0x1 ref 1 00000100:00100000:2.0:1789760746.999327:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423183296014 time 423183526687 state 0x0 ref 1 00000100:00100000:2.0:1789760746.999362:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777217792:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760746.999420:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.999437:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760746.999441:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760746.999447:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760746.999462:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.013239:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.013262:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.013272:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.013280:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760747.013284:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.013293:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.013331:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.013340:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.013432:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777217792:12345-192.168.203.38@tcp:3:dd.500 Request processed in 14081us (185259us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760747.013442:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:2.0:1789760747.013450:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423183296014 time 423183526687 state 0x2 ref 0 00010000:00010000:1.0:1789760747.015514:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760747.029127:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760747.029724:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777217920 00000100:00100000:0.0:1789760747.029735:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777217920 00000100:00100000:0.0:1789760747.029817:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423183296014 time 423183526687 state 0x0 ref 1 00000100:00100000:0.0:1789760747.029846:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423383526687 time 423183526687 state 0x1 ref 1 00000100:00100000:0.0:1789760747.199439:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423383526687 time 423383640587 state 0x0 ref 1 00000100:00100000:0.0:1789760747.199469:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777217920:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760747.199509:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.199526:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760747.199530:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760747.199536:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.199613:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.218629:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.218649:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.218658:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.218665:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f522400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760747.218670:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.218692:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.218721:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.218729:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760747.218860:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777217920:12345-192.168.203.38@tcp:3:dd.500 Request processed in 19399us (189737us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760747.218869:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:0.0:1789760747.218877:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423383526687 time 423383640587 state 0x2 ref 0 00000100:00100000:0.0:1789760747.224723:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760747.224813:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777218048 00000100:00100000:2.0:1789760747.224830:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777218048 00000100:00100000:2.0:1789760747.224885:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423383526687 time 423383640587 state 0x0 ref 1 00000100:00100000:2.0:1789760747.224898:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423583640587 time 423383640587 state 0x1 ref 1 00000100:00100000:2.0:1789760747.399514:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423583640587 time 423583714132 state 0x0 ref 1 00000100:00100000:2.0:1789760747.399547:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777218048:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760747.399590:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.399608:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760747.399612:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760747.399618:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.399647:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.410088:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.410108:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.410117:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.410125:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5461f4600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760747.410130:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.410139:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.410179:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.410186:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082235444/0xc2b9a3a7398582e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.410292:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777218048:12345-192.168.203.38@tcp:3:dd.500 Request processed in 10757us (185581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760747.410302:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:2.0:1789760747.410310:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423583640587 time 423583714132 state 0x2 ref 0 00000100:00100000:3.0:1789760747.419783:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760747.419994:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777218176 00000100:00100000:0.0:1789760747.420003:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777218176 00000100:00100000:0.0:1789760747.420052:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423583640587 time 423583714132 state 0x0 ref 1 00000100:00100000:0.0:1789760747.420071:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423783714132 time 423583714132 state 0x1 ref 1 00000100:00100000:0.0:1789760747.600015:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423783714132 time 423784215426 state 0x0 ref 1 00000100:00100000:0.0:1789760747.600676:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777218176:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760747.600994:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.601096:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760747.601103:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760747.601110:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.601233:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.624088:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.624109:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.624120:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.624128:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f522400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760747.624134:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.624144:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.624164:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.624191:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a7398582ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760747.624282:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777218176:12345-192.168.203.38@tcp:3:dd.500 Request processed in 24244us (204502us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760747.624292:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:0.0:1789760747.624301:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423783714132 time 423784215426 state 0x2 ref 0 00000100:00100000:3.0:1789760747.632606:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760747.632710:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777218304 00000100:00100000:2.0:1789760747.632728:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777218304 00000100:00100000:2.0:1789760747.632781:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423783714132 time 423784215426 state 0x0 ref 1 00000100:00100000:2.0:1789760747.632824:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423984215426 time 423784215426 state 0x1 ref 1 00000100:00100000:3.0:1789760747.800123:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423984215426 time 423984322439 state 0x0 ref 1 00000100:00100000:3.0:1789760747.800157:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777218304:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760747.800213:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.800230:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.800235:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760747.800241:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.800256:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.810866:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.810887:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.810897:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.810905:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f520c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760747.810910:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.810919:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.810955:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.810963:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc4a61b/0xc2b9a3a7398582f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.811048:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777218304:12345-192.168.203.38@tcp:3:dd.500 Request processed in 10902us (178446us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760747.811069:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:2.0:1789760747.811076:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423984215426 time 423984322439 state 0x2 ref 0 00000100:00100000:3.0:1789760747.816159:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760747.817859:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777218432 00000100:00100000:0.0:1789760747.817872:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777218432 00000100:00100000:0.0:1789760747.817924:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 423984215426 time 423984322439 state 0x0 ref 1 00000100:00100000:0.0:1789760747.817937:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424184322439 time 423984322439 state 0x1 ref 1 00000100:00100000:3.0:1789760748.002619:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424184322439 time 424186819543 state 0x0 ref 1 00000100:00100000:3.0:1789760748.002674:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777218432:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760748.002714:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.002729:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760748.002732:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.002737:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.002753:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760748.005696:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760748.020295:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.020314:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.020323:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.020330:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f520000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760748.020335:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.020377:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.020397:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.020405:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4211cac/0xc2b9a3a7398582fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760748.020512:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777218432:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17870us (204355us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760748.020523:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 175 00000100:00100000:0.0:1789760748.020541:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424184322439 time 424186819543 state 0x2 ref 0 00000100:00100000:1.0:1789760748.027999:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760748.028119:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777218560 00000100:00100000:2.0:1789760748.028130:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777218560 00000100:00100000:2.0:1789760748.028182:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424184322439 time 424186819543 state 0x0 ref 1 00000100:00100000:2.0:1789760748.028193:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424386819543 time 424186819543 state 0x1 ref 1 00010000:00010000:3.0:1789760748.039100:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760748.083159:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760748.083200:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760748.083253:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760748.083285:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760748.083333:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760748.083430:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777218816 00000100:00100000:1.0:1789760748.083441:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777218816 00000100:00100000:2.0:1789760748.083444:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777218688 00000100:00100000:2.0:1789760748.083448:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777218688 00000100:00100000:2.0:1789760748.083491:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 380 00000100:00100000:1.0:1789760748.083494:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777219072 00000100:00100000:1.0:1789760748.083496:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777219072 00000100:00100000:2.0:1789760748.083501:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777218688:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760748.083508:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777218944 00000100:00100000:1.0:1789760748.083510:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777218944 00000100:00100000:1.0:1789760748.083521:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777219200 00000100:00100000:1.0:1789760748.083524:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777219200 00000100:00100000:1.0:1789760748.083537:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 428 00000100:00100000:1.0:1789760748.083553:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777218816:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760748.083572:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777218688:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760748.083580:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 380 00000100:00100000:1.0:1789760748.083582:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777218816:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.083588:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 428 00000100:00100000:1.0:1789760748.083599:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 429 00000100:00100000:1.0:1789760748.083605:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777219072:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760748.083627:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777219072:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.083633:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 429 00000100:00100000:1.0:1789760748.083645:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 430 00000100:00100000:1.0:1789760748.083650:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777218944:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760748.083673:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777218944:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.083677:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 430 00000100:00100000:1.0:1789760748.083687:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 431 00000100:00100000:1.0:1789760748.083693:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777219200:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760748.083722:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777219200:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.083735:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 431 00000100:00080000:3.0:1789760748.084556:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760748.084562:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760748.205218:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424386819543 time 424389417912 state 0x0 ref 1 00000100:00100000:3.0:1789760748.205253:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777218560:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760748.205297:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.205314:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.205318:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760748.205324:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.205338:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.234407:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.234427:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.234437:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.234458:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f520e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760748.234464:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.234474:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.234495:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.234503:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9260c45/0xc2b9a3a739858302 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.234588:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777218560:12345-192.168.203.38@tcp:3:dd.500 Request processed in 29347us (206593us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760748.234599:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:3.0:1789760748.234607:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424386819543 time 424389417912 state 0x2 ref 0 00000100:00100000:3.0:1789760748.240267:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760748.240432:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777219328 00000100:00100000:0.0:1789760748.240442:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777219328 00000100:00100000:0.0:1789760748.240495:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424386819543 time 424389417912 state 0x0 ref 1 00000100:00100000:0.0:1789760748.240507:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424589417912 time 424389417912 state 0x1 ref 1 00000100:00100000:0.0:1789760748.405485:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424589417912 time 424589685299 state 0x0 ref 1 00000100:00100000:0.0:1789760748.405515:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777219328:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760748.405556:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.405591:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760748.405595:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760748.405601:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.405615:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.417578:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.417598:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.417608:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.417616:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f522400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760748.417621:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.417631:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.417650:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.417676:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858309 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760748.417767:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777219328:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12256us (177500us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760748.417777:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:0.0:1789760748.417784:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424589417912 time 424589685299 state 0x2 ref 0 00000100:00100000:1.0:1789760748.423441:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760748.423530:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777219456 00000100:00100000:2.0:1789760748.423540:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777219456 00000100:00100000:2.0:1789760748.423604:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424589417912 time 424589685299 state 0x0 ref 1 00000100:00100000:2.0:1789760748.423617:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424789685299 time 424589685299 state 0x1 ref 1 00000100:00100000:2.0:1789760748.605760:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424789685299 time 424789959602 state 0x0 ref 1 00000100:00100000:2.0:1789760748.605847:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777219456:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760748.605892:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.605910:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760748.605915:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760748.605921:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.605936:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.623340:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.623361:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.623370:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.623378:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ee00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760748.623397:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.623408:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.623429:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.623438:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a739858310 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760748.623566:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777219456:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17775us (200129us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760748.623586:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:2.0:1789760748.623594:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424789685299 time 424789959602 state 0x2 ref 0 00000100:00100000:1.0:1789760748.636898:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760748.637169:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777219584 00000100:00100000:0.0:1789760748.637180:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777219584 00000100:00100000:0.0:1789760748.637235:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424789685299 time 424789959602 state 0x0 ref 1 00000100:00100000:0.0:1789760748.637246:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424989959602 time 424789959602 state 0x1 ref 1 00000100:00100000:0.0:1789760748.805889:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424989959602 time 424990083581 state 0x0 ref 1 00000100:00100000:0.0:1789760748.805924:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777219584:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760748.805971:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.805987:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760748.805997:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760748.806003:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.806017:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.826860:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.826879:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.826888:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.826910:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f522400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760748.826915:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.826923:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.826943:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.827109:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858317 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.827472:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777219584:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21561us (190579us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760748.827483:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:3.0:1789760748.827490:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424989959602 time 424990083581 state 0x2 ref 0 00000100:00100000:1.0:1789760748.838929:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760748.839071:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777219712 00000100:00100000:3.0:1789760748.839081:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777219712 00000100:00100000:3.0:1789760748.839137:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 424989959602 time 424990083581 state 0x0 ref 1 00000100:00100000:3.0:1789760748.839150:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425190083581 time 424990083581 state 0x1 ref 1 00000100:00100000:2.0:1789760749.007246:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425190083581 time 425191446521 state 0x0 ref 1 00000100:00100000:2.0:1789760749.007278:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777219712:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760749.007317:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.007333:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760749.007336:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760749.007524:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.007558:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.019257:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.019296:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.019303:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.019308:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8ee00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760749.019311:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.019317:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.019334:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.019342:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1751bca/0xc2b9a3a73985831e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760749.019441:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777219712:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12173us (180519us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760749.019451:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:3.0:1789760749.019459:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425190083581 time 425191446521 state 0x2 ref 0 00000100:00100000:1.0:1789760749.029308:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760749.029384:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777219840 00000100:00100000:0.0:1789760749.029394:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777219840 00000100:00100000:0.0:1789760749.029449:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425190083581 time 425191446521 state 0x0 ref 1 00000100:00100000:0.0:1789760749.029462:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425391446521 time 425191446521 state 0x1 ref 1 00010000:00010000:1.0:1789760749.065365:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760749.207353:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425391446521 time 425391553542 state 0x0 ref 1 00000100:00100000:2.0:1789760749.207389:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777219840:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760749.207434:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.207452:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760749.207457:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760749.207463:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.207477:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.218515:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.218546:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.218555:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.218584:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fa00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760749.218589:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.218598:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.218618:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760749.218625:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858325 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760749.218709:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777219840:12345-192.168.203.38@tcp:3:dd.500 Request processed in 11333us (189405us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760749.218719:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:2.0:1789760749.218726:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425391446521 time 425391553542 state 0x2 ref 0 00000100:00100000:0.0:1789760749.232927:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760749.233201:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777219968 00000100:00100000:2.0:1789760749.233211:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777219968 00000100:00100000:2.0:1789760749.233262:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425391446521 time 425391553542 state 0x0 ref 1 00000100:00100000:2.0:1789760749.233275:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425591553542 time 425391553542 state 0x1 ref 1 00000100:00100000:0.0:1789760749.407524:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425591553542 time 425591724485 state 0x0 ref 1 00000100:00100000:0.0:1789760749.407679:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777219968:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760749.407733:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.407750:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760749.407908:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760749.407916:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.407994:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.445270:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.445303:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.445312:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.445320:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760749.445324:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.445333:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.445352:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.445359:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a73985832c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760749.445438:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777219968:12345-192.168.203.38@tcp:3:dd.500 Request processed in 37881us (212516us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760749.445447:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:3.0:1789760749.445454:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425591553542 time 425591724485 state 0x2 ref 0 00000100:00100000:0.0:1789760749.455175:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760749.455308:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777220096 00000100:00100000:3.0:1789760749.455384:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777220096 00000100:00100000:3.0:1789760749.455434:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425591553542 time 425591724485 state 0x0 ref 1 00000100:00100000:3.0:1789760749.455447:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425791724485 time 425591724485 state 0x1 ref 1 00000100:00100000:0.0:1789760749.608029:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425791724485 time 425792230105 state 0x0 ref 1 00000100:00100000:0.0:1789760749.608081:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777220096:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760749.608123:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.608152:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760749.608157:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760749.608162:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.608177:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.634527:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.634547:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.634557:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.634565:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548543c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760749.634570:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.634579:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.634599:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760749.634608:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f2d00c/0xc2b9a3a739858333 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760749.634690:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777220096:12345-192.168.203.38@tcp:3:dd.500 Request processed in 26628us (179626us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760749.634713:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:3.0:1789760749.634720:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425791724485 time 425792230105 state 0x2 ref 0 00000100:00100000:1.0:1789760749.644909:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760749.646622:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777220224 00000100:00100000:3.0:1789760749.646636:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777220224 00000100:00100000:3.0:1789760749.646690:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425791724485 time 425792230105 state 0x0 ref 1 00000100:00100000:3.0:1789760749.646703:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425992230105 time 425792230105 state 0x1 ref 1 00000100:00100000:1.0:1789760749.808202:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425992230105 time 425992401807 state 0x0 ref 1 00000100:00100000:1.0:1789760749.808238:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777220224:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760749.808286:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760749.808304:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760749.808309:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760749.808316:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760749.808331:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.818854:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.818879:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.818887:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.818895:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f532000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760749.818899:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.818908:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.818932:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760749.818958:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059817262/0xc2b9a3a73985833a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760749.819050:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777220224:12345-192.168.203.38@tcp:3:dd.500 Request processed in 10819us (174139us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760749.819060:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:0.0:1789760749.819068:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425992230105 time 425992401807 state 0x2 ref 0 00000100:00100000:3.0:1789760749.825128:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760749.826116:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777220352 00000100:00100000:2.0:1789760749.826127:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777220352 00000100:00100000:2.0:1789760749.826183:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 425992230105 time 425992401807 state 0x0 ref 1 00000100:00100000:2.0:1789760749.826212:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426192401807 time 425992401807 state 0x1 ref 1 00000100:00100000:2.0:1789760750.008321:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426192401807 time 426192520396 state 0x0 ref 1 00000100:00100000:2.0:1789760750.008376:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777220352:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760750.008435:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.008453:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760750.008457:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760750.008463:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.008477:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760750.008682:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760750.022179:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.022203:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.022212:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.022220:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fa00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760750.022226:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.022251:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.022274:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.022282:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a739858341 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760750.023089:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777220352:12345-192.168.203.38@tcp:3:dd.500 Request processed in 14743us (197965us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760750.023101:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:2.0:1789760750.023110:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426192401807 time 426192520396 state 0x2 ref 0 00000100:00100000:3.0:1789760750.032501:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760750.035627:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777220480 00000100:00100000:0.0:1789760750.035643:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777220480 00000100:00100000:0.0:1789760750.035717:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426192401807 time 426192520396 state 0x0 ref 1 00000100:00100000:0.0:1789760750.035733:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426392520396 time 426192520396 state 0x1 ref 1 00010000:00010000:1.0:1789760750.086956:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760750.208584:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426392520396 time 426392783961 state 0x0 ref 1 00000100:00100000:1.0:1789760750.208618:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777220480:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760750.208659:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.208689:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760750.208694:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760750.208701:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.208715:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.221072:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.221099:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.221109:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.221117:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760750.221122:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.221129:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.221147:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.221166:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d58dbb1/0xc2b9a3a739858348 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760750.221248:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777220480:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12641us (188752us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760750.221259:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:1.0:1789760750.221275:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426392520396 time 426392783961 state 0x2 ref 0 00000100:00100000:3.0:1789760750.231741:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760750.233578:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777220608 00000100:00100000:0.0:1789760750.233591:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777220608 00000100:00100000:0.0:1789760750.233648:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426392520396 time 426392783961 state 0x0 ref 1 00000100:00100000:0.0:1789760750.233661:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426592783961 time 426392783961 state 0x1 ref 1 00000100:00100000:3.0:1789760750.279572:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798224384:0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.279664:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.279735:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798224896:0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.279762:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.279782:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798225408:0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.279826:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.279851:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789760750.279856:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798224256:0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.279877:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.279891:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798224768:0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.279909:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.279923:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798225280:0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.279940:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.279963:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798225792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760750.279983:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.280008:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798224384 00000100:00100000:3.0:1789760750.280015:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798224384 00000100:00100000:3.0:1789760750.280066:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798224768 00000100:00100000:3.0:1789760750.280070:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798224768 00000100:00100000:3.0:1789760750.280095:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798225280 00000100:00100000:3.0:1789760750.280098:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798225280 00000100:00100000:3.0:1789760750.280114:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789760750.280132:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798224384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.280179:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798224384:12345-0@lo:400:kworker.0 Request processed in 48us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.280186:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789760750.280201:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1789760750.280207:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798224768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.280233:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798224768:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.280239:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1789760750.280249:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1789760750.280256:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798225280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.280282:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798225280:12345-0@lo:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.280288:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1789760750.280304:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798225792 00000100:00100000:3.0:1789760750.280307:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798225792 00000100:00100000:3.0:1789760750.280331:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789760750.280337:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798225792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760750.280370:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760750.280400:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798225792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.280406:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1789760750.280424:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760750.280429:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760750.280485:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798224768:0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.280495:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798225280:0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.280507:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798225792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760750.280516:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798224384:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.280599:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798224128:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.280631:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760750.280652:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798224640:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.280672:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760750.280687:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798225152:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.280706:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760750.280720:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798225664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760750.280738:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760750.280754:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789760750.280760:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798224000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.280784:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760750.280823:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798224512:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.280853:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760750.280866:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798225024:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.280884:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.281986:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798224256 00000100:00100000:3.0:1789760750.281996:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798224256 00000100:00100000:3.0:1789760750.282049:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798224512 00000100:00100000:3.0:1789760750.282052:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798224512 00000100:00100000:3.0:1789760750.282069:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789760750.282077:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798224256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.282146:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798224256:12345-0@lo:400:kworker.0 Request processed in 69us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.282153:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789760750.282167:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789760750.282173:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565e38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798224512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.282197:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565e38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798224512:12345-0@lo:400:kworker.0 Request processed in 25us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.282203:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789760750.282433:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798224128 00000100:00100000:3.0:1789760750.282446:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798224128 00000100:00100000:3.0:1789760750.282467:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798224640 00000100:00100000:3.0:1789760750.282470:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798224640 00000100:00100000:3.0:1789760750.282492:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798225152 00000100:00100000:3.0:1789760750.282495:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798225152 00000100:00100000:3.0:1789760750.283047:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789760750.283057:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798224128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.283100:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798224128:12345-0@lo:400:kworker.0 Request processed in 46us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.283107:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789760750.283119:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789760750.283125:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798224640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.283148:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798224640:12345-0@lo:400:kworker.0 Request processed in 24us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.283154:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789760750.283163:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1789760750.283169:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798225152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760750.283191:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798225152:12345-0@lo:400:kworker.0 Request processed in 22us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.283196:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00080000:3.0:1789760750.283219:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760750.283257:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798224256:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.283974:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798225536:0@lo:400:kworker.0 00000100:00100000:1.0:1789760750.284014:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760750.294937:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798224896 00000100:00100000:0.0:1789760750.294950:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798224896 00000100:00100000:0.0:1789760750.295028:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798225408 00000100:00100000:0.0:1789760750.295032:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798225408 00000100:00100000:0.0:1789760750.295057:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798225024 00000100:00100000:0.0:1789760750.295059:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798225024 00000100:00100000:0.0:1789760750.295072:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798225536 00000100:00100000:0.0:1789760750.295075:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798225536 00000100:00100000:0.0:1789760750.295094:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789760750.295116:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798224896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295206:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798224896:12345-0@lo:400:kworker.0 Request processed in 91us (15442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760750.295214:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789760750.295230:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789760750.295237:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798225408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295264:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798225408:12345-0@lo:400:kworker.0 Request processed in 28us (15437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760750.295270:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789760750.295280:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789760750.295285:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798225024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295312:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798225024:12345-0@lo:400:kworker.0 Request processed in 27us (14427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760750.295318:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789760750.295328:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789760750.295333:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798225536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295357:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798225536:12345-0@lo:400:kworker.0 Request processed in 24us (11343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760750.295363:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1789760750.295387:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760750.295391:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760750.295428:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798224896:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295439:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798225408:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295488:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798224000 00000100:00100000:0.0:1789760750.295492:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798224000 00000100:00100000:0.0:1789760750.295536:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789760750.295543:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798224000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295574:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e544988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798224000:12345-0@lo:400:kworker.0 Request processed in 31us (14789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760750.295579:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789760750.295606:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798225664 00000100:00100000:0.0:1789760750.295609:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798225664 00000100:00100000:0.0:1789760750.295632:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789760750.295638:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798225664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760750.295651:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760750.295679:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798225664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (14940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760750.295686:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789760750.295735:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798225536:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295747:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798224128:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295759:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798224640:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295770:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798225152:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295785:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798225664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760750.295842:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798224000:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295855:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798224512:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.295866:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798225024:0@lo:400:kworker.0 00000100:00100000:0.0:1789760750.408704:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426592783961 time 426592895306 state 0x0 ref 1 00000100:00100000:0.0:1789760750.408750:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777220608:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760750.408997:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760750.409014:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760750.409018:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760750.409024:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760750.409046:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.456472:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.456491:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.456501:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.456522:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760750.456527:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.456537:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.456560:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760750.456567:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed8c714/0xc2b9a3a73985834f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760750.456661:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777220608:12345-192.168.203.38@tcp:3:dd.500 Request processed in 47920us (224924us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760750.456671:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:1.0:1789760750.456698:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426592783961 time 426592895306 state 0x2 ref 0 00000100:00100000:0.0:1789760750.466698:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760750.466832:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777220736 00000100:00100000:1.0:1789760750.466842:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777220736 00000100:00100000:1.0:1789760750.466895:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426592783961 time 426592895306 state 0x0 ref 1 00000100:00100000:1.0:1789760750.466909:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426792895306 time 426592895306 state 0x1 ref 1 00000100:00100000:0.0:1789760750.608916:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426792895306 time 426793115443 state 0x0 ref 1 00000100:00100000:0.0:1789760750.608953:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777220736:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760750.608996:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760750.609013:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760750.609018:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760750.609025:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760750.609048:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.620782:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.620833:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.620843:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.620850:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f522400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760750.620855:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.620879:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.620900:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.620909:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5465423/0xc2b9a3a739858356 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760750.620992:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777220736:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12053us (154308us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760750.621003:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:2.0:1789760750.621010:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426792895306 time 426793115443 state 0x2 ref 0 00000100:00100000:3.0:1789760750.628564:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760750.629538:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777220864 00000100:00100000:2.0:1789760750.629549:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777220864 00000100:00100000:2.0:1789760750.629613:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426792895306 time 426793115443 state 0x0 ref 1 00000100:00100000:2.0:1789760750.629626:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426993115443 time 426793115443 state 0x1 ref 1 00000100:00100000:3.0:1789760750.792872:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798225920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760750.792992:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760750.793498:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798225920 00000100:00100000:3.0:1789760750.793508:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798225920 00000100:00100000:3.0:1789760750.793681:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789760750.793697:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798225920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789760750.793737:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789760750.793812:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798225920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760750.793821:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789760750.793933:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798225920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760750.809019:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426993115443 time 426993220302 state 0x0 ref 1 00000100:00100000:3.0:1789760750.809064:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777220864:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760750.809105:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.809135:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.809139:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760750.809144:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760750.809157:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.828001:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.828021:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.828044:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.828069:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760750.828074:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.828083:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.828106:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760750.828113:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5a687ed/0xc2b9a3a73985835d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760750.828215:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777220864:12345-192.168.203.38@tcp:3:dd.500 Request processed in 19164us (199657us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760750.828224:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:2.0:1789760750.828232:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426993115443 time 426993220302 state 0x2 ref 0 00000100:00100000:3.0:1789760750.839846:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760750.839906:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777220992 00000100:00100000:1.0:1789760750.839917:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777220992 00000100:00100000:1.0:1789760750.839971:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 426993115443 time 426993220302 state 0x0 ref 1 00000100:00100000:1.0:1789760750.840038:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427193220302 time 426993220302 state 0x1 ref 1 00000100:00100000:3.0:1789760751.009271:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427193220302 time 427193471136 state 0x0 ref 1 00000100:00100000:3.0:1789760751.009304:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777220992:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760751.009348:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.009380:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760751.009384:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760751.009400:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.009416:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.037772:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.037817:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.037827:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.037854:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760751.037859:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.037869:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.037888:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.037896:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acb3a7f/0xc2b9a3a739858364 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760751.038246:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777220992:12345-192.168.203.38@tcp:3:dd.500 Request processed in 28952us (198410us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760751.038256:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:2.0:1789760751.038264:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427193220302 time 427193471136 state 0x2 ref 0 00000100:00100000:3.0:1789760751.052876:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760751.052968:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777221120 00000100:00100000:1.0:1789760751.052978:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777221120 00000100:00100000:1.0:1789760751.053041:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427193220302 time 427193471136 state 0x0 ref 1 00000100:00100000:1.0:1789760751.053054:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427393471136 time 427193471136 state 0x1 ref 1 00010000:00010000:3.0:1789760751.111290:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760751.210522:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427393471136 time 427394721937 state 0x0 ref 1 00000100:00100000:2.0:1789760751.210557:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777221120:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760751.210600:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.210617:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760751.210634:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760751.210640:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.210655:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.227745:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.227767:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.227777:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.227807:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e441f8fa00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760751.227813:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.227823:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.227843:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760751.227851:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ae81401/0xc2b9a3a73985836b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760751.228119:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777221120:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17574us (175247us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760751.228130:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:2.0:1789760751.228138:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427393471136 time 427394721937 state 0x2 ref 0 00000100:00100000:1.0:1789760751.247647:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760751.247747:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777221248 00000100:00100000:2.0:1789760751.247757:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777221248 00000100:00100000:2.0:1789760751.247828:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427393471136 time 427394721937 state 0x0 ref 1 00000100:00100000:2.0:1789760751.247840:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427594721937 time 427394721937 state 0x1 ref 1 00000100:00100000:2.0:1789760751.303035:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760751.303059:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798226048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760751.303134:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760751.303262:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798226048 00000100:00100000:1.0:1789760751.303270:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798226048 00000100:00100000:1.0:1789760751.303317:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789760751.303326:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798226048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789760751.303363:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789760751.303419:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798226048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760751.303426:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789760751.303522:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798226048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760751.410683:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427594721937 time 427594882143 state 0x0 ref 1 00000100:00100000:0.0:1789760751.410715:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777221248:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760751.410758:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.410773:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760751.410777:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760751.410782:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.410833:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.427209:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.427230:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.427239:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.427248:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8e600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760751.427253:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.427262:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.427303:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760751.427311:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013845068/0xc2b9a3a739858372 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760751.427450:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777221248:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16744us (179808us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760751.427462:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:3.0:1789760751.427470:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427594721937 time 427594882143 state 0x2 ref 0 00000100:00100000:1.0:1789760751.434069:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760751.434159:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777221376 00000100:00100000:2.0:1789760751.434169:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777221376 00000100:00100000:2.0:1789760751.434221:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427594721937 time 427594882143 state 0x0 ref 1 00000100:00100000:2.0:1789760751.434233:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427794882143 time 427594882143 state 0x1 ref 1 00000100:00100000:0.0:1789760751.610845:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427794882143 time 427795044350 state 0x0 ref 1 00000100:00100000:0.0:1789760751.610882:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777221376:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760751.610928:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.610947:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760751.610952:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760751.610959:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.610994:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.628680:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.628833:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.628843:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.628851:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760751.628856:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.628867:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.628888:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.628894:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858379 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760751.629192:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777221376:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18133us (194939us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760751.629205:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:0.0:1789760751.629212:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427794882143 time 427795044350 state 0x2 ref 0 00000100:00100000:3.0:1789760751.636493:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760751.636567:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777221504 00000100:00100000:2.0:1789760751.636578:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777221504 00000100:00100000:2.0:1789760751.636633:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427794882143 time 427795044350 state 0x0 ref 1 00000100:00100000:2.0:1789760751.636646:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427995044350 time 427795044350 state 0x1 ref 1 00000100:00100000:1.0:1789760751.814977:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760751.814980:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aaf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798226304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760751.815006:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798226176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760751.815062:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760751.815099:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760751.815143:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798226304 00000100:00100000:1.0:1789760751.815151:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798226176 00000100:00100000:3.0:1789760751.815151:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798226304 00000100:00100000:1.0:1789760751.815157:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798226176 00000100:00100000:3.0:1789760751.815200:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789760751.815211:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798226304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760751.815248:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789760751.815298:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798226304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760751.815306:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789760751.815339:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aaf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798226304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760751.815515:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427995044350 time 427999721018 state 0x0 ref 1 00000100:00100000:0.0:1789760751.815542:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777221504:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760751.815569:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.815585:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760751.815589:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760751.817594:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.817619:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760751.821445:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789760751.821466:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798226176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760751.821508:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:1.0:1789760751.821589:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798226176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (6490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760751.821597:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789760751.821847:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798226176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760751.856501:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.856633:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.856667:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.856738:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760751.856744:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.856754:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.856773:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760751.856780:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858380 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760751.856944:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777221504:12345-192.168.203.38@tcp:3:dd.500 Request processed in 41411us (220454us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760751.856955:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:0.0:1789760751.856963:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427995044350 time 427999721018 state 0x2 ref 0 00000100:00100000:1.0:1789760751.889684:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760751.889780:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777221632 00000100:00100000:2.0:1789760751.889829:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777221632 00000100:00100000:2.0:1789760751.889886:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 427995044350 time 427999721018 state 0x0 ref 1 00000100:00100000:2.0:1789760751.889899:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428199721018 time 427999721018 state 0x1 ref 1 00000100:00100000:0.0:1789760752.017196:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428199721018 time 428201395587 state 0x0 ref 1 00000100:00100000:0.0:1789760752.017256:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777221632:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760752.017301:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.017330:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760752.017334:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760752.017340:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.017355:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760752.017615:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760752.044893:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.044913:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.044921:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.044928:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760752.044933:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.044941:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.044960:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.044989:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0985e/0xc2b9a3a739858387 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760752.045097:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777221632:12345-192.168.203.38@tcp:3:dd.500 Request processed in 27878us (155418us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760752.045107:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:0.0:1789760752.045114:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428199721018 time 428201395587 state 0x2 ref 0 00000100:00100000:2.0:1789760752.049481:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760752.049574:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777221760 00000100:00100000:3.0:1789760752.049584:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777221760 00000100:00100000:3.0:1789760752.049652:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428199721018 time 428201395587 state 0x0 ref 1 00000100:00100000:3.0:1789760752.049665:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428401395587 time 428201395587 state 0x1 ref 1 00010000:00010000:1.0:1789760752.134924:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760752.219754:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428401395587 time 428403952942 state 0x0 ref 1 00000100:00100000:2.0:1789760752.219835:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777221760:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760752.219882:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760752.219900:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760752.219904:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760752.219911:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760752.219926:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.251070:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.251093:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.251102:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.251110:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f551400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760752.251115:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.251124:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.251146:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.251154:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a73985838e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760752.251259:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777221760:12345-192.168.203.38@tcp:3:dd.500 Request processed in 31480us (201782us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760752.251297:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:3.0:1789760752.251307:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428401395587 time 428403952942 state 0x2 ref 0 00000100:00100000:2.0:1789760752.263232:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760752.263324:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777221888 00000100:00100000:0.0:1789760752.263334:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777221888 00000100:00100000:0.0:1789760752.263387:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428401395587 time 428403952942 state 0x0 ref 1 00000100:00100000:0.0:1789760752.263401:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428603952942 time 428403952942 state 0x1 ref 1 00000100:00100000:1.0:1789760752.419963:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428603952942 time 428604159202 state 0x0 ref 1 00000100:00100000:1.0:1789760752.419999:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777221888:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760752.420056:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760752.420074:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760752.420079:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760752.420085:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760752.420099:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.442646:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.442666:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.442685:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.442693:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f55be00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760752.442698:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.442706:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.442726:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.442733:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001a8338f/0xc2b9a3a739858395 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760752.442868:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777221888:12345-192.168.203.38@tcp:3:dd.500 Request processed in 22881us (179642us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760752.442891:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:3.0:1789760752.442900:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428603952942 time 428604159202 state 0x2 ref 0 00000100:00100000:2.0:1789760752.451684:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760752.451825:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777222016 00000100:00100000:0.0:1789760752.451837:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777222016 00000100:00100000:0.0:1789760752.451889:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428603952942 time 428604159202 state 0x0 ref 1 00000100:00100000:0.0:1789760752.451901:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428804159202 time 428604159202 state 0x1 ref 1 00000100:00100000:0.0:1789760752.620084:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428804159202 time 428804285733 state 0x0 ref 1 00000100:00100000:0.0:1789760752.620116:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777222016:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760752.620161:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.620179:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760752.620196:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760752.620203:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.620218:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.635252:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.635272:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.635281:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.635289:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f53fa00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760752.635294:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.635302:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.635321:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.635328:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058a1abba/0xc2b9a3a73985839c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760752.635491:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777222016:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15386us (183825us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760752.635509:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:0.0:1789760752.635517:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428804159202 time 428804285733 state 0x2 ref 0 00000100:00100000:1.0:1789760752.643109:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760752.644977:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777222144 00000100:00100000:0.0:1789760752.644990:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777222144 00000100:00100000:0.0:1789760752.645054:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 428804159202 time 428804285733 state 0x0 ref 1 00000100:00100000:0.0:1789760752.645076:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429004285733 time 428804285733 state 0x1 ref 1 00000100:00100000:1.0:1789760752.820248:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429004285733 time 429004447017 state 0x0 ref 1 00000100:00100000:1.0:1789760752.820285:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777222144:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760752.820324:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760752.820342:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760752.820346:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760752.820352:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760752.820370:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.838662:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.838690:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.838699:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.838706:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f55b600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760752.838711:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.838721:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.838740:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.838748:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e94237a/0xc2b9a3a7398583a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760752.838866:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777222144:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18595us (195763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760752.838886:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:3.0:1789760752.838893:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429004285733 time 429004447017 state 0x2 ref 0 00000100:00100000:1.0:1789760752.849897:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760752.849975:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777222272 00000100:00100000:3.0:1789760752.849984:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777222272 00000100:00100000:3.0:1789760752.850042:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429004285733 time 429004447017 state 0x0 ref 1 00000100:00100000:3.0:1789760752.850055:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429204447017 time 429004447017 state 0x1 ref 1 00000100:00100000:2.0:1789760753.021046:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429204447017 time 429205243736 state 0x0 ref 1 00000100:00100000:2.0:1789760753.021091:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777222272:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760753.021134:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.021162:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760753.021166:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760753.021173:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.021188:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.041560:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.041580:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.041590:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.041597:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f550c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760753.041602:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.041612:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.041630:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.041657:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760753.041768:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777222272:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20689us (191875us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760753.041779:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:3.0:1789760753.041833:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429204447017 time 429205243736 state 0x2 ref 0 00000100:00100000:1.0:1789760753.057911:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760753.057995:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777222400 00000100:00100000:3.0:1789760753.058004:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777222400 00000100:00100000:3.0:1789760753.058081:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429204447017 time 429205243736 state 0x0 ref 1 00000100:00100000:3.0:1789760753.058093:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429405243736 time 429205243736 state 0x1 ref 1 00010000:00010000:1.0:1789760753.159456:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760753.198312:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760753.198352:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760753.198385:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777222656 00000100:00100000:0.0:1789760753.198395:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760753.198396:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777222656 00000100:00100000:0.0:1789760753.198424:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760753.198445:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760753.198452:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777222912 00000100:00100000:3.0:1789760753.198455:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777222912 00000100:00100000:3.0:1789760753.198468:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777222784 00000100:00100000:3.0:1789760753.198471:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777222784 00000100:00100000:0.0:1789760753.198482:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777223040 00000100:00100000:0.0:1789760753.198485:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777223040 00000100:00100000:3.0:1789760753.198488:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 438 00000100:00100000:3.0:1789760753.198497:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777222656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760753.198504:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 439 00000100:00100000:0.0:1789760753.198509:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777222912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760753.198611:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 440 00000100:00100000:1.0:1789760753.198621:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777222784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760753.198626:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777222656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760753.198632:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 438 00000100:00100000:1.0:1789760753.198647:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777222784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760753.198649:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 441 00000100:00100000:1.0:1789760753.198653:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 440 00000100:00100000:3.0:1789760753.198655:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777223040:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:1.0:1789760753.198689:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760753.198692:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760753.198877:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777222912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 366us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760753.198884:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 439 00000100:00100000:2.0:1789760753.199076:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777222528 00000100:00100000:2.0:1789760753.199082:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777222528 00000100:00100000:2.0:1789760753.199118:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 382 00000100:00100000:2.0:1789760753.199126:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777222528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760753.199147:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777223040:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 491us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760753.199152:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777222528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760753.199154:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 441 00000100:00100000:2.0:1789760753.199158:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 382 00000100:00100000:2.0:1789760753.221248:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429405243736 time 429405447865 state 0x0 ref 1 00000100:00100000:2.0:1789760753.221283:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777222400:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760753.221325:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.221343:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760753.221348:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760753.221354:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.221388:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.241030:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.241050:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.241059:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.241066:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f550c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760753.241071:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.241081:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.241239:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.241249:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9724d1a/0xc2b9a3a7398583b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760753.241346:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777222400:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20076us (183440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760753.241357:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:2.0:1789760753.241364:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429405243736 time 429405447865 state 0x2 ref 0 00000100:00100000:0.0:1789760753.246289:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760753.246449:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777223168 00000100:00100000:2.0:1789760753.246460:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777223168 00000100:00100000:2.0:1789760753.246509:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429405243736 time 429405447865 state 0x0 ref 1 00000100:00100000:2.0:1789760753.246523:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429605447865 time 429405447865 state 0x1 ref 1 00000100:00100000:3.0:1789760753.426210:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429605447865 time 429610410180 state 0x0 ref 1 00000100:00100000:3.0:1789760753.426245:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777223168:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760753.426292:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.426309:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760753.426313:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760753.426319:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.426333:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.441744:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.441765:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.441774:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.441829:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e546181800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760753.441834:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.441843:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.441862:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.441870:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760753.441955:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777223168:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15723us (195672us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760753.441965:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:3.0:1789760753.441972:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429605447865 time 429610410180 state 0x2 ref 0 00000100:00100000:2.0:1789760753.448562:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760753.448690:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777223296 00000100:00100000:3.0:1789760753.448700:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777223296 00000100:00100000:3.0:1789760753.448757:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429605447865 time 429610410180 state 0x0 ref 1 00000100:00100000:3.0:1789760753.448770:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429810410180 time 429610410180 state 0x1 ref 1 00000100:00100000:3.0:1789760753.626314:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429810410180 time 429810513625 state 0x0 ref 1 00000100:00100000:3.0:1789760753.626349:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777223296:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760753.626409:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.626428:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760753.626438:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760753.626445:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.626460:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.638232:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.638251:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.638259:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.638266:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e546181800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760753.638271:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.638281:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.638322:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.638330:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1e0eca6/0xc2b9a3a7398583bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760753.638436:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777223296:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12099us (189879us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760753.638446:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:3.0:1789760753.638454:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429810410180 time 429810513625 state 0x2 ref 0 00000100:00100000:2.0:1789760753.656367:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760753.656452:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777223424 00000100:00100000:3.0:1789760753.656463:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777223424 00000100:00100000:3.0:1789760753.656524:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 429810410180 time 429810513625 state 0x0 ref 1 00000100:00100000:3.0:1789760753.656536:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430010513625 time 429810513625 state 0x1 ref 1 00000100:00100000:0.0:1789760753.827471:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430010513625 time 430011671871 state 0x0 ref 1 00000100:00100000:0.0:1789760753.827512:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777223424:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760753.827569:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.827588:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760753.827592:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760753.827598:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.827616:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.838684:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.838720:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.838738:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.838746:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c7a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760753.838751:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.838759:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.838778:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.838819:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eac1d235/0xc2b9a3a7398583c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760753.838906:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777223424:12345-192.168.203.38@tcp:3:dd.500 Request processed in 11404us (182543us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760753.838916:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:1.0:1789760753.838924:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430010513625 time 430011671871 state 0x2 ref 0 00000100:00100000:3.0:1789760753.848393:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760753.848490:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777223552 00000100:00100000:0.0:1789760753.848500:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777223552 00000100:00100000:0.0:1789760753.848547:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430010513625 time 430011671871 state 0x0 ref 1 00000100:00100000:0.0:1789760753.848559:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430211671871 time 430011671871 state 0x1 ref 1 00000100:00100000:2.0:1789760754.028384:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430211671871 time 430212582893 state 0x0 ref 1 00000100:00100000:2.0:1789760754.028490:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777223552:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760754.028535:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.028551:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760754.028556:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760754.028562:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.028575:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760754.033876:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760754.048543:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.048563:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.048572:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.048579:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f551400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760754.048583:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.048591:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.048611:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.048618:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fded48a/0xc2b9a3a7398583cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760754.048709:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777223552:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20301us (200320us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760754.048719:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:1.0:1789760754.048729:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430211671871 time 430212582893 state 0x2 ref 0 00000100:00100000:3.0:1789760754.062923:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760754.063078:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777223680 00000100:00100000:0.0:1789760754.063088:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777223680 00000100:00100000:0.0:1789760754.063138:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430211671871 time 430212582893 state 0x0 ref 1 00000100:00100000:0.0:1789760754.063151:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430412582893 time 430212582893 state 0x1 ref 1 00010000:00010000:3.0:1789760754.183227:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760754.228990:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430412582893 time 430413189701 state 0x0 ref 1 00000100:00100000:0.0:1789760754.229033:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777223680:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760754.229084:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.229120:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760754.229125:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760754.229132:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.229145:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.247746:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.247765:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.247773:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.247781:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c7600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760754.247799:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.247809:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.247827:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.247855:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8c3718/0xc2b9a3a7398583d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760754.248325:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777223680:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18936us (185028us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760754.248335:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:0.0:1789760754.248343:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430412582893 time 430413189701 state 0x2 ref 0 00000100:00100000:2.0:1789760754.260318:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760754.260455:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777223808 00000100:00100000:3.0:1789760754.260464:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777223808 00000100:00100000:3.0:1789760754.260526:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430412582893 time 430413189701 state 0x0 ref 1 00000100:00100000:3.0:1789760754.260539:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430613189701 time 430413189701 state 0x1 ref 1 00000100:00100000:1.0:1789760754.430999:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430613189701 time 430615200848 state 0x0 ref 1 00000100:00100000:1.0:1789760754.431051:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777223808:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760754.431096:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.431113:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760754.431118:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760754.431125:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.431140:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.443427:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.443475:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.443491:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.443500:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760754.443504:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.443514:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.443534:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.443542:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003578f7f4/0xc2b9a3a7398583db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.443677:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777223808:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12633us (183365us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760754.443687:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 207 00000100:00100000:3.0:1789760754.443695:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430613189701 time 430615200848 state 0x2 ref 0 00000100:00100000:2.0:1789760754.449565:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760754.449664:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777223936 00000100:00100000:1.0:1789760754.449675:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777223936 00000100:00100000:1.0:1789760754.449726:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430613189701 time 430615200848 state 0x0 ref 1 00000100:00100000:1.0:1789760754.449738:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430815200848 time 430615200848 state 0x1 ref 1 00000100:00100000:0.0:1789760754.631298:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430815200848 time 430815498447 state 0x0 ref 1 00000100:00100000:0.0:1789760754.631331:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777223936:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760754.631374:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.631390:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760754.631395:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760754.631402:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.631416:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.645846:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.645870:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.645880:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.645908:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e5820c6200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760754.645913:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.645922:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.645942:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.645950:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a360a7a7/0xc2b9a3a7398583e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760754.646051:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777223936:12345-192.168.203.38@tcp:3:dd.500 Request processed in 14729us (196490us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760754.646062:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:1.0:1789760754.646070:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430815200848 time 430815498447 state 0x2 ref 0 00000100:00100000:2.0:1789760754.653192:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760754.653365:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777224064 00000100:00100000:1.0:1789760754.653377:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777224064 00000100:00100000:1.0:1789760754.653431:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 430815200848 time 430815498447 state 0x0 ref 1 00000100:00100000:1.0:1789760754.653444:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431015498447 time 430815498447 state 0x1 ref 1 00000100:00100000:3.0:1789760754.831516:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431015498447 time 431015715087 state 0x0 ref 1 00000100:00100000:3.0:1789760754.831566:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777224064:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760754.831612:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.831635:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760754.831640:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.831646:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.831664:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.846699:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.846718:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.846726:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.846733:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e546180600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760754.846737:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.846744:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.846780:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.846809:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a7398583e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.846893:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777224064:12345-192.168.203.38@tcp:3:dd.500 Request processed in 15336us (193711us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760754.846903:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:3.0:1789760754.846912:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431015498447 time 431015715087 state 0x2 ref 0 00000100:00100000:1.0:1789760754.859376:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760754.859491:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777224192 00000100:00100000:0.0:1789760754.859500:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777224192 00000100:00100000:0.0:1789760754.859565:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431015498447 time 431015715087 state 0x0 ref 1 00000100:00100000:0.0:1789760754.859593:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431215715087 time 431015715087 state 0x1 ref 1 00000100:00100000:2.0:1789760755.031869:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431215715087 time 431216068525 state 0x0 ref 1 00000100:00100000:2.0:1789760755.031906:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777224192:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760755.031954:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.031972:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.031977:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.031984:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.032010:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.057207:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.057228:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.057238:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.057265:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760755.057270:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.057280:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.057300:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.057308:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398583f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760755.057394:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777224192:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25501us (198023us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760755.057404:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:2.0:1789760755.057413:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431215715087 time 431216068525 state 0x2 ref 0 00000100:00100000:0.0:1789760755.067644:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760755.067849:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777224320 00000100:00100000:3.0:1789760755.067858:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777224320 00000100:00100000:3.0:1789760755.067912:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431215715087 time 431216068525 state 0x0 ref 1 00000100:00100000:3.0:1789760755.067923:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431416068525 time 431216068525 state 0x1 ref 1 00010000:00010000:1.0:1789760755.206980:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760755.232034:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431416068525 time 431416234409 state 0x0 ref 1 00000100:00100000:0.0:1789760755.232208:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777224320:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760755.232256:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.232598:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760755.232603:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760755.232609:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.232625:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.243895:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.243916:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.243925:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.243933:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760755.243950:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.243958:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.243976:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.243984:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760755.244080:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777224320:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12023us (176452us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760755.244091:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:0.0:1789760755.244099:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431416068525 time 431416234409 state 0x2 ref 0 00000100:00100000:0.0:1789760755.255226:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760755.255468:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777224448 00000100:00100000:1.0:1789760755.255480:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777224448 00000100:00100000:1.0:1789760755.255602:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431416068525 time 431416234409 state 0x0 ref 1 00000100:00100000:1.0:1789760755.255616:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431616234409 time 431416234409 state 0x1 ref 1 00000100:00100000:3.0:1789760755.398981:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760755.399025:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57aaf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798226432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760755.399057:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760755.399070:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798226560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760755.399102:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760755.399137:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798226432 00000100:00100000:2.0:1789760755.399145:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798226432 00000100:00100000:3.0:1789760755.399191:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760755.399472:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798226688:0@lo:400:kworker.0 00000100:00100000:3.0:1789760755.399716:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760755.399741:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798227200:0@lo:400:kworker.0 00000100:00100000:3.0:1789760755.399764:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760755.399782:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798227712:0@lo:400:kworker.0 00000100:00100000:3.0:1789760755.399834:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760755.399853:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789760755.399859:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4493ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798227072:0@lo:400:kworker.0 00000100:00100000:3.0:1789760755.399880:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760755.399895:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798227584:0@lo:400:kworker.0 00000100:00100000:3.0:1789760755.399913:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760755.399926:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798228096:0@lo:400:kworker.0 00000100:00100000:3.0:1789760755.399942:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760755.400499:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798226944:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.400534:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760755.400557:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798227456:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.400578:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760755.400593:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798227968:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.400612:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760755.400629:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789760755.400635:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798226816:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.400656:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760755.400672:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798227328:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.400691:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760755.400705:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798227840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.400722:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760755.400743:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798227072 00000100:00100000:1.0:1789760755.400748:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798227072 00000100:00100000:1.0:1789760755.400776:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798227456 00000100:00100000:1.0:1789760755.400778:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798227456 00000100:00100000:1.0:1789760755.400808:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798227968 00000100:00100000:1.0:1789760755.400811:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798227968 00000100:00100000:1.0:1789760755.400824:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798226816 00000100:00100000:1.0:1789760755.400826:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798226816 00000100:00100000:1.0:1789760755.400836:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798227328 00000100:00100000:1.0:1789760755.400838:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798227328 00000100:00100000:1.0:1789760755.400863:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798227840 00000100:00100000:1.0:1789760755.400866:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798227840 00000100:00100000:1.0:1789760755.400882:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1789760755.400890:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54887bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798227072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.400943:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54887bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3464:x1876699798227072:12345-0@lo:400:kworker.0 Request processed in 52us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.400950:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1789760755.400965:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789760755.400971:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798227456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401014:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798227456:12345-0@lo:400:kworker.0 Request processed in 43us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.401030:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789760755.401042:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789760755.401054:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798227968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401082:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798227968:12345-0@lo:400:kworker.0 Request processed in 34us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.401087:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789760755.401099:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789760755.401105:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798226816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401131:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798226816:12345-0@lo:400:kworker.0 Request processed in 26us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.401136:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789760755.401146:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789760755.401152:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798227328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401175:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798227328:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.401186:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789760755.401198:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1789760755.401203:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798227840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401229:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798227840:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.401233:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1789760755.401251:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798227200 00000100:00100000:1.0:1789760755.401255:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798227200 00000100:00100000:1.0:1789760755.401278:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798226944 00000100:00100000:1.0:1789760755.401281:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798226944 00000100:00100000:1.0:1789760755.401292:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789760755.401299:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798227200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401336:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798227200:12345-0@lo:400:kworker.0 Request processed in 37us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.401342:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789760755.401355:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789760755.401363:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798226944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401406:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798226944:12345-0@lo:400:kworker.0 Request processed in 45us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.401411:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789760755.401473:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3464:1876699798227072:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401485:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4493fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798227200:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401513:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798226816:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401523:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798227328:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401541:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798227840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401549:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798226944:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401557:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798227456:0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401566:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798227968:0@lo:400:kworker.0 00000100:00080000:1.0:1789760755.401603:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760755.401606:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760755.401609:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760755.401632:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798227712 00000100:00100000:1.0:1789760755.401636:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798227712 00000100:00100000:1.0:1789760755.401662:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798227584 00000100:00100000:1.0:1789760755.401665:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798227584 00000100:00100000:1.0:1789760755.401682:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798228096 00000100:00100000:1.0:1789760755.401684:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798228096 00000100:00100000:1.0:1789760755.401697:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789760755.401702:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798227712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.401742:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798227712:12345-0@lo:400:kworker.0 Request processed in 39us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.401747:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789760755.401759:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789760755.401764:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798227584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760755.402121:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798226560 00000100:00100000:2.0:1789760755.402127:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798226560 00000100:00100000:2.0:1789760755.402208:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789760755.402218:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798228096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760755.404972:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798227584:12345-0@lo:400:kworker.0 Request processed in 3197us (5047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.404985:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789760755.405003:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798228096:12345-0@lo:400:kworker.0 Request processed in 2774us (5046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760755.405014:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789760755.405068:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798226688 00000100:00100000:2.0:1789760755.405070:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789760755.405078:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798226688 00000100:00100000:2.0:1789760755.405083:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798226432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760755.405119:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760755.405124:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789760755.405147:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798226688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760755.405174:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798226432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (6072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760755.405181:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789760755.405194:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789760755.405201:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798226560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760755.405212:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760755.405975:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798226560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 772us (6782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760755.405983:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1789760755.406622:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760755.406627:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760755.406672:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54498a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798226688:12345-0@lo:400:kworker.0 Request processed in 1526us (6953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.406682:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789760755.406880:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798227584:0@lo:400:kworker.0 00000100:00100000:2.0:1789760755.407398:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57aaf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798226432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760755.411264:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798228096:0@lo:400:kworker.0 00000100:00100000:0.0:1789760755.411282:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798226688:0@lo:400:kworker.0 00000100:00100000:0.0:1789760755.411294:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798227712:0@lo:400:kworker.0 00000100:00100000:0.0:1789760755.411314:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798226560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760755.433300:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431616234409 time 431617501288 state 0x0 ref 1 00000100:00100000:0.0:1789760755.433333:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777224448:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760755.433375:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.433391:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760755.433396:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760755.433403:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.433418:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.462026:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.462046:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.462055:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.462063:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760755.462068:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.462077:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.462098:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.462106:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d020e4/0xc2b9a3a7398583fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.462204:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777224448:12345-192.168.203.38@tcp:3:dd.500 Request processed in 28880us (206982us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760755.462228:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:1.0:1789760755.462236:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431616234409 time 431617501288 state 0x2 ref 0 00000100:00100000:3.0:1789760755.477070:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760755.477166:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777224576 00000100:00100000:0.0:1789760755.477175:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777224576 00000100:00100000:0.0:1789760755.477228:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431616234409 time 431617501288 state 0x0 ref 1 00000100:00100000:0.0:1789760755.477242:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431817501288 time 431617501288 state 0x1 ref 1 00000100:00100000:3.0:1789760755.634566:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431817501288 time 431818754830 state 0x0 ref 1 00000100:00100000:3.0:1789760755.634600:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777224576:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760755.634641:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.634658:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.634663:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.634669:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.634683:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.645571:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.645598:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.645609:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.645651:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e546180600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760755.645657:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.645667:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.645691:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.645700:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e697112/0xc2b9a3a739858405 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760755.645876:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777224576:12345-192.168.203.38@tcp:3:dd.500 Request processed in 11286us (168810us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760755.645890:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:2.0:1789760755.645902:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431817501288 time 431818754830 state 0x2 ref 0 00000100:00100000:0.0:1789760755.653679:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760755.653762:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777224704 00000100:00100000:2.0:1789760755.653776:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777224704 00000100:00100000:2.0:1789760755.653875:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 431817501288 time 431818754830 state 0x0 ref 1 00000100:00100000:2.0:1789760755.653890:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432018754830 time 431818754830 state 0x1 ref 1 00000100:00100000:1.0:1789760755.834759:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432018754830 time 432018952817 state 0x0 ref 1 00000100:00100000:1.0:1789760755.834848:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777224704:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760755.834905:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.834927:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760755.834931:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.834939:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.834958:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.862442:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.862505:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.862515:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.862524:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ff35a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760755.862530:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.862541:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.862574:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.862582:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6ff478d/0xc2b9a3a73985840c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.862705:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777224704:12345-192.168.203.38@tcp:3:dd.500 Request processed in 27915us (209031us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760755.862717:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:3.0:1789760755.862726:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432018754830 time 432018952817 state 0x2 ref 0 00000100:00100000:0.0:1789760755.870173:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760755.870360:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777224832 00000100:00100000:2.0:1789760755.870374:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777224832 00000100:00100000:2.0:1789760755.870454:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432018754830 time 432018952817 state 0x0 ref 1 00000100:00100000:2.0:1789760755.870501:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432218952817 time 432018952817 state 0x1 ref 1 00000100:00100000:2.0:1789760755.913875:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798228224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760755.913955:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760755.914132:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798228224 00000100:00100000:0.0:1789760755.914141:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798228224 00000100:00100000:0.0:1789760755.914190:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789760755.914200:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798228224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760755.914236:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760755.914294:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798228224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.914315:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789760755.914460:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798228224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760756.034964:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432218952817 time 432219157481 state 0x0 ref 1 00000100:00100000:1.0:1789760756.035191:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777224832:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760756.035253:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.035276:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760756.035282:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760756.035289:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.035329:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760756.035577:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760756.066480:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.066507:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.066517:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.066525:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ff34e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760756.066530:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.066540:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.066563:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.066570:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eff1abf/0xc2b9a3a739858413 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.066822:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777224832:12345-192.168.203.38@tcp:3:dd.500 Request processed in 31797us (196626us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760756.066835:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 215 00000100:00100000:2.0:1789760756.066845:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432218952817 time 432219157481 state 0x2 ref 0 00000100:00100000:1.0:1789760756.077189:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760756.077342:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777224960 00000100:00100000:3.0:1789760756.077372:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777224960 00000100:00100000:3.0:1789760756.077438:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432218952817 time 432219157481 state 0x0 ref 1 00000100:00100000:3.0:1789760756.077454:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432419157481 time 432219157481 state 0x1 ref 1 00010000:00010000:1.0:1789760756.231291:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760756.235106:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432419157481 time 432419300269 state 0x0 ref 1 00000100:00100000:3.0:1789760756.235152:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777224960:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760756.235283:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.235306:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.235311:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.235318:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.235334:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.251601:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.251626:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.251636:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.251780:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ff36a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760756.251818:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.251828:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.251848:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.251854:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985841a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.252123:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777224960:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16989us (174943us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760756.252241:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:3.0:1789760756.252254:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432419157481 time 432419300269 state 0x2 ref 0 00000100:00100000:0.0:1789760756.260862:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760756.261056:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777225088 00000100:00100000:2.0:1789760756.261071:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777225088 00000100:00100000:2.0:1789760756.261145:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432419157481 time 432419300269 state 0x0 ref 1 00000100:00100000:2.0:1789760756.261161:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432619300269 time 432419300269 state 0x1 ref 1 00000100:00100000:3.0:1789760756.423380:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760756.423413:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798228352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760756.423530:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.423919:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798228352 00000100:00100000:2.0:1789760756.423929:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798228352 00000100:00100000:2.0:1789760756.424007:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789760756.424019:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798228352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789760756.424072:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760756.424143:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798228352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.424152:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789760756.424230:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798228352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760756.436541:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432619300269 time 432620736205 state 0x0 ref 1 00000100:00100000:3.0:1789760756.436597:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777225088:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760756.436656:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.436697:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.436702:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.436709:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.436727:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.453749:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.453773:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.453783:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.453823:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ff36a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760756.453829:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.453838:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.453861:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.453895:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858421 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.454040:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777225088:12345-192.168.203.38@tcp:3:dd.500 Request processed in 17461us (193186us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760756.454060:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 217 00000100:00100000:3.0:1789760756.454071:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432619300269 time 432620736205 state 0x2 ref 0 00000100:00100000:0.0:1789760756.463894:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760756.465248:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777225216 00000100:00100000:3.0:1789760756.465262:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777225216 00000100:00100000:2.0:1789760756.465439:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432619300269 time 432620736205 state 0x0 ref 1 00000100:00100000:2.0:1789760756.465457:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432820736205 time 432620736205 state 0x1 ref 1 00000100:00100000:3.0:1789760756.636855:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432820736205 time 432821055300 state 0x0 ref 1 00000100:00100000:3.0:1789760756.636889:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777225216:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760756.636932:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.636951:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.636956:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.636963:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.636977:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.649580:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.649620:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.649631:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.649924:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ff36a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760756.649932:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.649944:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.649965:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.649974:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858428 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.650387:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777225216:12345-192.168.203.38@tcp:3:dd.500 Request processed in 13510us (186503us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760756.650397:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:3.0:1789760756.650406:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432820736205 time 432821055300 state 0x2 ref 0 00000100:00100000:2.0:1789760756.658518:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760756.662828:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777225344 00000100:00100000:1.0:1789760756.663088:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777225344 00000100:00100000:1.0:1789760756.663148:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 432820736205 time 432821055300 state 0x0 ref 1 00000100:00100000:1.0:1789760756.663161:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433021055300 time 432821055300 state 0x1 ref 1 00000100:00100000:3.0:1789760756.837922:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433021055300 time 433022123193 state 0x0 ref 1 00000100:00100000:3.0:1789760756.837966:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777225344:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760756.838017:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.838035:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760756.838039:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760756.838044:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.838060:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.849996:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.850015:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.850025:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.850041:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ff36a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760756.850052:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.850061:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.850094:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.850103:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a73985842f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.850193:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777225344:12345-192.168.203.38@tcp:3:dd.500 Request processed in 12235us (191680us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760756.850204:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:3.0:1789760756.850213:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433021055300 time 433022123193 state 0x2 ref 0 00000100:00100000:2.0:1789760756.859916:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760756.860126:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777225472 00000100:00100000:3.0:1789760756.860136:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777225472 00000100:00100000:3.0:1789760756.860184:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433021055300 time 433022123193 state 0x0 ref 1 00000100:00100000:3.0:1789760756.860196:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433222123193 time 433022123193 state 0x1 ref 1 00000100:00100000:3.0:1789760756.935236:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798228480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760756.935308:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.935475:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798228480 00000100:00100000:0.0:1789760756.935483:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798228480 00000100:00100000:0.0:1789760756.935541:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789760756.935550:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4499daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798228480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760756.935592:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789760756.935891:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4499daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798228480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 340us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.935899:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789760756.938753:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798228608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760756.938836:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.938994:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798228608 00000100:00100000:3.0:1789760756.939002:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798228608 00000100:00100000:3.0:1789760756.939046:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789760756.939062:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798228608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760756.939083:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789760756.939134:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798228608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.939158:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789760756.939212:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798228608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760756.944184:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798228480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760757.038064:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433222123193 time 433222254581 state 0x0 ref 1 00000100:00100000:3.0:1789760757.038103:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777225472:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760757.038146:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.038163:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.038167:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.038174:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.038189:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.066199:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.066227:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.066237:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.066244:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ff36a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760757.066262:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.066272:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.066290:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.066297:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858436 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760757.066390:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777225472:12345-192.168.203.38@tcp:3:dd.500 Request processed in 28305us (206480us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760757.066400:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:3.0:1789760757.066408:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433222123193 time 433222254581 state 0x2 ref 0 00000100:00100000:0.0:1789760757.075035:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760757.075120:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777225600 00000100:00100000:3.0:1789760757.075134:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777225600 00000100:00100000:3.0:1789760757.075186:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433222123193 time 433222254581 state 0x0 ref 1 00000100:00100000:3.0:1789760757.075209:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433422254581 time 433222254581 state 0x1 ref 1 00000100:00100000:0.0:1789760757.240135:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433422254581 time 433424334828 state 0x0 ref 1 00000100:00100000:0.0:1789760757.240170:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777225600:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760757.240214:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.240230:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760757.240235:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760757.240241:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.240276:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.256086:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760757.263394:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.263433:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.263442:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.263449:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760757.263454:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.263464:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.263485:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.263493:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985843d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760757.263749:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777225600:12345-192.168.203.38@tcp:3:dd.500 Request processed in 23592us (188717us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760757.263759:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:2.0:1789760757.263767:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433422254581 time 433424334828 state 0x2 ref 0 00000100:00100000:2.0:1789760757.275294:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760757.275398:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777225728 00000100:00100000:3.0:1789760757.275407:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777225728 00000100:00100000:3.0:1789760757.275460:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433422254581 time 433424334828 state 0x0 ref 1 00000100:00100000:3.0:1789760757.275483:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433624334828 time 433424334828 state 0x1 ref 1 00000100:00100000:1.0:1789760757.440362:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433624334828 time 433624563358 state 0x0 ref 1 00000100:00100000:1.0:1789760757.440394:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57d2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777225728:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760757.440451:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.440468:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760757.440473:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760757.440479:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.440493:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.464166:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.464187:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.464197:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.464205:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e540030c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760757.464209:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.464218:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.464237:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.464245:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063f2d6b/0xc2b9a3a739858444 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760757.464403:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57d2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777225728:12345-192.168.203.38@tcp:3:dd.500 Request processed in 24017us (189113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760757.464414:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:3.0:1789760757.464422:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433624334828 time 433624563358 state 0x2 ref 0 00000100:00100000:1.0:1789760757.486408:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760757.487598:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777225856 00000100:00100000:3.0:1789760757.487610:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777225856 00000100:00100000:3.0:1789760757.487680:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433624334828 time 433624563358 state 0x0 ref 1 00000100:00100000:3.0:1789760757.487694:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433824563358 time 433624563358 state 0x1 ref 1 00000100:00100000:2.0:1789760757.640486:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433824563358 time 433824686115 state 0x0 ref 1 00000100:00100000:2.0:1789760757.640577:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777225856:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760757.640619:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.640771:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760757.640777:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760757.640784:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.640842:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.656313:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.656336:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.656346:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.656355:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd8f600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760757.656360:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.656387:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.656409:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.656417:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e0a0ef2/0xc2b9a3a73985844b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760757.656617:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777225856:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16109us (170213us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760757.656628:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 223 00000100:00100000:2.0:1789760757.656648:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433824563358 time 433824686115 state 0x2 ref 0 00000100:00100000:0.0:1789760757.663873:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760757.666331:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777225984 00000100:00100000:3.0:1789760757.666345:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777225984 00000100:00100000:3.0:1789760757.666405:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 433824563358 time 433824686115 state 0x0 ref 1 00000100:00100000:3.0:1789760757.666418:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434024686115 time 433824686115 state 0x1 ref 1 00000100:00100000:3.0:1789760757.840618:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434024686115 time 434024818221 state 0x0 ref 1 00000100:00100000:3.0:1789760757.840660:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777225984:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760757.840713:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.840729:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760757.840740:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.840747:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.840764:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.857060:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.857099:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.857109:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.857116:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ff36a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760757.857121:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.857131:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.857150:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.857158:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2d0943/0xc2b9a3a739858452 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760757.857301:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777225984:12345-192.168.203.38@tcp:3:dd.500 Request processed in 16653us (193432us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760757.857311:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 224 00000100:00100000:3.0:1789760757.857318:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434024686115 time 434024818221 state 0x2 ref 0 00000100:00100000:0.0:1789760757.868383:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760757.869736:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777226112 00000100:00100000:2.0:1789760757.869758:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777226112 00000100:00100000:2.0:1789760757.869845:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434024686115 time 434024818221 state 0x0 ref 1 00000100:00100000:2.0:1789760757.869858:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434224818221 time 434024818221 state 0x1 ref 1 00000100:00100000:1.0:1789760758.043894:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434224818221 time 434228093828 state 0x0 ref 1 00000100:00100000:1.0:1789760758.044014:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777226112:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760758.044074:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.044093:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760758.044098:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760758.044105:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.044120:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760758.045127:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760758.063683:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.063702:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.063711:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.063842:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f544e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760758.063864:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.063874:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.063894:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.063902:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c50afea4/0xc2b9a3a739858459 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760758.064062:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777226112:12345-192.168.203.38@tcp:3:dd.500 Request processed in 20146us (195684us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760758.064072:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 225 00000100:00100000:1.0:1789760758.064081:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434224818221 time 434228093828 state 0x2 ref 0 00000100:00100000:1.0:1789760758.071403:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760758.071482:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777226240 00000100:00100000:3.0:1789760758.071507:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777226240 00000100:00100000:3.0:1789760758.071559:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434224818221 time 434228093828 state 0x0 ref 1 00000100:00100000:3.0:1789760758.071571:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434428093828 time 434228093828 state 0x1 ref 1 00000100:00100000:0.0:1789760758.248446:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434428093828 time 434432647178 state 0x0 ref 1 00000100:00100000:0.0:1789760758.248479:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777226240:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:0.0:1789760758.248524:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.248541:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760758.248545:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760758.248551:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.248565:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.276475:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.276494:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.276521:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.276529:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760758.276536:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.276544:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.276561:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.276568:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002282a153/0xc2b9a3a739858460 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760758.276653:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777226240:12345-192.168.203.38@tcp:3:dd.500 Request processed in 28185us (205255us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760758.276663:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 226 00000100:00100000:0.0:1789760758.276671:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434428093828 time 434432647178 state 0x2 ref 0 00010000:00010000:1.0:1789760758.279900:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760758.285275:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760758.285366:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777226368 00000100:00100000:2.0:1789760758.285375:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777226368 00000100:00100000:2.0:1789760758.285426:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434428093828 time 434432647178 state 0x0 ref 1 00000100:00100000:2.0:1789760758.285439:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434632647178 time 434432647178 state 0x1 ref 1 00000100:00100000:3.0:1789760758.317768:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760758.317833:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760758.317951:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777226624 00000100:00100000:1.0:1789760758.317969:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777226624 00000100:00100000:1.0:1789760758.318050:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777226880 00000100:00100000:1.0:1789760758.318054:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777226880 00000100:00100000:3.0:1789760758.318064:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 448 00000100:00100000:3.0:1789760758.318075:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2406:x1876699777226624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760758.318080:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 449 00000100:00100000:1.0:1789760758.318085:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777226880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:2.0:1789760758.318158:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760758.318383:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777226880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 295us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.318406:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 449 00000100:00100000:3.0:1789760758.321052:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2406:x1876699777226624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 2967us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.321066:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 448 00000100:00100000:2.0:1789760758.321134:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760758.321237:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777226496 00000100:00100000:0.0:1789760758.321246:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777226496 00000100:00100000:0.0:1789760758.321389:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 384 00000100:00100000:0.0:1789760758.321399:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777226496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760758.321455:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777226496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 59us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.321463:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 384 00000100:00100000:2.0:1789760758.322432:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760758.322589:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760758.323322:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777226752 00000100:00100000:1.0:1789760758.323331:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777226752 00000100:00100000:3.0:1789760758.323365:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777227008 00000100:00100000:3.0:1789760758.323369:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777227008 00000100:00100000:1.0:1789760758.323399:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 450 00000100:00100000:1.0:1789760758.323408:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777226752:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:2.0:1789760758.323408:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760758.323446:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 451 00000100:00100000:3.0:1789760758.323453:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777227008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760758.323471:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777226752:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.323478:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 450 00000100:00100000:3.0:1789760758.325996:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777227008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 2519us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.326010:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 451 00000100:00100000:2.0:1789760758.449116:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434632647178 time 434633315861 state 0x0 ref 1 00000100:00100000:2.0:1789760758.449148:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777226368:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760758.449191:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.449207:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760758.449211:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760758.449216:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.449229:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.467724:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.467744:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.467753:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.467783:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf5400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760758.467807:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.467817:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.467835:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.467842:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646102cb/0xc2b9a3a739858467 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.467927:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777226368:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18790us (182657us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760758.467936:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 227 00000100:00100000:3.0:1789760758.467943:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434632647178 time 434633315861 state 0x2 ref 0 00000100:00100000:1.0:1789760758.482434:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760758.482541:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777227136 00000100:00100000:0.0:1789760758.482551:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777227136 00000100:00100000:0.0:1789760758.482603:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434632647178 time 434633315861 state 0x0 ref 1 00000100:00100000:0.0:1789760758.482617:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434833315861 time 434633315861 state 0x1 ref 1 00000100:00100000:2.0:1789760758.649274:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434833315861 time 434833475322 state 0x0 ref 1 00000100:00100000:2.0:1789760758.650978:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777227136:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760758.651030:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.651047:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760758.651052:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760758.651059:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.651091:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.670139:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.670162:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.670172:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.670180:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fcf4c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760758.670184:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.670193:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.670214:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.670221:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f12e7988/0xc2b9a3a73985846e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.670326:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777227136:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21029us (187896us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760758.670337:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:2.0:1789760758.670345:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434833315861 time 434833475322 state 0x2 ref 0 00000100:00100000:0.0:1789760758.688013:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760758.688172:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777227264 00000100:00100000:1.0:1789760758.688182:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777227264 00000100:00100000:1.0:1789760758.688232:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 434833315861 time 434833475322 state 0x0 ref 1 00000100:00100000:1.0:1789760758.688245:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435033475322 time 434833475322 state 0x1 ref 1 00000100:00100000:3.0:1789760758.849820:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435033475322 time 435033996953 state 0x0 ref 1 00000100:00100000:3.0:1789760758.849851:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777227264:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760758.849892:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.849910:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760758.849926:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.849932:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.849962:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.874291:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.874310:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.874320:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.874327:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760758.874331:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.874361:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.874382:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.874391:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858475 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760758.874484:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777227264:12345-192.168.203.38@tcp:3:dd.500 Request processed in 24642us (186476us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760758.874495:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:1.0:1789760758.874503:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435033475322 time 435033996953 state 0x2 ref 0 00000100:00100000:0.0:1789760758.884572:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760758.884677:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777227392 00000100:00100000:3.0:1789760758.884687:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777227392 00000100:00100000:3.0:1789760758.884741:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435033475322 time 435033996953 state 0x0 ref 1 00000100:00100000:3.0:1789760758.884753:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435233996953 time 435033996953 state 0x1 ref 1 00000100:00100000:3.0:1789760759.050648:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435233996953 time 435234839492 state 0x0 ref 1 00000100:00100000:3.0:1789760759.050681:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777227392:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760759.050720:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.050736:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.050740:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.050745:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.050759:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.069437:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.069457:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.069465:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.069473:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760759.069478:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.069486:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.069506:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.069513:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a73985847c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760759.069634:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777227392:12345-192.168.203.38@tcp:3:dd.500 Request processed in 18965us (185067us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760759.069645:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:2.0:1789760759.069652:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435233996953 time 435234839492 state 0x2 ref 0 00000100:00100000:3.0:1789760759.081554:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760759.081724:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777227520 00000100:00100000:2.0:1789760759.081734:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777227520 00000100:00100000:2.0:1789760759.081812:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435233996953 time 435234839492 state 0x0 ref 1 00000100:00100000:2.0:1789760759.081826:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435434839492 time 435234839492 state 0x1 ref 1 00000100:00100000:1.0:1789760759.250976:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435434839492 time 435435164545 state 0x0 ref 1 00000100:00100000:1.0:1789760759.251132:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777227520:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760759.251174:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.251192:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760759.251196:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760759.251202:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.251236:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.291883:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.291904:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.291913:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.291922:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57ac81000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760759.291927:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.291936:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.291956:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.291964:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003718f993/0xc2b9a3a739858483 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760759.292086:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2406:x1876699777227520:12345-192.168.203.38@tcp:3:dd.500 Request processed in 40970us (210541us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760759.292096:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:1.0:1789760759.292104:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435434839492 time 435435164545 state 0x2 ref 0 00000100:00100000:0.0:1789760759.297941:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760759.298035:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777227648 00000100:00100000:2.0:1789760759.298044:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777227648 00000100:00100000:2.0:1789760759.298107:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435434839492 time 435435164545 state 0x0 ref 1 00000100:00100000:2.0:1789760759.298119:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435635164545 time 435435164545 state 0x1 ref 1 00010000:00010000:1.0:1789760759.303269:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760759.451592:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435635164545 time 435635792224 state 0x0 ref 1 00000100:00100000:3.0:1789760759.451625:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777227648:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:3.0:1789760759.451668:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.451697:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.451701:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760759.451708:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.451723:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.476857:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.476878:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.476888:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.476896:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760759.476901:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.476929:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.476950:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.476959:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000775d4df9/0xc2b9a3a73985848a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760759.477053:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777227648:12345-192.168.203.38@tcp:3:dd.500 Request processed in 25440us (179117us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760759.477064:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:3.0:1789760759.477072:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435635164545 time 435635792224 state 0x2 ref 0 00000100:00100000:0.0:1789760759.490899:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760759.491063:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777227776 00000100:00100000:1.0:1789760759.491072:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777227776 00000100:00100000:1.0:1789760759.491125:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435635164545 time 435635792224 state 0x0 ref 1 00000100:00100000:1.0:1789760759.491137:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435835792224 time 435635792224 state 0x1 ref 1 00000100:00100000:2.0:1789760759.652357:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435835792224 time 435836557068 state 0x0 ref 1 00000100:00100000:2.0:1789760759.652392:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777227776:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760759.652436:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.652454:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760759.652459:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760759.652465:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.652499:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.675783:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.675825:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.675834:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.675841:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760759.675846:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.675854:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.675873:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.675880:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858491 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760759.675997:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777227776:12345-192.168.203.38@tcp:3:dd.500 Request processed in 23617us (185103us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760759.676007:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 233 00000100:00100000:2.0:1789760759.676015:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435835792224 time 435836557068 state 0x2 ref 0 00000100:00100000:2.0:1789760759.690889:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760759.691060:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777227904 00000100:00100000:3.0:1789760759.691070:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777227904 00000100:00100000:3.0:1789760759.691127:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 435835792224 time 435836557068 state 0x0 ref 1 00000100:00100000:3.0:1789760759.691139:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 436036557068 time 435836557068 state 0x1 ref 1 00000100:00100000:2.0:1789760759.854654:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 436036557068 time 436038856221 state 0x0 ref 1 00000100:00100000:2.0:1789760759.854685:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777227904:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:2.0:1789760759.854803:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.854819:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760759.854823:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760759.854830:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.854846:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.876008:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.876027:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.876313:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.876321:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e548542400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760759.876325:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.876334:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.876355:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760759.876363:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3eda255/0xc2b9a3a739858498 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760759.876550:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777227904:12345-192.168.203.38@tcp:3:dd.500 Request processed in 21874us (185667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760759.876560:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 234 00000100:00100000:3.0:1789760759.876569:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 436036557068 time 436038856221 state 0x2 ref 0 00000100:00100000:1.0:1789760759.886450:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760759.886544:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777228032 00000100:00100000:3.0:1789760759.886554:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777228032 00000100:00100000:3.0:1789760759.886607:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 436036557068 time 436038856221 state 0x0 ref 1 00000100:00100000:3.0:1789760759.886620:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 436238856221 time 436038856221 state 0x1 ref 1 00000100:00100000:1.0:1789760760.058525:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 436238856221 time 436242725707 state 0x0 ref 1 00000100:00100000:1.0:1789760760.058579:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777228032:12345-192.168.203.38@tcp:3:dd.500 00010000:00010000:1.0:1789760760.058622:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.058639:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760760.058644:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760760.058650:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.058664:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760760.058824:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760760.072525:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.072546:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.072554:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.072561:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760760.072565:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.072574:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.072607:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.072626:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a73985849f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.072705:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777228032:12345-192.168.203.38@tcp:3:dd.500 Request processed in 14159us (186259us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760760.072714:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 235 00000100:00100000:0.0:1789760760.072722:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 436238856221 time 436242725707 state 0x2 ref 0 00000100:00100000:0.0:1789760760.084345:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760760.084445:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777228288 00000100:00100000:2.0:1789760760.084454:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777228288 00000100:00080000:0.0:1789760760.084571:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760760.084631:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1789760760.084642:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+9:12017:x1876699777228288:12345-192.168.203.38@tcp:35:dd.500 00000100:00100000:2.0:1789760760.086328:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:12017:x1876699777228288:12345-192.168.203.38@tcp:35:dd.500 Request processed in 1680us (1993us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1789760760.086349:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:3.0:1789760760.177567:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760760.177743:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777228416 00000100:00100000:2.0:1789760760.177753:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777228416 00000100:00100000:2.0:1789760760.177856:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1789760760.177867:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:6390:x1876699777228416:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760760.177882:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760760.177922:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279e56af/0xc2b9a3a7398581e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c20 expref: 6 pid: 9533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.178026:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760760.178268:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:6390:x1876699777228416:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 402us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760760.178277:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1789760760.212094:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760760.212249:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777228544 00000100:00100000:3.0:1789760760.212260:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777228544 00000100:00100000:3.0:1789760760.212391:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:3.0:1789760760.212403:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:11161:x1876699777228544:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1789760760.212426:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760760.212447:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542200/0xc2b9a3a7398584a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c27 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.213581:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543800/0xc2b9a3a7398584ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.213599:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543800/0xc2b9a3a7398584ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.213613:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543800/0xc2b9a3a7398584ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760760.213645:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00000004:00200000:3.0:1789760760.213649:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789760760.213667:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543800/0xc2b9a3a7398584ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.213693:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542200/0xc2b9a3a7398584a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c27 expref: 12 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.213712:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543800/0xc2b9a3a7398584ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c27 expref: 11 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.213737:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:3.0:1789760760.213740:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760760.213743:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f543800, rc 0) 00000100:00100000:3.0:1789760760.213833:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:11161:x1876699777228544:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1432us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.213841:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:1.0:1789760760.242087:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760760.242339:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777228800 00000100:00100000:2.0:1789760760.242350:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777228800 00000100:00100000:2.0:1789760760.242463:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:2.0:1789760760.242474:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+11:12032:x1876699777228800:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1789760760.242495:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760760.242515:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39e00/0xc2b9a3a7398584b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c2e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760760.242603:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00010000:00010000:2.0:1789760760.242719:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39e00/0xc2b9a3a7398584b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c2e expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.242752:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760760.242755:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760760.242760:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39e00/0xc2b9a3a7398584b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c2e expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.242775:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d39e00, rc 0) 00000100:00100000:2.0:1789760760.242884:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+12:12032:x1876699777228800:12345-192.168.203.38@tcp:101:rm.0 Request processed in 412us (806us total) trans 4294967359 rc 301/301 00000100:00100000:2.0:1789760760.242892:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:2.0:1789760760.259880:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760760.260839:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777228928 00000100:00100000:3.0:1789760760.260851:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777228928 00000100:00100000:3.0:1789760760.260979:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1789760760.260991:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:12032:x1876699777228928:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:0.0:1789760760.270079:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:12032:x1876699777228928:12345-192.168.203.38@tcp:37:rm.0 Request processed in 9078us (10195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.270093:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1789760760.273035:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760760.273122:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777229184 00000100:00100000:2.0:1789760760.273133:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777229184 00000100:00100000:2.0:1789760760.273197:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1789760760.273208:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:12032:x1876699777229184:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:2.0:1789760760.273462:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+13:12032:x1876699777229184:12345-192.168.203.38@tcp:35:rm.0 Request processed in 255us (434us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789760760.273471:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1789760760.278591:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760760.278666:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777229440 00000100:00100000:3.0:1789760760.278676:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777229440 00000100:00100000:3.0:1789760760.278730:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:3.0:1789760760.278738:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aaba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+13:12032:x1876699777229440:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1789760760.278760:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760760.278778:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542200/0xc2b9a3a7398584c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c35 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.278895:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542800/0xc2b9a3a7398584c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.278909:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542800/0xc2b9a3a7398584c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.278919:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542800/0xc2b9a3a7398584c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760760.278945:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00010000:00010000:3.0:1789760760.279064:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542200/0xc2b9a3a7398584c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c35 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.279081:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542800/0xc2b9a3a7398584c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c35 expref: 15 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.279089:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:3.0:1789760760.279092:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789760760.279095:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f542800, rc 0) 00000100:00100000:3.0:1789760760.279139:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aaba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+15:12032:x1876699777229440:12345-192.168.203.38@tcp:101:rm.0 Request processed in 402us (556us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1789760760.279145:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:3.0:1789760760.282198:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760760.282296:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777229568 00000100:00100000:1.0:1789760760.282306:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777229568 00000100:00100000:1.0:1789760760.282363:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:1.0:1789760760.282373:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+15:12032:x1876699777229568:12345-192.168.203.38@tcp:41:rm.0 00000004:00000024:1.0:1789760760.282439:0:6466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7610564608 00000100:00100000:1.0:1789760760.282514:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+15:12032:x1876699777229568:12345-192.168.203.38@tcp:41:rm.0 Request processed in 141us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760760.282521:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:0.0:1789760760.284591:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760760.284680:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777229824 00000100:00100000:2.0:1789760760.284690:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777229824 00000100:00100000:2.0:1789760760.284741:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 165 00000100:00100000:2.0:1789760760.284752:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+15:12032:x1876699777229824:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1789760760.284835:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789760760.284861:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00e00/0xc2b9a3a7398581d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c19 expref: 15 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.284901:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf4e00/0xc2b9a3a739857e86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bf6 expref: 14 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.284914:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0ad00) 00010000:00010000:2.0:1789760760.284929:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543800/0xc2b9a3a7398584ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c27 expref: 13 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.284937:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:2.0:1789760760.284941:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760760.284971:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.284983:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.284992:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.285007:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.285013:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.285020:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.285396:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.285416:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.285423:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789760760.288386:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789760760.288407:0:6467:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436472618057ns, next at 437472613795ns, rc = 0 00010000:00010000:2.0:1789760760.288499:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288514:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288524:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288533:0:6467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288540:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288546:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288570:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789760760.288592:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288599:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288612:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288618:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d38600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760760.288623:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288631:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.288632:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760760.288638:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288643:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0a200) 00010000:00010000:2.0:1789760760.288646:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789760760.288650:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.288650:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d38a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760760.288653:0:7281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288657:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38600/0xc2b9a3a7398584e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.288660:0:7281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.288667:0:7281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff97e543c0a200) 00010000:00010000:3.0:1789760760.288670:0:7281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789760760.288672:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288677:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288684:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.288684:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38a00/0xc2b9a3a7398584ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288690:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288694:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d38800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760760.288696:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.288700:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760760.288702:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760760.288704:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760760.288710:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288718:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:2.0:1789760760.288720:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760760.288723:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288728:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38800/0xc2b9a3a7398584d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760760.288739:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072f25244 reply state 000000003a2a2b6f transno 4294967362 ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288883:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.288889:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x4009f790 (ffff97e543c0a300) 00010000:00010000:2.0:1789760760.288892:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760760.288895:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760760.289030:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+14:12032:x1876699777229824:12345-192.168.203.38@tcp:36:rm.0 Request processed in 4276us (4443us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789760760.289039:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 165 00000100:00100000:2.0:1789760760.291765:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760760.292029:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777230080 00000100:00100000:0.0:1789760760.292039:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777230080 00000100:00100000:0.0:1789760760.292284:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:0.0:1789760760.292296:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57aabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+14:12032:x1876699777230080:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:0.0:1789760760.292544:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57aabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+15:12032:x1876699777230080:12345-192.168.203.38@tcp:35:rm.0 Request processed in 250us (787us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789760760.292551:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1789760760.298346:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760760.298450:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777230336 00000100:00100000:1.0:1789760760.298460:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777230336 00000100:00100000:1.0:1789760760.298518:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:1.0:1789760760.298528:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+15:12032:x1876699777230336:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1789760760.298580:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789760760.298608:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542800/0xc2b9a3a7398584c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c35 expref: 15 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.298630:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fcf5800/0xc2b9a3a739857e55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211be8 expref: 14 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.298641:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2f00) 00010000:00010000:1.0:1789760760.298657:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e5461f4000/0xc2b9a3a739857df3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211bd3 expref: 13 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.298685:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760760.298688:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760760.298708:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.298720:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.298731:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.298744:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.298750:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.298756:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299121:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299131:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299139:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760760.299681:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16384 00010000:00010000:1.0:1789760760.299698:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299711:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299717:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299723:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54ea00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760760.299728:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299735:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299746:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff97e5461f2a00) 00010000:00010000:1.0:1789760760.299749:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789760760.299753:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299759:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a739858501 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299780:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299810:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299817:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299822:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299834:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54f000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760760.299838:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299844:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299853:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760760.299856:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760760.299859:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299865:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a7398584f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760760.299875:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f56ebfc4 reply state 000000007fd28e91 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299885:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.299892:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5461f2700) 00010000:00010000:1.0:1789760760.299894:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760760.299897:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760760.299983:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+14:12032:x1876699777230336:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1454us (1645us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789760760.299991:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 166 00010000:00010000:1.0:1789760760.326897:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760760.519225:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798229120:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.519299:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.519395:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798229632:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.519437:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.519474:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798230144:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.519504:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760760.519543:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798228864:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.519546:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789760760.519562:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798228736:0@lo:400:kworker.0 00000100:00100000:1.0:1789760760.519658:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798229632 00000100:00100000:1.0:1789760760.519666:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798229632 00000100:00100000:1.0:1789760760.519747:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798230144 00000100:00100000:1.0:1789760760.519751:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798230144 00000100:00100000:1.0:1789760760.519811:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789760760.519822:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798229632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.519931:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.519954:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798229248:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.519994:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.520017:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798229760:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520045:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.520070:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5434b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798230272:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520091:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.520114:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798229120 00000100:00100000:3.0:1789760760.520117:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798229120 00000100:00100000:3.0:1789760760.520146:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1789760760.520159:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798229120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520197:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798229120:12345-0@lo:400:kworker.0 Request processed in 39us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.520205:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1789760760.520227:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798229248 00000100:00100000:3.0:1789760760.520230:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798229248 00000100:00100000:3.0:1789760760.520282:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789760760.520294:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798229248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760760.520312:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798229760 00000100:00100000:0.0:1789760760.520322:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798229760 00000100:00100000:3.0:1789760760.520335:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798229248:12345-0@lo:400:kworker.0 Request processed in 43us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.520343:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789760760.520368:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798230272 00000100:00100000:0.0:1789760760.520374:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798230272 00000100:00100000:0.0:1789760760.520414:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789760760.520425:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798230144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520429:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798229248:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520448:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798229120:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520494:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798228992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520520:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.520540:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798229504:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520563:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.520580:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798230016:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520601:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.520621:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798230528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760760.520655:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.520707:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798228992 00000100:00100000:3.0:1789760760.520712:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798228992 00000100:00100000:0.0:1789760760.520716:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798230144:12345-0@lo:400:kworker.0 Request processed in 290us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.520729:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789760760.520755:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789760760.520760:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789760760.520766:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798228992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760760.520774:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798229760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.520878:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798228992:12345-0@lo:400:kworker.0 Request processed in 112us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.520889:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789760760.520923:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798230528 00000100:00100000:3.0:1789760760.520927:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798230528 00000100:00100000:0.0:1789760760.520934:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798229760:12345-0@lo:400:kworker.0 Request processed in 162us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.520944:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789760760.520977:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789760760.520985:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789760760.520997:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5433df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3462:x1876699798230528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760760.521004:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3463:x1876699798230272:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789760760.521037:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760760.521052:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3463:x1876699798230272:12345-0@lo:400:kworker.0 Request processed in 55us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.521062:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789760760.521098:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5433df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798230528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.521107:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789760760.521161:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798228992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.521177:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798230528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760760.521218:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798229504 00000100:00100000:3.0:1789760760.521222:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798229504 00000100:00100000:3.0:1789760760.521245:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798230016 00000100:00100000:3.0:1789760760.521248:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798230016 00000100:00100000:3.0:1789760760.521278:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1789760760.521287:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798229504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.521330:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798229504:12345-0@lo:400:kworker.0 Request processed in 45us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.521339:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1789760760.521355:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1789760760.521364:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798230016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.521393:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798230016:12345-0@lo:400:kworker.0 Request processed in 32us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.521406:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1789760760.521459:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798229504:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.521469:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798230016:0@lo:400:kworker.0 00000100:00080000:3.0:1789760760.521518:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760760.521523:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760760.521525:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760760.521543:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798228736 00000100:00100000:3.0:1789760760.521547:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798228736 00000100:00100000:3.0:1789760760.521571:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789760760.521578:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798228736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.521610:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798228736:12345-0@lo:400:kworker.0 Request processed in 33us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.521617:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789760760.522511:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798229760:0@lo:400:kworker.0 00000100:00100000:0.0:1789760760.522546:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5434b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798230272:0@lo:400:kworker.0 00000100:00100000:0.0:1789760760.522561:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798230144:0@lo:400:kworker.0 00000100:00100000:0.0:1789760760.522595:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e4498ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798228736:0@lo:400:kworker.0 00000100:00100000:2.0:1789760760.523356:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760760.523384:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798229632:12345-0@lo:400:kworker.0 Request processed in 3555us (3938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760760.523398:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789760760.523414:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798229376:0@lo:400:kworker.0 00000100:00100000:1.0:1789760760.523455:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798228864 00000100:00100000:1.0:1789760760.523462:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798228864 00000100:00100000:2.0:1789760760.523840:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760760.523886:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798229888:0@lo:400:kworker.0 00000100:00100000:2.0:1789760760.523912:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760760.523932:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798230400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760760.523972:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760760.524039:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798229376 00000100:00100000:1.0:1789760760.524174:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798229376 00000100:00100000:1.0:1789760760.524210:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798229888 00000100:00100000:1.0:1789760760.524214:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798229888 00000100:00100000:1.0:1789760760.524233:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1789760760.524241:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798228864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760760.524307:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798228864:12345-0@lo:400:kworker.0 Request processed in 66us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760760.524314:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1789760760.524328:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1789760760.524334:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798229376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760760.524365:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798229376:12345-0@lo:400:kworker.0 Request processed in 31us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760760.524372:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1789760760.524384:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1789760760.524389:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798229888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760760.524417:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798229888:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760760.524437:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:1.0:1789760760.524526:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760760.526838:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798228864:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.526857:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798229376:0@lo:400:kworker.0 00000100:00100000:3.0:1789760760.526869:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798229888:0@lo:400:kworker.0 00000100:00100000:0.0:1789760760.528955:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798229632:0@lo:400:kworker.0 00000100:00100000:2.0:1789760760.529947:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798230400 00000100:00100000:2.0:1789760760.529966:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798230400 00000100:00100000:2.0:1789760760.530051:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789760760.530063:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798230400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789760760.530098:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760760.530216:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798230400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (6244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760760.530225:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789760760.530566:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798230400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760761.031284:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798230656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789760761.031383:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760761.032903:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798230656 00000100:00100000:2.0:1789760761.032919:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798230656 00000100:00100000:2.0:1789760761.033379:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789760761.033392:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798230656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760761.034185:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760761.034302:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798230656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 911us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760761.034312:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789760761.034735:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798230656:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1789760761.125291:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967363 is committed 00000001:00080000:2.0:1789760761.125335:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967364 is committed 00000004:00080000:2.0:1789760761.125412:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:1.0:1789760761.125687:0:3447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.125708:0:3447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.125717:0:3447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.125726:0:3447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54e600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760761.125733:0:3447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760761.125739:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e543574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798230784:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789760761.125748:0:3447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.125779:0:3447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5461f2700) 00010000:00010000:1.0:1789760761.125783:0:3447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760761.125826:0:3447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.125834:0:3447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a7398584fa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760761.125894:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760761.126588:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760761.126616:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760761.126624:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760761.126631:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d39000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760761.126636:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760761.126645:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760761.126661:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x4009f790 (ffff97e543c0a300) 00010000:00010000:2.0:1789760761.126664:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760761.126669:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760761.126675:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39000/0xc2b9a3a7398584de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760761.127979:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798230784 00000100:00100000:1.0:1789760761.127997:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798230784 00000100:00100000:1.0:1789760761.128106:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789760761.128129:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4498ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798230784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789760761.128169:0:8114:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1789760761.128211:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 104857600, mtime: 0x6aad94e3, atime: 0x6aad94cf, ctime: 0x6aad94e3, blocks: 0x3200f 00010000:00010000:1.0:1789760761.128219:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.128239:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1789760761.128244:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760761.128251:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.128268:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.128279:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.128288:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.128307:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789760761.129272:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4498ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3464:x1876699798230784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1136us (3370us total) trans 4294967553 rc 0/0 00000100:00100000:1.0:1789760761.129287:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:1.0:1789760761.129335:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760761.129345:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.129371:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54f000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760761.129376:0:6453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.129388:0:6453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.129411:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.129418:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d28030c6/0xc2b9a3a739858508 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.129441:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760761.129443:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760761.129445:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789760761.129703:0:3464:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e543574a80/2, rc 0, transno 4294967553 00000100:00100000:0.0:1789760761.129718:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e543574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798230784:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789760761.351009:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760761.547141:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798230912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760761.547213:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760761.547816:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798230912 00000100:00100000:0.0:1789760761.547824:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798230912 00000100:00100000:0.0:1789760761.547871:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789760761.547880:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798230912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760761.547917:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760761.547983:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798230912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760761.547991:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789760761.548175:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798230912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760762.057478:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798231040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760762.057545:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760762.057736:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798231040 00000100:00100000:0.0:1789760762.057743:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798231040 00000100:00100000:0.0:1789760762.057809:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789760762.057818:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5434b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3462:x1876699798231040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760762.057851:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789760762.057896:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5434b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3462:x1876699798231040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760762.057903:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789760762.058363:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798231040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789760762.060204:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760762.061675:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798231168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760762.061738:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760762.061823:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798231168 00000100:00100000:2.0:1789760762.061830:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798231168 00000100:00100000:2.0:1789760762.061881:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789760762.061890:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798231168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760762.061911:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789760762.061966:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798231168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760762.061983:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789760762.062028:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798231168:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789760762.062115:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760762.375965:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789760762.874021:0:14150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 439058229689ns, next at 437472613795ns, rc = 0 00000004:00080000:2.0:1789760762.874203:0:14150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 439058414407ns, next at 398279215707ns, rc = 0 00000004:00080000:2.0:1789760762.874280:0:14150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 439058491355ns, next at 314405594137ns, rc = 0 00000004:00080000:2.0:1789760762.874342:0:14150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 439058553265ns, next at 396745460860ns, rc = 0 00000004:00080000:2.0:1789760762.877363:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789760762.877383:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1789760762.883373:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 7 committed 00000004:00080000:1.0:1789760762.883401:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 7 committed 00010000:00010000:2.0:1789760763.400277:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760763.437213:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760763.437266:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760763.437370:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777230592 00000100:00100000:3.0:1789760763.437396:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777230592 00000100:00100000:3.0:1789760763.437494:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 458 00000100:00100000:3.0:1789760763.437507:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777230592:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760763.437620:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777230592:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 115us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760763.437648:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 458 00000100:00080000:0.0:1789760763.437698:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760763.438069:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760763.438109:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760763.438140:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760763.438140:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777231104 00000100:00100000:3.0:1789760763.438147:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777231104 00000100:00100000:3.0:1789760763.438186:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777230720 00000100:00100000:1.0:1789760763.438192:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760763.438192:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777230720 00000100:00100000:3.0:1789760763.438224:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777230976 00000100:00100000:3.0:1789760763.438228:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777230976 00000100:00100000:1.0:1789760763.438236:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 459 00000100:00100000:1.0:1789760763.438248:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777231104:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760763.438255:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 460 00000100:00100000:3.0:1789760763.438266:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777230720:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760763.438358:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777230464 00000100:00100000:0.0:1789760763.438363:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777230464 00000100:00100000:0.0:1789760763.438399:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 386 00000100:00100000:0.0:1789760763.438407:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777230464:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760763.439071:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777231104:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 822us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760763.439082:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 459 00000100:00100000:1.0:1789760763.439110:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 461 00000100:00100000:1.0:1789760763.439121:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777230976:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760763.439712:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777230720:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1443us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760763.439722:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 460 00000100:00100000:2.0:1789760763.440534:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777230848 00000100:00100000:2.0:1789760763.440548:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777230848 00000100:00100000:0.0:1789760763.440560:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777230464:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 2147us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760763.440572:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 386 00000100:00100000:2.0:1789760763.440619:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:2.0:1789760763.440631:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777230848:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:0.0:1789760763.440649:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760763.440656:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760763.440660:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760763.440695:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777230848:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 67us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760763.440702:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:1.0:1789760763.443143:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777230976:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 4000us (4928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760763.443162:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 461 00010000:00010000:3.0:1789760764.423435:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760765.446993:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760765.638968:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e548826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798231296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760765.639060:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760765.639150:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798231296 00000100:00100000:1.0:1789760765.639159:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798231296 00000100:00100000:1.0:1789760765.639223:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789760765.639233:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798231296:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789760765.639267:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789760765.639308:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760765.639357:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798231296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760765.639364:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789760765.639415:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e548826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798231296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760765.641690:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798231424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760765.641804:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760765.641894:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798231424 00000100:00100000:3.0:1789760765.641903:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798231424 00000100:00100000:3.0:1789760765.641983:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789760765.641995:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798231424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760765.642034:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760765.642087:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798231424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760765.642095:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789760765.642158:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798231424:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789760765.642174:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760765.642357:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798231552:0@lo:400:kworker.0 00000100:00100000:2.0:1789760765.642401:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760765.643117:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798231552 00000100:00100000:3.0:1789760765.643123:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798231552 00000100:00100000:3.0:1789760765.643172:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789760765.643181:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798231552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.643237:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798231552:12345-0@lo:400:kworker.0 Request processed in 57us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760765.643244:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789760765.643293:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798231552:0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.643983:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798232064:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.644014:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798231680:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.644065:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760765.644095:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798232192:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.644130:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760765.644153:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798232704:0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.644155:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760765.644190:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798232576:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.644192:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760765.644227:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789760765.644229:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760765.644238:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798231808:0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.644258:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789760765.644266:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798231936:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.644343:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760765.644700:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798232064 00000100:00100000:1.0:1789760765.644708:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798232064 00000100:00100000:1.0:1789760765.644748:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798231808 00000100:00100000:1.0:1789760765.644751:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798231808 00000100:00100000:1.0:1789760765.644766:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789760765.644776:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798232064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.649638:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798231680 00000100:00100000:3.0:1789760765.649659:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798231680 00000100:00100000:3.0:1789760765.650092:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798232192 00000100:00100000:3.0:1789760765.650113:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798232192 00000100:00100000:3.0:1789760765.650168:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798232704 00000100:00100000:3.0:1789760765.650171:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798232704 00000100:00100000:3.0:1789760765.650229:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1789760765.650245:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798231680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.650415:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798231680:12345-0@lo:400:kworker.0 Request processed in 172us (6350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760765.650442:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1789760765.650451:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789760765.650466:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798231808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.650486:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1789760765.650496:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798232192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760765.650518:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798231808:12345-0@lo:400:kworker.0 Request processed in 56us (6175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760765.650527:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789760765.650540:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798232192:12345-0@lo:400:kworker.0 Request processed in 45us (6408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760765.650558:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1789760765.650571:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789760765.650581:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798232704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.650602:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798232576 00000100:00100000:3.0:1789760765.650608:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798232576 00000100:00100000:2.0:1789760765.650622:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798232704:12345-0@lo:400:kworker.0 Request processed in 43us (6431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760765.650629:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1789760765.650680:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789760765.651132:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3462:x1876699798232576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.651197:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3462:x1876699798232576:12345-0@lo:400:kworker.0 Request processed in 508us (6967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760765.651207:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789760765.651280:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760765.651318:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798231936 00000100:00100000:3.0:1789760765.651324:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798231936 00000100:00100000:3.0:1789760765.651360:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1789760765.651368:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798231936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.651407:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798231936:12345-0@lo:400:kworker.0 Request processed in 40us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760765.651413:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1789760765.651473:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798231936:0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.651489:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798232448:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.651493:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798231808:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.651504:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798232320:0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.651533:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760765.651575:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798232576:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.651598:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760765.651625:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798232832:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.651646:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760765.651691:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798231680:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.651702:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798232192:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.651715:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798232704:0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.651739:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798232320 00000100:00100000:3.0:1789760765.651745:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798232320 00000100:00100000:0.0:1789760765.651746:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798232832 00000100:00100000:0.0:1789760765.651751:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798232832 00000100:00100000:3.0:1789760765.651783:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1789760765.651818:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798232320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.651866:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3463:x1876699798232320:12345-0@lo:400:kworker.0 Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760765.651881:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1789760765.651902:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1789760765.651909:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798232832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760765.651949:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3463:x1876699798232832:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760765.651954:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789760765.652034:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3463:1876699798232320:0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.652046:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3463:1876699798232832:0@lo:400:kworker.0 00000100:00080000:0.0:1789760765.652096:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760765.652102:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760765.652105:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760765.652121:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798232448 00000100:00100000:0.0:1789760765.652125:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798232448 00000100:00100000:0.0:1789760765.652180:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789760765.652187:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798232448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760765.652227:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798232448:12345-0@lo:400:kworker.0 Request processed in 40us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760765.652233:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1789760765.652369:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760765.652392:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798232448:0@lo:400:kworker.0 00000100:00100000:1.0:1789760765.652860:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798232064:12345-0@lo:400:kworker.0 Request processed in 8082us (8705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760765.652869:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789760765.653908:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798232064:0@lo:400:kworker.0 00000001:00080000:0.0:1789760765.758943:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967553 is committed 00000100:00100000:0.0:1789760766.153942:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760766.153970:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798232960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760766.154062:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.154368:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798232960 00000100:00100000:2.0:1789760766.154381:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798232960 00000100:00100000:2.0:1789760766.154482:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789760766.154494:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798232960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760766.154545:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760766.154620:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798232960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760766.154628:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789760766.154736:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798232960:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760766.471071:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760766.665771:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798233088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760766.665887:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760766.666103:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798233088 00000100:00100000:1.0:1789760766.666115:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798233088 00000100:00100000:1.0:1789760766.666187:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789760766.666198:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798233088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789760766.666251:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789760766.666317:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798233088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760766.666325:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789760766.666608:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798233088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760767.176492:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798233216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760767.176596:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760767.177255:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798233216 00000100:00100000:1.0:1789760767.177268:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798233216 00000100:00100000:1.0:1789760767.177352:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789760767.177368:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798233216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760767.177416:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760767.177489:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798233216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760767.177497:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789760767.177562:0:3463:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967553 gen 2 00000004:00080000:1.0:1789760767.177569:0:3463:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e543574a80, transno 4294967553 00000100:00100000:1.0:1789760767.177593:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798233216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760767.178332:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760767.181139:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798233344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760767.181251:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760767.181387:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798233344 00000100:00100000:2.0:1789760767.181396:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798233344 00000100:00100000:2.0:1789760767.181476:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789760767.181487:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798233344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760767.181516:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789760767.181670:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760767.186984:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798233344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5485us (5719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760767.187002:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789760767.187492:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798233344:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789760767.496248:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760768.519610:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760768.559160:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760768.559206:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760768.559234:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760768.559268:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760768.559287:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760768.559311:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760768.559467:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777231360 00000100:00100000:0.0:1789760768.559480:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777231360 00000100:00100000:0.0:1789760768.559562:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777231872 00000100:00100000:0.0:1789760768.559566:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777231872 00000100:00100000:0.0:1789760768.559582:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777231488 00000100:00100000:0.0:1789760768.559585:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777231488 00000100:00100000:0.0:1789760768.559599:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777231744 00000100:00100000:0.0:1789760768.559601:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777231744 00000100:00100000:0.0:1789760768.559619:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 468 00000100:00100000:0.0:1789760768.559629:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777231360:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760768.559733:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777231360:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 105us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.559741:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 468 00000100:00100000:0.0:1789760768.559763:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 469 00000100:00100000:0.0:1789760768.559772:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777231872:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760768.559775:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777231616 00000100:00100000:2.0:1789760768.559782:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777231616 00000100:00100000:0.0:1789760768.559850:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777231872:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.559857:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 469 00000100:00080000:1.0:1789760768.559863:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760768.559869:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760768.559872:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760768.559873:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 470 00000100:00100000:0.0:1789760768.559880:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e4493ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777231488:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760768.559891:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:2.0:1789760768.559912:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777231616:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760768.559919:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 471 00000100:00100000:0.0:1789760768.559920:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e4493ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777231488:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.559926:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 470 00000100:00100000:1.0:1789760768.559934:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777231744:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760768.559958:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777231616:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 56us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.559966:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:1.0:1789760768.559972:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777231744:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.559980:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 471 00000100:00100000:1.0:1789760768.560003:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777231232 00000100:00100000:1.0:1789760768.560007:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777231232 00000100:00100000:1.0:1789760768.560040:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 388 00000100:00100000:1.0:1789760768.560214:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777231232:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760768.560269:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2406:x1876699777231232:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 221us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.560276:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 388 00010000:00010000:2.0:1789760769.544936:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760770.567280:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760770.759056:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798233600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760770.759112:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798233728:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.759165:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760770.759165:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.759231:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798233472:0@lo:400:kworker.0 00000100:00100000:0.0:1789760770.759404:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798233728 00000100:00100000:0.0:1789760770.759415:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798233728 00000100:00100000:0.0:1789760770.759499:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1789760770.759510:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798233728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761014:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.761042:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798233856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760770.761082:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798234112:0@lo:400:kworker.0 00000100:00100000:3.0:1789760770.761109:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.761126:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.761144:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798234368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761154:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798234624:0@lo:400:kworker.0 00000100:00100000:3.0:1789760770.761176:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.761207:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798234880:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761223:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.761234:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.761263:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798235136:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761289:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.761311:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789760770.761316:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798234240:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761342:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.761378:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798234752:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761410:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.761444:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798233984:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761480:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.761498:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798234496:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761522:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.761531:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798235008:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761550:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.761580:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798233600 00000100:00100000:1.0:1789760770.761588:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798233600 00000100:00100000:1.0:1789760770.761665:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798233856 00000100:00100000:1.0:1789760770.761669:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798233856 00000100:00100000:1.0:1789760770.761706:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789760770.761728:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798233600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760770.761735:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798234240 00000100:00100000:2.0:1789760770.761741:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798234240 00000100:00100000:2.0:1789760770.761780:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798233984 00002000:00000024:1.0:1789760770.761783:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760770.761785:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798233984 00000100:00100000:2.0:1789760770.761831:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789760770.761839:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798234240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.761877:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798233600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.761898:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789760770.761902:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798234240:12345-0@lo:400:kworker.0 Request processed in 63us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.761912:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789760770.761926:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789760770.761933:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789760770.761938:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798233856:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789760770.761945:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798233984:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789760770.761953:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760770.761992:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798233984:12345-0@lo:400:kworker.0 Request processed in 50us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.762000:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798233856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.762003:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789760770.762014:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789760770.762045:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798234624 00000100:00100000:1.0:1789760770.762050:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798234624 00000100:00100000:1.0:1789760770.762089:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798235136 00000100:00100000:2.0:1789760770.762090:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798233472 00000100:00100000:1.0:1789760770.762094:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798235136 00000100:00100000:2.0:1789760770.762097:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798233472 00000100:00100000:1.0:1789760770.762118:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798234752 00000100:00100000:1.0:1789760770.762123:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798234752 00000100:00100000:2.0:1789760770.762135:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789760770.762147:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798233472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762151:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789760770.762161:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798234624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760770.762201:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3461:x1876699798233472:12345-0@lo:400:kworker.0 Request processed in 57us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.762211:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798234624:12345-0@lo:400:kworker.0 Request processed in 51us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.762211:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789760770.762222:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789760770.762238:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789760770.762246:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798235136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760770.762251:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798234112 00000100:00100000:2.0:1789760770.762257:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798234112 00000100:00100000:2.0:1789760770.762280:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798234368 00000100:00100000:1.0:1789760770.762281:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798235136:12345-0@lo:400:kworker.0 Request processed in 37us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.762285:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798234368 00000100:00100000:2.0:1789760770.762302:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798234880 00000100:00100000:1.0:1789760770.762303:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789760770.762306:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798234880 00000100:00100000:1.0:1789760770.762325:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789760770.762326:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798234496 00000100:00100000:2.0:1789760770.762331:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798234496 00000100:00100000:1.0:1789760770.762339:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798234752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760770.762348:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798235008 00000100:00100000:2.0:1789760770.762352:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798235008 00000100:00100000:2.0:1789760770.762376:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1789760770.762381:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798234752:12345-0@lo:400:kworker.0 Request processed in 46us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.762386:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57acae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798234112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762393:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789760770.762430:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57acae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798234112:12345-0@lo:400:kworker.0 Request processed in 46us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.762438:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1789760770.762453:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798233984:0@lo:400:kworker.0 00000100:00100000:2.0:1789760770.762455:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1789760770.762467:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798234368:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789760770.762494:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760770.762500:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760770.762501:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798234368:12345-0@lo:400:kworker.0 Request processed in 36us (1325us total) trans 0 rc 0/0 00000100:00080000:1.0:1789760770.762504:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760770.762508:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760770.762512:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789760770.762534:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798234240:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762545:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798234752:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762557:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798234112:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762567:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798234624:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762576:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798235136:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762594:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798233600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760770.762603:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3461:1876699798233472:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762656:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1789760770.762664:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798234880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760770.762674:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789760770.762684:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5581c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798234496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762705:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798234880:12345-0@lo:400:kworker.0 Request processed in 41us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.762722:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789760770.762736:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5581c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798234496:12345-0@lo:400:kworker.0 Request processed in 53us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.762743:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789760770.762752:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798235008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760770.762759:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1789760770.762816:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798235008:12345-0@lo:400:kworker.0 Request processed in 67us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.762823:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789760770.762852:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798234496:0@lo:400:kworker.0 00000100:00100000:1.0:1789760770.762865:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798235008:0@lo:400:kworker.0 00000100:00100000:0.0:1789760770.762964:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798233728:12345-0@lo:400:kworker.0 Request processed in 3454us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.762973:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789760770.762986:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798233728:0@lo:400:kworker.0 00000100:00100000:3.0:1789760770.763106:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798234880:0@lo:400:kworker.0 00000100:00100000:3.0:1789760770.763136:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798233856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789760770.763153:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798234368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760771.271190:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760771.271220:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798235264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760771.271322:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760771.271395:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798235264 00000100:00100000:2.0:1789760771.271406:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798235264 00000100:00100000:2.0:1789760771.271467:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789760771.271479:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798235264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760771.271545:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760771.271612:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798235264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760771.271619:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789760771.273768:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798235264:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789760771.591527:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760771.783641:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760771.783674:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e54557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798235392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760771.783777:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760771.784069:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798235392 00000100:00100000:1.0:1789760771.784088:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798235392 00000100:00100000:1.0:1789760771.784154:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789760771.784167:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798235392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789760771.784228:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789760771.784294:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798235392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760771.784302:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789760771.784640:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e54557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798235392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760772.295106:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798235520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760772.295211:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760772.295306:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798235520 00000100:00100000:2.0:1789760772.295320:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798235520 00000100:00100000:2.0:1789760772.295418:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789760772.295432:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798235520:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760772.295483:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798235648:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760772.295485:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760772.295526:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760772.295557:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798235520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760772.295566:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789760772.295588:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798235648 00000100:00100000:2.0:1789760772.295593:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798235648 00000100:00100000:2.0:1789760772.295614:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789760772.295618:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798235520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760772.295624:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798235648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760772.295637:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789760772.295692:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760772.295738:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798235648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760772.295753:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789760772.297537:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798235648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760772.615204:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760773.640203:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760773.677951:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760773.677996:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760773.678028:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760773.678060:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760773.678081:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760773.678095:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777232384 00000100:00100000:0.0:1789760773.678107:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777232384 00000100:00100000:2.0:1789760773.678116:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760773.678143:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777232128 00000100:00100000:2.0:1789760773.678147:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777232128 00000100:00100000:2.0:1789760773.678186:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777232256 00000100:00100000:2.0:1789760773.678189:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777232256 00000100:00100000:2.0:1789760773.678206:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777232640 00000100:00100000:2.0:1789760773.678209:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777232640 00000100:00100000:2.0:1789760773.678222:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777232512 00000100:00100000:2.0:1789760773.678225:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777232512 00000100:00100000:2.0:1789760773.678240:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 478 00000100:00100000:0.0:1789760773.678247:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:2.0:1789760773.678253:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777232128:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760773.678264:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777232384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760773.678327:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777232384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.678336:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:1.0:1789760773.678351:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777232000 00000100:00100000:1.0:1789760773.678357:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777232000 00000100:00100000:0.0:1789760773.678370:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 479 00000100:00100000:0.0:1789760773.678380:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777232256:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760773.678393:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 390 00000100:00100000:3.0:1789760773.678443:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 480 00000100:00100000:3.0:1789760773.678453:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777232640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760773.678493:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777232000:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760773.682177:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777232128:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 3912us (4164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.682186:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777232256:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 3783us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760773.682194:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 478 00000100:00100000:0.0:1789760773.682204:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 479 00000100:00100000:2.0:1789760773.682243:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 481 00000100:00100000:2.0:1789760773.682382:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777232512:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760773.682433:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777232512:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 58us (4317us total) trans 0 rc 0/0 00000100:00080000:0.0:1789760773.682781:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789760773.682811:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760773.682815:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760773.683771:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2406:x1876699777232640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 5311us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760773.683782:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 480 00000100:00100000:1.0:1789760773.683965:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777232000:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 5472us (6021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.683974:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 390 00000100:00100000:2.0:1789760773.686687:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 481 00010000:00010000:1.0:1789760774.662959:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760775.688405:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760775.879806:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e54557ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798235776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760775.879884:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.879962:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798235776 00000100:00100000:1.0:1789760775.879969:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798235776 00000100:00080000:0.0:1789760775.879999:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760775.880028:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789760775.880038:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798235776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760775.880070:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:1.0:1789760775.880079:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760775.880132:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798235776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760775.880140:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789760775.882980:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e54557ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798235776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760775.883035:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798236288:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.883105:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.883157:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760775.883175:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798236160:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.883199:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.883243:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798236288 00000100:00100000:1.0:1789760775.883249:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798236288 00000100:00100000:1.0:1789760775.883292:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789760775.883300:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798236288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.883368:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798236288:12345-0@lo:400:kworker.0 Request processed in 68us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760775.883375:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789760775.883399:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798236416:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.883423:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.883442:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760775.883448:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798236032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760775.883471:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.883516:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798236160 00000100:00100000:1.0:1789760775.883520:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798236160 00000100:00100000:1.0:1789760775.883545:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798236416 00000100:00100000:1.0:1789760775.883547:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798236416 00000100:00100000:1.0:1789760775.883577:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1789760775.883585:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798236160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.883616:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1876699798236160:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760775.883623:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1789760775.883633:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1789760775.883638:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798236416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.883666:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798236416:12345-0@lo:400:kworker.0 Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760775.883673:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1789760775.883693:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798236032 00000100:00100000:1.0:1789760775.883697:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798236032 00000100:00100000:1.0:1789760775.883731:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789760775.883737:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798236032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789760775.883761:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760775.883811:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798236032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760775.883817:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1789760775.883838:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760775.883876:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798236032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760775.883886:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798236416:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.883921:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1876699798236160:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.883930:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798236288:0@lo:400:kworker.0 00000100:00100000:0.0:1789760775.884138:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798235904:0@lo:400:kworker.0 00000100:00100000:0.0:1789760775.884176:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760775.884309:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798235904 00000100:00100000:2.0:1789760775.884314:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798235904 00000100:00100000:0.0:1789760775.884427:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1789760775.884436:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798235904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.884598:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798235904:0@lo:400:kworker.0 00000100:00100000:0.0:1789760775.884671:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798235904:12345-0@lo:400:kworker.0 Request processed in 165us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760775.884678:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789760775.885824:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798236800:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.885877:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.885900:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798237312:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.885921:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.885941:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789760775.886033:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798236800 00000100:00100000:3.0:1789760775.886039:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798236800 00000100:00100000:3.0:1789760775.886081:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798237312 00000100:00100000:3.0:1789760775.886084:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798237312 00000100:00100000:3.0:1789760775.886105:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789760775.886112:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798236800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886155:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798236800:12345-0@lo:400:kworker.0 Request processed in 43us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760775.886161:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789760775.886175:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1789760775.886182:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798237312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886207:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798237312:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760775.886213:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1789760775.886245:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798236544:0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886273:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760775.886293:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798237056:0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886315:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760775.886333:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760775.886338:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798236928:0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886357:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760775.886410:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798236544 00000100:00100000:3.0:1789760775.886414:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798236544 00000100:00100000:3.0:1789760775.886439:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789760775.886445:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798236544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886483:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798236544:12345-0@lo:400:kworker.0 Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760775.886489:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:3.0:1789760775.886507:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760775.886531:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798236544:0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886559:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798237056 00000100:00100000:3.0:1789760775.886563:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798237056 00000100:00100000:3.0:1789760775.886591:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798236928 00000100:00100000:3.0:1789760775.886594:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798236928 00000100:00100000:3.0:1789760775.886611:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789760775.886617:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798237056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886651:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798237056:12345-0@lo:400:kworker.0 Request processed in 35us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760775.886658:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789760775.886670:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789760775.886675:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798236928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886701:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798236928:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760775.886706:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:3.0:1789760775.886722:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760775.886737:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798236928:0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.886746:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798237056:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.886919:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798236672:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.887647:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.887907:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798237184:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.887936:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.889932:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798236800:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.890034:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798237312:0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.890097:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798236672 00000100:00100000:3.0:1789760775.890104:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798236672 00000100:00100000:3.0:1789760775.890161:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798237184 00000100:00100000:3.0:1789760775.890165:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798237184 00000100:00100000:3.0:1789760775.890186:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1789760775.890194:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798236672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.890260:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1876699798236672:12345-0@lo:400:kworker.0 Request processed in 66us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760775.890268:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1789760775.890284:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1789760775.890290:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798237184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760775.890320:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1876699798237184:12345-0@lo:400:kworker.0 Request processed in 30us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760775.890326:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00080000:1.0:1789760775.890392:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760775.890425:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1876699798236672:0@lo:400:kworker.0 00000100:00100000:1.0:1789760775.890435:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1876699798237184:0@lo:400:kworker.0 00000100:00100000:0.0:1789760776.391087:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798237440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760776.391157:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760776.391416:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798237440 00000100:00100000:1.0:1789760776.391426:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798237440 00000100:00100000:1.0:1789760776.391473:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789760776.391482:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798237440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760776.391527:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760776.391704:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798237440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 222us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760776.391712:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789760776.392089:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798237440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789760776.711062:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760776.903315:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760776.903336:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e54557a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798237568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760776.903399:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760776.903536:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798237568 00000100:00100000:1.0:1789760776.903544:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798237568 00000100:00100000:1.0:1789760776.903592:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789760776.903601:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798237568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789760776.903640:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789760776.903691:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798237568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760776.903699:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789760776.903847:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e54557a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798237568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760777.415142:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798237696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760777.415213:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760777.415220:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798237824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760777.415264:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760777.415416:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798237696 00000100:00100000:3.0:1789760777.415424:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798237696 00000100:00080000:1.0:1789760777.415497:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760777.415515:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798237824 00000100:00100000:0.0:1789760777.415527:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798237824 00000100:00080000:2.0:1789760777.415601:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760777.415657:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789760777.415668:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798237696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760777.415702:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760777.415871:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798237696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760777.415878:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789760777.415894:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789760777.415900:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798237824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760777.415911:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760777.415943:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798237824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760777.415973:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789760777.416518:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798237696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760777.416585:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798237824:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789760777.735151:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760778.759972:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760778.799047:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760778.799122:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777232768 00000100:00100000:3.0:1789760778.799132:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777232768 00000100:00100000:3.0:1789760778.799181:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 392 00000100:00100000:3.0:1789760778.799190:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777232768:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760778.799297:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777232768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.799305:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 392 00000100:00100000:3.0:1789760778.800102:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760778.800135:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760778.800231:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760778.800274:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760778.800444:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760778.800469:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777233024 00000100:00100000:2.0:1789760778.800475:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777233024 00000100:00100000:2.0:1789760778.800524:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777232896 00000100:00100000:2.0:1789760778.800528:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777232896 00000100:00100000:2.0:1789760778.800547:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777233408 00000100:00100000:2.0:1789760778.800550:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777233408 00000100:00100000:2.0:1789760778.800568:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 488 00000100:00100000:2.0:1789760778.800576:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777233024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760778.800640:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777233024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760778.800648:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 488 00000100:00100000:2.0:1789760778.800664:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 489 00000100:00100000:2.0:1789760778.800670:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777232896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760778.800697:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777232896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760778.800715:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 489 00000100:00100000:2.0:1789760778.800729:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 490 00000100:00100000:2.0:1789760778.800735:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777233408:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760778.800759:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777233408:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760778.800765:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 490 00000100:00080000:2.0:1789760778.800782:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760778.800806:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760778.801173:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777233152 00000100:00100000:0.0:1789760778.801178:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777233152 00000100:00100000:0.0:1789760778.801226:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:0.0:1789760778.801233:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777233152:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760778.801269:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777233152:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760778.801276:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00080000:2.0:1789760778.801359:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760778.801735:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777233280 00000100:00100000:2.0:1789760778.801740:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777233280 00000100:00100000:2.0:1789760778.801806:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 491 00000100:00100000:2.0:1789760778.801815:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777233280:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760778.801859:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777233280:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 46us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760778.801865:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 491 00000100:00080000:0.0:1789760778.802036:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789760779.782943:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760780.807047:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760780.999932:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798237952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760781.000015:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760781.000075:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798238464:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.000098:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760781.000114:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798238976:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.000136:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760781.000165:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798239488:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.000186:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760781.000217:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798238976 00000100:00100000:3.0:1789760781.000221:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789760781.000226:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798238976 00000100:00100000:3.0:1789760781.000230:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798238080:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.000257:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760781.000293:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798238592:0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.000297:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798239488 00000100:00100000:0.0:1789760781.000302:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798239488 00000100:00100000:0.0:1789760781.000328:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789760781.000334:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760781.000340:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798238976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.000356:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798239104:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.000382:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760781.000401:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798239616:0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.000409:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798238976:12345-0@lo:400:kworker.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.000418:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789760781.000426:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760781.000441:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798239104 00000100:00100000:0.0:1789760781.000446:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798239104 00000100:00100000:3.0:1789760781.000458:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798238976:0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.000480:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798239616 00000100:00100000:0.0:1789760781.000485:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798239616 00000100:00100000:3.0:1789760781.000496:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798237952 00000100:00100000:3.0:1789760781.000501:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798237952 00000100:00100000:0.0:1789760781.000507:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789760781.000517:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798239488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.000541:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789760781.000549:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57a806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3463:x1876699798237952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760781.000573:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798239488:12345-0@lo:400:kworker.0 Request processed in 57us (384us total) trans 0 rc 0/0 00002000:00000024:3.0:1789760781.000580:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760781.000581:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789760781.000599:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789760781.000608:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e581c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798239104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.000625:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57a806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3463:x1876699798237952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.000632:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789760781.000648:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e581c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798239104:12345-0@lo:400:kworker.0 Request processed in 42us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.000656:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789760781.000937:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789760781.000947:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798239616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.000986:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798239616:12345-0@lo:400:kworker.0 Request processed in 41us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.001001:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1789760781.001025:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760781.001030:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760781.001039:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798238080 00000100:00100000:3.0:1789760781.001045:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798238080 00000100:00100000:3.0:1789760781.001093:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1789760781.001101:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798239104:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.001108:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798238080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.001118:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798239616:0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.001133:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798239488:0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.001151:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798237952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760781.001165:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798238080:12345-0@lo:400:kworker.0 Request processed in 62us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.001176:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1789760781.001181:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798238080:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.001220:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798238592 00000100:00100000:3.0:1789760781.001227:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798238592 00000100:00100000:3.0:1789760781.001268:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789760781.001276:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798238592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.001577:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798238592:12345-0@lo:400:kworker.0 Request processed in 301us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.001585:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789760781.001617:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798238592:0@lo:400:kworker.0 00000100:00100000:2.0:1789760781.003107:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798238208:0@lo:400:kworker.0 00000100:00100000:2.0:1789760781.003163:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760781.003207:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798238720:0@lo:400:kworker.0 00000100:00100000:2.0:1789760781.003231:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760781.003260:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798239232:0@lo:400:kworker.0 00000100:00100000:2.0:1789760781.003280:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760781.003297:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798239744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760781.003503:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798238464 00000100:00100000:0.0:1789760781.003511:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798238464 00000100:00100000:0.0:1789760781.003618:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798238208 00000100:00100000:0.0:1789760781.003622:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798238208 00000100:00100000:0.0:1789760781.003637:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798238720 00000100:00100000:0.0:1789760781.003640:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798238720 00000100:00100000:0.0:1789760781.003661:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798239232 00000100:00100000:0.0:1789760781.003664:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798239232 00000100:00100000:0.0:1789760781.003686:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1789760781.003695:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798238464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.003756:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3463:x1876699798238464:12345-0@lo:400:kworker.0 Request processed in 62us (3656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.003763:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1789760781.003783:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789760781.003819:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798238208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.003848:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1876699798238208:12345-0@lo:400:kworker.0 Request processed in 31us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.003863:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789760781.003877:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1789760781.003883:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798238720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760781.003915:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1876699798238720:12345-0@lo:400:kworker.0 Request processed in 32us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.003922:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1789760781.003930:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1789760781.003944:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798239232:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789760781.003949:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760781.003985:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3463:1876699798238464:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.004914:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798238336:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.005004:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1876699798239232:12345-0@lo:400:kworker.0 Request processed in 1064us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.005013:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1789760781.005104:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760781.005160:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1876699798238208:0@lo:400:kworker.0 00000100:00100000:2.0:1789760781.005174:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1876699798238720:0@lo:400:kworker.0 00000100:00100000:2.0:1789760781.005185:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1876699798239232:0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.005270:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798239744 00000100:00100000:3.0:1789760781.005276:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798239744 00000100:00100000:3.0:1789760781.005330:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789760781.005339:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798239744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760781.005358:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760781.005401:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798239744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.005408:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789760781.005559:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.005587:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798238848:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.005622:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.005648:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798239360:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.005671:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.005700:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798238848 00000100:00100000:1.0:1789760781.005704:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798238848 00000100:00100000:1.0:1789760781.005736:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798239360 00000100:00100000:1.0:1789760781.005739:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798239360 00000100:00100000:1.0:1789760781.005761:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1789760781.005768:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798238848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.005844:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798238848:12345-0@lo:400:kworker.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.005852:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1789760781.005864:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798239360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.005897:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798238336 00000100:00100000:3.0:1789760781.005903:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798238336 00000100:00100000:0.0:1789760781.005904:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798239360:12345-0@lo:400:kworker.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.005937:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789760781.005945:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798238336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.005982:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798238336:12345-0@lo:400:kworker.0 Request processed in 38us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.005988:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789760781.006098:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798239744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760781.006152:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1789760781.006185:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798238336:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.006200:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798238848:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.006209:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798239360:0@lo:400:kworker.0 00000100:00080000:1.0:1789760781.006229:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760781.006374:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1789760781.230165:0:14520:0:(nrs_tbf.c:480:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff97e4495e3c00 key gid={500} rule@0xffff97e547f42000 gen 0 rate 5 depth 3 token 0 deadline 436238856221 time 436242725707 state 0x6 ref 0 00000100:00100000:1.0:1789760781.230183:0:14520:0:(nrs_tbf.c:480:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff97e44c684800 key gid={0} rule@0xffff97e57f97d800 gen 0 rate 10000 depth 3 token 2 deadline 392888463432 time 394504083491 state 0x6 ref 0 00000100:00100000:3.0:1789760781.511191:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760781.511325:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798239872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789760781.511407:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760781.511625:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798239872 00000100:00100000:0.0:1789760781.511633:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798239872 00000100:00100000:0.0:1789760781.511683:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789760781.511692:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798239872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760781.511729:0:7305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760781.511774:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798239872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760781.511781:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789760781.512081:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798239872:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789760781.831422:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760782.023217:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760782.023239:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e54557b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798240000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760782.023306:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760782.024022:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798240000 00000100:00100000:0.0:1789760782.024040:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798240000 00000100:00100000:0.0:1789760782.024254:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789760782.024265:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798240000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760782.024319:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760782.024380:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798240000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760782.024388:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789760782.024470:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e54557b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798240000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789760782.535123:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760782.535935:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798240256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760782.536010:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760782.536173:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798240256 00000100:00100000:3.0:1789760782.536182:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798240256 00000100:00100000:3.0:1789760782.536242:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789760782.536254:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798240256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760782.536289:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760782.536342:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798240256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760782.536349:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789760782.536404:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798240256:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789760782.536498:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760782.536949:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798240128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760782.536988:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760782.537422:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798240128 00000100:00100000:3.0:1789760782.537428:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798240128 00000100:00100000:3.0:1789760782.537483:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789760782.537492:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798240128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760782.537506:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241762304 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760782.537554:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798240128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760782.537561:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789760782.537658:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798240128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760782.537848:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760782.856523:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760783.878973:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760783.919383:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760783.919426:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760783.919479:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760783.919509:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777233792 00000100:00100000:0.0:1789760783.919518:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777233792 00000100:00100000:1.0:1789760783.919549:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777233664 00000100:00100000:1.0:1789760783.919556:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777233664 00000100:00100000:0.0:1789760783.919587:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 498 00000100:00100000:1.0:1789760783.919597:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 499 00000100:00100000:0.0:1789760783.919603:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777233792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760783.919611:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777233664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760783.919690:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777233664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.919709:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 499 00000100:00100000:3.0:1789760783.919722:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777233536 00000100:00100000:3.0:1789760783.919728:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777233536 00000100:00100000:3.0:1789760783.919757:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 394 00000100:00100000:3.0:1789760783.919772:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777233536:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760783.919840:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777233536:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760783.919848:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 394 00000100:00080000:1.0:1789760783.919890:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760783.919895:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760783.920195:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777233792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.920203:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 498 00000100:00100000:2.0:1789760783.932484:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760783.932534:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760783.932577:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760783.932628:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777234048 00000100:00100000:1.0:1789760783.932643:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777234176 00000100:00100000:0.0:1789760783.932644:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777234048 00000100:00100000:1.0:1789760783.932650:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777234176 00000100:00100000:0.0:1789760783.932739:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 500 00000100:00100000:0.0:1789760783.932751:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777234048:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760783.932890:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2403:x1876699777234048:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 141us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.932898:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 500 00000100:00100000:1.0:1789760783.932946:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 501 00000100:00100000:1.0:1789760783.932956:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777234176:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1789760783.932990:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777234176:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.932996:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 501 00000100:00080000:2.0:1789760783.933225:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760783.933231:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760783.933960:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777233920 00000100:00100000:3.0:1789760783.933973:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777233920 00000100:00100000:3.0:1789760783.934129:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:3.0:1789760783.934142:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2402:x1876699777233920:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:3.0:1789760783.934176:0:8110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc2b9a3a739857b30 00000100:00080000:3.0:1789760783.934189:0:8110:0:(import.c:65:import_set_state_nolock()) ffff97e54991f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789760783.934247:0:8110:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967553 00000100:00080000:2.0:1789760783.934312:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760783.934631:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+2:2402:x1876699777233920:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 491us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760783.934642:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 127 00010000:00010000:1.0:1789760783.934733:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760784.902965:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760785.927098:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760786.119217:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798240768:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.119350:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798240384:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.119352:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.119405:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760786.119431:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798241280:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.119446:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798240896:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.119466:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.119485:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760786.119501:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798241792:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.119524:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798241408:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.119533:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.119557:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.119580:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798241920:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.119584:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798240768 00000100:00100000:0.0:1789760786.119594:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798240768 00000100:00100000:1.0:1789760786.119606:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.119643:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798240640:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.119671:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.119690:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798241152:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.119734:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760786.119881:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798240512:0@lo:400:kworker.0 00000100:00100000:2.0:1789760786.119998:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798241280 00000100:00100000:2.0:1789760786.120002:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798241280 00000100:00100000:2.0:1789760786.120046:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798241792 00000100:00100000:2.0:1789760786.120050:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798241792 00000100:00100000:2.0:1789760786.120065:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798241408 00000100:00100000:2.0:1789760786.120068:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798241408 00000100:00100000:2.0:1789760786.120081:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798241920 00000100:00100000:2.0:1789760786.120083:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798241920 00000100:00100000:2.0:1789760786.120098:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789760786.120106:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798241280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760786.120178:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798241280:12345-0@lo:400:kworker.0 Request processed in 71us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.120186:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789760786.120204:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789760786.120210:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798241792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760786.120238:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798241792:12345-0@lo:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.120244:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789760786.120253:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789760786.120258:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798241408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760786.120287:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798241408:12345-0@lo:400:kworker.0 Request processed in 28us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.120293:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789760786.120303:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789760786.120309:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798241920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760786.120332:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798241920:12345-0@lo:400:kworker.0 Request processed in 24us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.120338:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789760786.120361:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798240896 00000100:00100000:2.0:1789760786.120364:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798240896 00000100:00100000:2.0:1789760786.120391:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798240640 00000100:00100000:2.0:1789760786.120394:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798240640 00000100:00100000:2.0:1789760786.120406:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789760786.120411:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e545578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798240896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760786.120445:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e545578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798240896:12345-0@lo:400:kworker.0 Request processed in 33us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.120460:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789760786.120472:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789760786.120478:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e54557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798240640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760786.120507:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e54557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798240640:12345-0@lo:400:kworker.0 Request processed in 30us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.120513:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789760786.120532:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798240384 00000100:00100000:2.0:1789760786.120536:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798240384 00000100:00100000:2.0:1789760786.120560:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789760786.120566:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798240384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760786.120595:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3462:x1876699798240384:12345-0@lo:400:kworker.0 Request processed in 30us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.120603:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:2.0:1789760786.120632:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760786.120637:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760786.121302:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798241280:0@lo:400:kworker.0 00000100:00100000:3.0:1789760786.121320:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798241792:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.121958:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760786.125609:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798241152 00000100:00100000:0.0:1789760786.125631:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798241152 00000100:00100000:3.0:1789760786.125674:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1789760786.125701:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798240768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760786.125848:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798240768:12345-0@lo:400:kworker.0 Request processed in 160us (6497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760786.125856:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1789760786.126369:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798240768:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.126929:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1789760786.126945:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798241152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.127241:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3464:x1876699798241152:12345-0@lo:400:kworker.0 Request processed in 301us (7505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760786.127250:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00080000:0.0:1789760786.127634:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789760786.127714:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3462:1876699798240384:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.127733:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798240896:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.127747:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798241408:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.127764:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798241920:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.127878:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3464:1876699798241152:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.127893:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798241664:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.129320:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798241024:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.129385:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.129409:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798241536:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.129432:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.129461:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798242048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760786.129488:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798240512 00000100:00100000:0.0:1789760786.129499:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798240512 00000100:00100000:3.0:1789760786.129519:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760786.129593:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798241024 00000100:00100000:2.0:1789760786.129601:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798241024 00000100:00100000:3.0:1789760786.129614:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798242176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760786.129735:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798241536 00000100:00100000:0.0:1789760786.129752:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798241536 00000100:00100000:0.0:1789760786.129806:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798241664 00000100:00100000:0.0:1789760786.129809:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798241664 00000100:00100000:0.0:1789760786.129834:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1789760786.129845:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798240512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.129917:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798240512:12345-0@lo:400:kworker.0 Request processed in 74us (7964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760786.129925:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1789760786.129945:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1789760786.129951:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798241024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.129994:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798241024:12345-0@lo:400:kworker.0 Request processed in 44us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760786.130000:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1789760786.130014:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1789760786.130020:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798241536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.131443:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798241536:12345-0@lo:400:kworker.0 Request processed in 1413us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760786.131455:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1789760786.131493:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1789760786.131507:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798241664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.131606:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760786.131662:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798242048 00000100:00100000:1.0:1789760786.131683:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798242048 00000100:00100000:1.0:1789760786.131730:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789760786.131739:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798242048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789760786.131913:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760786.131958:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798242048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 221us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760786.131966:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789760786.132038:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798242048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789760786.132060:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798240512:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.132075:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798241024:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.132087:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798241536:0@lo:400:kworker.0 00000100:00100000:1.0:1789760786.132154:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789760786.132161:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760786.132169:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760786.132195:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3464:x1876699798241664:12345-0@lo:400:kworker.0 Request processed in 538us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760786.132201:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798240640:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.132208:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1789760786.132234:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3464:1876699798241664:0@lo:400:kworker.0 00000100:00100000:0.0:1789760786.132246:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798242176 00000100:00100000:0.0:1789760786.132252:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798242176 00000100:00100000:0.0:1789760786.133558:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789760786.133580:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798242176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760786.133620:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760786.133702:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798242176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760786.133709:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789760786.135020:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798242176:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789760786.172776:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:0.0:1789760786.172811:0:8141:0:(genops.c:885:class_export_put()) final put ffff97e549918000/ac82f857-edfe-4201-bbe8-4599ba569acb 00000020:00000080:2.0:1789760786.172893:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97e549918000/ac82f857-edfe-4201-bbe8-4599ba569acb for lustre-OST0000 00000020:00000080:2.0:1789760786.173003:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e54991f000 for lustre-OST0000 00000100:00100000:0.0:1789760786.631743:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760786.631815:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798242304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760786.631908:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760786.632090:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798242304 00000100:00100000:2.0:1789760786.632100:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798242304 00000100:00100000:2.0:1789760786.632167:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789760786.632178:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798242304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789760786.632234:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760786.632577:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798242304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 399us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760786.632602:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789760786.632742:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798242304:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789760786.950890:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760787.143220:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760787.143242:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798242432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789760787.143317:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760787.143375:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798242432 00000100:00100000:3.0:1789760787.143383:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798242432 00000100:00100000:0.0:1789760787.143737:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789760787.143750:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798242432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760787.144561:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760787.144682:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798242432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 934us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760787.144865:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798242432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760787.153584:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789760787.656507:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798242560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789760787.656574:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760787.656696:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798242560 00000100:00100000:3.0:1789760787.656706:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798242560 00000100:00100000:3.0:1789760787.656770:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789760787.656780:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798242560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789760787.656829:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760787.656875:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798242560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760787.656882:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789760787.656971:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798242560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789760787.657557:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760787.667163:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798242688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760787.667241:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760787.667368:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798242688 00000100:00100000:0.0:1789760787.667377:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798242688 00000100:00100000:0.0:1789760787.667434:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789760787.667444:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798242688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760787.667468:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760787.667514:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798242688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760787.667520:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789760787.667676:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57b1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798242688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760787.974947:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760788.469211:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760788.469982:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777234304 00000100:00100000:1.0:1789760788.469993:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777234304 00000100:00100000:1.0:1789760788.470237:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 167 00000100:00100000:1.0:1789760788.470250:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:11161:x1876699777234304:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1789760788.470269:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760788.470286:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a73985850f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c3c expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.470340:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.470353:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.470364:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760788.470394:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789760788.470397:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789760788.470413:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.470450:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a73985850f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 7 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.470467:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 6 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.470476:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760788.470479:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789760788.470482:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54e600, rc 0) 00000100:00100000:1.0:1789760788.470538:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11161:x1876699777234304:12345-192.168.203.38@tcp:101:bash.0 Request processed in 292us (1334us total) trans 0 rc 0/0 00000100:00080000:2.0:1789760788.470945:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760788.471124:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 167 00000100:00100000:2.0:1789760788.480758:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760788.480942:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777234432 00000100:00100000:0.0:1789760788.480952:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777234432 00000100:00100000:0.0:1789760788.481012:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:0.0:1789760788.481023:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11161:x1876699777234432:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1789760788.481042:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760788.481075:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985851d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c43 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481140:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481154:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481165:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481178:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481185:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481191:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481438:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481448:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481463:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481469:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481475:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760788.481479:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481488:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481503:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760788.481506:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760788.481510:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481516:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481528:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481534:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481539:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481543:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760788.481552:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481558:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481565:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff97e5489b1d00) 00010000:00010000:0.0:1789760788.481567:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760788.481570:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481575:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985852b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481604:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985851d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c43 expref: 7 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481614:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760788.481617:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760788.481621:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985851d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c43 expref: 7 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.481630:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d31e00, rc 0) 00000100:00100000:0.0:1789760788.481694:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:11161:x1876699777234432:12345-192.168.203.38@tcp:101:bash.0 Request processed in 673us (956us total) trans 0 rc 301/301 00000100:00100000:0.0:1789760788.481702:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 168 00010000:00010000:1.0:1789760788.999082:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760789.038732:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760789.038783:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760789.038861:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760789.038893:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760789.038947:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760789.039022:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777234816 00000100:00100000:2.0:1789760789.039031:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777234816 00000100:00100000:2.0:1789760789.039093:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777235072 00000100:00100000:2.0:1789760789.039096:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777235072 00000100:00100000:2.0:1789760789.039111:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777234688 00000100:00100000:2.0:1789760789.039113:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777234688 00000100:00100000:2.0:1789760789.039125:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777234944 00000100:00100000:2.0:1789760789.039127:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777234944 00000100:00100000:2.0:1789760789.039146:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 508 00000100:00100000:2.0:1789760789.039155:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777234816:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760789.039228:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777234816:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.039235:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 508 00000100:00100000:2.0:1789760789.039251:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 509 00000100:00100000:2.0:1789760789.039258:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777235072:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760789.039283:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777235072:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.039289:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 509 00000100:00100000:2.0:1789760789.039298:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 510 00000100:00100000:2.0:1789760789.039303:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777234688:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760789.039323:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777234688:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 20us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.039338:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 510 00000100:00100000:2.0:1789760789.039348:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 511 00000100:00100000:2.0:1789760789.039353:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777234944:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760789.039383:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2405:x1876699777234944:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.039388:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 511 00000100:00080000:0.0:1789760789.040995:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760789.041004:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760789.041373:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777234560 00000100:00100000:3.0:1789760789.041384:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777234560 00000100:00100000:3.0:1789760789.041442:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 396 00000100:00100000:3.0:1789760789.041452:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777234560:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1789760789.041525:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c9a29f0-58a4-4591-8db4-e258df357379+13:2405:x1876699777234560:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760789.041532:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 396 00010000:00010000:1.0:1789760790.023864:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760790.040928:0:14716:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77kb: Check different granular TBF type combination: jobid+opcode ========================================================== 15:46:28 (1789760788) 00010000:00010000:0.0:1789760791.047068:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760791.239146:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760791.239170:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798242816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760791.239250:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760791.239320:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798242816 00000100:00100000:1.0:1789760791.239327:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798242816 00000100:00100000:1.0:1789760791.239394:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789760791.239405:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798242816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760791.239439:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760791.239492:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798242816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.239501:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789760791.239745:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760791.239757:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798242944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760791.239825:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789760791.239862:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760791.239873:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798242944 00000100:00100000:0.0:1789760791.239876:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798242944 00000100:00100000:0.0:1789760791.239907:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789760791.239915:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798242944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789760791.239925:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760791.239957:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798242944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.239965:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:0.0:1789760791.239985:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760791.240026:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798242944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760791.240286:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798243072:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240328:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.240369:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798243584:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240399:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.240419:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798244096:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240446:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.240467:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789760791.240473:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798243200:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240516:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.240539:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798243712:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240566:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.240587:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798244224:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240613:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.240667:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798243072 00000100:00100000:0.0:1789760791.240673:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798243072 00000100:00100000:0.0:1789760791.240704:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789760791.240712:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798243072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240764:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3463:x1876699798243072:12345-0@lo:400:kworker.0 Request processed in 53us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.240772:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789760791.240811:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3463:1876699798243072:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240825:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798243584 00000100:00100000:0.0:1789760791.240830:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798243584 00000100:00100000:0.0:1789760791.240863:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789760791.240870:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798243584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.240908:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798243584:12345-0@lo:400:kworker.0 Request processed in 38us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.240915:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789760791.240933:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798244096 00000100:00100000:0.0:1789760791.240936:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798244096 00000100:00100000:0.0:1789760791.240967:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789760791.240973:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798244096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.241002:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798244096:12345-0@lo:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.241008:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789760791.241036:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798243200 00000100:00100000:0.0:1789760791.241040:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798243200 00000100:00100000:0.0:1789760791.241062:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798243712 00000100:00100000:0.0:1789760791.241065:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798243712 00000100:00100000:0.0:1789760791.241083:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798244224 00000100:00100000:0.0:1789760791.241086:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798244224 00000100:00100000:0.0:1789760791.241101:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1789760791.241107:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798243200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.241140:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1876699798243200:12345-0@lo:400:kworker.0 Request processed in 33us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.241146:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1789760791.241158:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1789760791.241164:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798243712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.241192:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1876699798243712:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.241197:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1789760791.241339:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1789760791.241354:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57b1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798244224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.241389:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57b1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1876699798244224:12345-0@lo:400:kworker.0 Request processed in 37us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.241394:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00080000:0.0:1789760791.241593:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760791.241597:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760791.241608:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798243328:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.241638:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.241664:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798243840:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.241687:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.241710:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798244352:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.241741:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.241760:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789760791.241762:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798243840 00000100:00100000:0.0:1789760791.241769:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798243456:0@lo:400:kworker.0 00000100:00100000:3.0:1789760791.241770:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798243840 00000100:00100000:0.0:1789760791.241915:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.241944:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798243968:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.241970:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760791.242502:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798243328 00000100:00100000:1.0:1789760791.242509:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798243328 00000100:00100000:1.0:1789760791.242537:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789760791.242545:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798243328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.242591:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798243328:12345-0@lo:400:kworker.0 Request processed in 46us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.242597:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789760791.242615:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798244352 00000100:00100000:1.0:1789760791.242618:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798244352 00000100:00100000:1.0:1789760791.242638:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798243456 00000100:00100000:1.0:1789760791.242641:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798243456 00000100:00100000:1.0:1789760791.242653:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1789760791.242659:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798243840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.242687:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1876699798243840:12345-0@lo:400:kworker.0 Request processed in 28us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.242693:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1789760791.242703:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1789760791.242709:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798244352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.242743:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1876699798244352:12345-0@lo:400:kworker.0 Request processed in 34us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.242748:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1789760791.242759:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1789760791.242765:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798243456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.242817:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1876699798243456:12345-0@lo:400:kworker.0 Request processed in 52us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.242823:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1789760791.242867:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3461:1876699798243456:0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.242883:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798243328:0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.242895:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3461:1876699798243840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.242906:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3461:1876699798244352:0@lo:400:kworker.0 00000100:00100000:2.0:1789760791.243908:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798242816:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789760791.246014:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760791.246159:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1876699798243200:0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.246174:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1876699798243712:0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.246186:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1876699798244224:0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.246197:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798243584:0@lo:400:kworker.0 00000100:00100000:1.0:1789760791.246218:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798244096:0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.246616:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798243968 00000100:00100000:0.0:1789760791.246624:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798243968 00000100:00100000:0.0:1789760791.247448:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789760791.247460:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798243968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760791.247544:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798243968:12345-0@lo:400:kworker.0 Request processed in 87us (5572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.247551:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789760791.247929:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798243968:0@lo:400:kworker.0 00000100:00080000:1.0:1789760791.248487:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760791.262534:0:14764:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e449966c00 rate 10000 gen 0 00000100:00100000:0.0:1789760791.262573:0:14764:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e449966100 rate 10000 gen 0 00000100:00100000:0.0:1789760791.263290:0:14764:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e449966500 rate 20 gen 0 00000100:00100000:0.0:1789760791.263299:0:14764:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e449966200 rate 20 gen 0 00000100:00100000:0.0:1789760791.263429:0:14764:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e449966300 rate 10 gen 0 00000100:00100000:0.0:1789760791.263440:0:14764:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff97e449966600 rate 10 gen 0 00000100:00100000:3.0:1789760791.324378:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760791.324460:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760791.324499:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777235200 00000100:00100000:3.0:1789760791.324511:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777235200 00000100:00100000:3.0:1789760791.324630:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777235456 00000100:00100000:3.0:1789760791.324634:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777235456 00000100:00100000:3.0:1789760791.324661:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:3.0:1789760791.324670:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777235200:12345-192.168.203.38@tcp:41:mkdir.0 00000004:00000024:3.0:1789760791.324712:0:6465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760791.324805:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2405:x1876699777235200:12345-192.168.203.38@tcp:41:mkdir.0 Request processed in 120us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.324812:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:3.0:1789760791.326437:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:3.0:1789760791.326457:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:13044:x1876699777235456:12345-192.168.203.38@tcp:36:mkdir.0 00000100:00100000:3.0:1789760791.326565:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b69180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798244480:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.326625:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.326662:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633d80 going to sleep for 11 seconds 00000100:00080000:3.0:1789760791.326692:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760791.328408:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798244480 00000100:00100000:3.0:1789760791.328417:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798244480 00000100:00100000:3.0:1789760791.328464:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789760791.328471:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6465:x1876699798244480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.328565:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6465:x1876699798244480:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.328578:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789760791.328608:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b69180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798244480:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789760791.328672:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a187100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798244608:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789760791.328713:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.328748:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5502d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760791.329525:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798244608 00000100:00100000:3.0:1789760791.329532:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798244608 00000100:00100000:3.0:1789760791.329565:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789760791.329572:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6465:x1876699798244608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.329783:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6465:x1876699798244608:12345-0@lo:1000:mdt00_000.0 Request processed in 211us (1070us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760791.329805:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789760791.331260:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a187100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798244608:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789760791.331457:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.331468:0:6465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.331478:0:6465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760791.331495:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e542b69180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798244736:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1789760791.331544:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.331582:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760791.331952:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798244736 00000100:00100000:1.0:1789760791.331962:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798244736 00000100:00100000:1.0:1789760791.332005:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789760791.332015:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6465:x1876699798244736:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789760791.332032:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760791.332048:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a739858539 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739858532 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.332086:0:6470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 5 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.332095:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a739858539 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739858532 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.333053:0:6470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 5 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.333072:0:6470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 5 pid: 6465 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.333086:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fc28e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6470:1876699798244864:192.168.203.38@tcp:104: 00000100:00100000:1.0:1789760791.333430:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41180 going to sleep for 11 seconds 00000100:00100000:3.0:1789760791.350830:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760791.350878:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777235584 00000100:00100000:3.0:1789760791.350890:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777235584 00010000:00010000:3.0:1789760791.350967:0:6450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 6 pid: 6465 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760791.351013:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:3.0:1789760791.351045:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777235584:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760791.351065:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760791.351075:0:6450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 6 pid: 6465 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.351093:0:6450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 6 pid: 6465 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.351106:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fc28e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6470:1876699798244864:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760791.351127:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54e600/0xc2b9a3a739858516 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c3c expref: 6 pid: 6465 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.351147:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a739858539 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739858532 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.351149:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760791.351162:0:6450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a739858539 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739858532 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.351192:0:6450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a739858539 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc2b9a3a739858532 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.351206:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a739858539 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc2b9a3a739858532 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760791.351262:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789760791.357912:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760791.357924:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760791.357942:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54f000, rc 0) 00000100:00100000:0.0:1789760791.358058:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6465:x1876699798244736:12345-0@lo:101:mdt00_000.0 Request processed in 26040us (26511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.358067:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00010000:00010000:2.0:1789760791.359171:0:6450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a739858539 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739858532 expref: 6 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.359195:0:6450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6450:1876699798244992:0@lo:105: 00000100:00100000:2.0:1789760791.359243:0:6450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760791.359281:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798244992 00000100:00100000:2.0:1789760791.359287:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798244992 00000100:00100000:2.0:1789760791.359331:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760791.359339:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6450:x1876699798244992:12345-0@lo:105: 00010000:00010000:2.0:1789760791.359351:0:6448:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.359362:0:6448:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.359370:0:6448:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.359391:0:6448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.359399:0:6448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.359411:0:6448:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.359427:0:6448:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97e57f543a00) 00000100:00100000:2.0:1789760791.359459:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6450:x1876699798244992:12345-0@lo:105: Request processed in 120us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760791.359466:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760791.359496:0:6450:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a6333c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760791.359518:0:6450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6450:1876699798244992:0@lo:105: 00010000:00010000:2.0:1789760791.359536:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760791.359581:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777235584:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 8546us (8765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760791.359590:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:3.0:1789760791.359881:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e542b69180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798244736:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789760791.359911:0:6465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760791.359948:0:6465:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1789760791.360004:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.360023:0:6465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.360036:0:6465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760791.360057:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245120:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1789760791.360116:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.360166:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789760791.360204:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798245120 00000100:00100000:2.0:1789760791.360212:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798245120 00000100:00100000:2.0:1789760791.360264:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789760791.360277:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6465:x1876699798245120:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1789760791.360295:0:7305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760791.360358:0:7305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39600/0xc2b9a3a739858547 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739858540 expref: -99 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.360395:0:7305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39600/0xc2b9a3a739858547 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739858540 expref: 8 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.360409:0:7305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39600/0xc2b9a3a739858547 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739858540 expref: 8 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.360417:0:7305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e543c0af00) 00010000:00010000:2.0:1789760791.360420:0:7305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760791.360423:0:7305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d39600, rc 0) 00000100:00100000:2.0:1789760791.360476:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245120:12345-0@lo:101:mdt00_000.0 Request processed in 204us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760791.360482:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789760791.361310:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245120:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789760791.361333:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.361347:0:6465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760791.361369:0:6465:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1789760791.361502:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245248:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.361565:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.361675:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760791.362834:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798245248 00000100:00100000:0.0:1789760791.362847:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798245248 00000100:00100000:0.0:1789760791.362999:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789760791.363081:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789760791.363605:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245248:12345-0@lo:1000:mdt00_000.0 Request processed in 526us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.363615:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789760791.363757:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245248:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.363957:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245376:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.364005:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.364074:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760791.364111:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798245376 00000100:00100000:0.0:1789760791.364322:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798245376 00000100:00100000:0.0:1789760791.364372:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789760791.364391:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789760791.364993:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245376:12345-0@lo:1000:mdt00_000.0 Request processed in 610us (985us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760791.365002:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789760791.365066:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245376:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.365319:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245504:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.365372:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.365502:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760791.367855:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798245504 00000100:00100000:0.0:1789760791.367870:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798245504 00000100:00100000:0.0:1789760791.367936:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789760791.367948:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789760791.368333:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245504:12345-0@lo:1000:mdt00_000.0 Request processed in 386us (2959us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760791.368343:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789760791.368573:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245504:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.370073:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245632:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.370136:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.370166:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760791.370304:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798245632 00000100:00100000:0.0:1789760791.370313:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798245632 00000100:00100000:0.0:1789760791.370370:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789760791.370401:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789760791.370500:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6465:x1876699798245632:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760791.370970:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245632:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789760791.371066:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ff5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245760:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789760791.371109:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760791.371139:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e548690d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789760791.371153:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798245760 00000100:00100000:3.0:1789760791.371160:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798245760 00000100:00100000:3.0:1789760791.371206:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789760791.371214:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6465:x1876699798245760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.371277:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6465:x1876699798245760:12345-0@lo:1000:mdt00_000.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.371286:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789760791.371318:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ff5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245760:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.371367:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f097480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245888:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.371393:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.371408:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a6333c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760791.371420:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798245888 00000100:00100000:3.0:1789760791.371423:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798245888 00000100:00100000:3.0:1789760791.371441:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789760791.371447:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6465:x1876699798245888:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.371493:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6465:x1876699798245888:12345-0@lo:1000:mdt00_000.0 Request processed in 45us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.371500:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789760791.371523:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f097480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798245888:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789760791.372128:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000040:00080000:3.0:1789760791.373692:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].5, 984 off36568 00000040:00080000:3.0:1789760791.374123:0:6465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].5, 1136 off37184 00000004:00080000:3.0:1789760791.374138:0:6465:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e57a633840 with version 12 00000004:00080000:2.0:1789760791.374221:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 12 rpc_version 12 00000020:00100000:2.0:1789760791.374276:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789760791.374290:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e57ab71f80 x1876699798246144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760791.374318:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab71f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798246144:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789760791.374424:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760791.374469:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e55a14fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760791.374754:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798246144 00000100:00100000:3.0:1789760791.374766:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798246144 00000100:00100000:3.0:1789760791.374903:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789760791.374914:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7275:x1876699798246144:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789760791.375943:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7275:x1876699798246144:12345-0@lo:1000:osp_up0-1.0 Request processed in 1025us (1512us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789760791.375954:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789760791.376198:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab71f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798246144:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1789760791.377902:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 3/0,1 mode: --/PW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.377930:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.377950:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760791.377972:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000763265f9 reply state 00000000fd294018 transno 4294967365 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.377985:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.377992:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:3.0:1789760791.377995:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789760791.377999:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760791.378007:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00000004:00080000:3.0:1789760791.378019:0:6465:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1789760791.378035:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.378058:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.378066:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.378085:0:6465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789760791.378090:0:6465:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1789760791.378096:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.378103:0:6465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760791.378232:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13044:x1876699777235456:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 51778us (53765us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789760791.378242:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 170 00010000:00010000:0.0:1789760791.379456:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760791.379472:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.379486:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543a00 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:0.0:1789760791.379494:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760791.379505:0:6454:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.379559:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.379568:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760791.379607:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.379615:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f543a00/0xc2b9a3a739858532 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739858539 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.379635:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760791.379637:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760791.379651:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760791.379661:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760791.379683:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798246272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760791.379772:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.379872:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798246272 00000100:00100000:0.0:1789760791.379880:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798246272 00000100:00100000:0.0:1789760791.379934:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760791.379944:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3461:x1876699798246272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760791.379960:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760791.379984:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a739858539 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739858532 expref: 9 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.380002:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760791.380008:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760791.380046:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3461:x1876699798246272:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.380054:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760791.380141:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798246272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760791.396176:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.396332:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777235712 00000100:00100000:0.0:1789760791.396346:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777235712 00000100:00100000:0.0:1789760791.396418:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:0.0:1789760791.396432:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:13045:x1876699777235712:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1789760791.396459:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760791.396487:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c4a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.396568:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985855c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.396592:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985855c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.396607:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985855c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760791.396650:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760791.396653:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760791.396676:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985855c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.396703:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a739858555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c4a expref: 7 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.396722:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985855c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c4a expref: 6 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.396741:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760791.396744:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760791.396748:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d31800, rc 0) 00000100:00100000:0.0:1789760791.396981:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:13045:x1876699777235712:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 551us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.396989:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:3.0:1789760791.403153:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.403246:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777235968 00000100:00100000:0.0:1789760791.403262:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777235968 00000100:00100000:0.0:1789760791.403337:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:0.0:1789760791.403350:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:13045:x1876699777235968:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1789760791.403374:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760791.403386:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789760791.403420:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a73985855c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c4a expref: 6 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.403442:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760791.403448:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760791.403464:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a739858563 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c51 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.403653:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.403670:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.403683:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.403695:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.403706:0:6466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39600/0xc2b9a3a739858547 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739858540 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.403716:0:6466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.403763:0:6466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39600/0xc2b9a3a739858547 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739858540 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760791.403784:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44a184a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6466:1876699798246400:0@lo:104: 00000100:00100000:0.0:1789760791.403875:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.403985:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5502d3840 going to sleep for 11 seconds 00000100:00100000:2.0:1789760791.404986:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798246400 00000100:00100000:2.0:1789760791.404999:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798246400 00000100:00100000:3.0:1789760791.409228:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789760791.409248:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6466:x1876699798246400:12345-0@lo:104: 00010000:00010000:3.0:1789760791.409274:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.409413:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760791.409420:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6466:x1876699798246400:12345-0@lo:104: Request processed in 177us (5544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.409449:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789760791.409479:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760791.409486:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.409496:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542000 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:3.0:1789760791.409503:0:6453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760791.409513:0:6453:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.409558:0:6453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.409565:0:6453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760791.409598:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.409605:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542000/0xc2b9a3a739858540 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739858547 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.409629:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760791.409631:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760791.409632:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760791.409641:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760791.409659:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798246528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760791.409710:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.409894:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44a184a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6466:1876699798246400:0@lo:104: 00010000:00010000:3.0:1789760791.409925:0:6466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.410014:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798246528 00000100:00100000:2.0:1789760791.410023:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798246528 00010000:00010000:2.0:1789760791.410052:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39600/0xc2b9a3a739858547 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc2b9a3a739858540 expref: 8 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.410088:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789760791.410097:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3464:x1876699798246528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760791.410111:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1789760791.505680:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967365 is committed 00010000:00010000:1.0:1789760791.514694:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d39600/0xc2b9a3a739858547 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739858540 expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.514723:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e543c0af00) 00010000:00010000:1.0:1789760791.514740:0:9898:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.514752:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.514760:0:9898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.514878:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760791.514975:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798246528:12345-0@lo:103:ldlm_bl.0 Request processed in 104878us (105262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.514987:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:3.0:1789760791.515113:0:6466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.515123:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760791.515511:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f094700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6466:1876699798246656:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789760791.515624:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.515669:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5509310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760791.515720:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798246528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760791.515839:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798246656 00000100:00100000:1.0:1789760791.515847:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798246656 00000100:00100000:1.0:1789760791.515898:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789760791.515908:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6466:x1876699798246656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789760791.515992:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6466:x1876699798246656:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.515999:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789760791.516074:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f094700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6466:1876699798246656:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789760791.516132:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858578 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516147:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858578 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516157:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858578 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516173:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516180:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516186:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516204:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516212:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760791.516216:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516225:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516239:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760791.516242:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760791.516246:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516253:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a73985856a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516266:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516272:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516278:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516283:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760791.516286:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516304:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516313:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e543c0af00) 00010000:00010000:3.0:1789760791.516315:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760791.516318:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.516325:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30800/0xc2b9a3a739858571 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.517502:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a739858563 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c51 expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.517536:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858578 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c51 expref: 6 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.517546:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16000) 00010000:00010000:3.0:1789760791.517608:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789760791.517612:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f542000, rc 0) 00000100:00100000:3.0:1789760791.517696:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:13045:x1876699777235968:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 114348us (114560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.517705:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:2.0:1789760791.523959:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760791.524305:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777236224 00000100:00100000:3.0:1789760791.524319:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777236224 00000100:00100000:3.0:1789760791.524498:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:3.0:1789760791.524512:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13045:x1876699777236224:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1789760791.524663:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760791.524692:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542e00/0xc2b9a3a73985857f lrc: 2/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c58 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760791.525366:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00010000:00010000:3.0:1789760791.525629:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542e00/0xc2b9a3a73985857f lrc: 1/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c58 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.525649:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:3.0:1789760791.525652:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760791.525658:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542e00/0xc2b9a3a73985857f lrc: 0/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c58 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.525679:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f542e00, rc 0) 00000100:00100000:2.0:1789760791.525961:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13045:x1876699777236224:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1450us (2012us total) trans 0 rc 301/301 00000100:00100000:2.0:1789760791.525972:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:1.0:1789760791.533873:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760791.534094:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777236352 00000100:00100000:2.0:1789760791.534107:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777236352 00000100:00100000:2.0:1789760791.534191:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:2.0:1789760791.534204:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:13045:x1876699777236352:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760791.534335:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760791.534364:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38e00/0xc2b9a3a739858586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c5f expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.534450:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.534467:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.534482:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760791.534542:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760791.534547:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760791.534574:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.534602:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38e00/0xc2b9a3a739858586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.534625:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 7 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.534635:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760791.534638:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760791.534643:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d38000, rc 0) 00000100:00100000:2.0:1789760791.534741:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13045:x1876699777236352:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 539us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760791.534749:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:3.0:1789760791.537199:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.537327:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777236608 00000100:00100000:0.0:1789760791.537342:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777236608 00000100:00100000:0.0:1789760791.537409:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 175 00000100:00100000:0.0:1789760791.537421:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13045:x1876699777236608:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1789760791.537448:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760791.537473:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a739858594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c66 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.537581:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.537600:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.537614:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.537631:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.537639:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.537646:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538104:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30600/0xc2b9a3a7398585a9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538128:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30600/0xc2b9a3a7398585a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538137:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30600/0xc2b9a3a7398585a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538157:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538166:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538174:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538182:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538189:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760791.538196:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538206:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538221:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760791.538225:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760791.538521:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538531:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a73985859b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538558:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538564:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538570:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538576:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760791.538579:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538585:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538594:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5489b1d00) 00010000:00010000:0.0:1789760791.538597:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760791.538600:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538606:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538658:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31800/0xc2b9a3a739858594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c66 expref: 9 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538675:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30600/0xc2b9a3a7398585a9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c66 expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.538696:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760791.538698:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760791.538701:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d30600, rc 0) 00000100:00100000:0.0:1789760791.541068:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:13045:x1876699777236608:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 3630us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.541084:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 175 00000100:00100000:3.0:1789760791.543755:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.543844:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777236864 00000100:00100000:0.0:1789760791.543858:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777236864 00000100:00100000:0.0:1789760791.543940:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1789760791.543952:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777236864:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760791.543972:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760791.544008:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30600/0xc2b9a3a7398585a9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c66 expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.544035:0:6451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760791.544041:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760791.544118:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777236864:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 167us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.544126:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1789760791.546489:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760791.546576:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777236992 00000100:00100000:2.0:1789760791.546589:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777236992 00000100:00100000:2.0:1789760791.546663:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:2.0:1789760791.546675:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13045:x1876699777236992:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760791.546702:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760791.546745:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a7398585b0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c6d expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760791.546906:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00010000:00010000:2.0:1789760791.547092:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a7398585b0 lrc: 1/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c6d expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.547118:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:2.0:1789760791.547122:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760791.547129:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a7398585b0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c6d expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.547144:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d38e00, rc 0) 00000100:00100000:2.0:1789760791.547218:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:13045:x1876699777236992:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 545us (742us total) trans 4294967366 rc 301/301 00000100:00100000:2.0:1789760791.547226:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:3.0:1789760791.550238:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760791.550500:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777237248 00000100:00100000:2.0:1789760791.550513:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777237248 00000100:00100000:2.0:1789760791.550737:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:2.0:1789760791.550751:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e542b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:13045:x1876699777237248:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:2.0:1789760791.550899:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 3/0,1 mode: --/PW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.550920:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.550935:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760791.551319:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db6b75c5 reply state 00000000b5b58f86 transno 4294967367 ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.551336:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.551368:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:2.0:1789760791.551371:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1789760791.551376:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760791.551387:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00000100:00100000:2.0:1789760791.551934:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e542b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+10:13045:x1876699777237248:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 1180us (1705us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789760791.551944:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:3.0:1789760791.555361:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.555519:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777237504 00000100:00100000:0.0:1789760791.555532:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777237504 00000100:00100000:0.0:1789760791.555677:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:0.0:1789760791.555690:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+10:13045:x1876699777237504:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1789760791.556334:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:13045:x1876699777237504:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 640us (981us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789760791.556367:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:2.0:1789760791.574354:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.574564:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777237632 00000100:00100000:0.0:1789760791.574579:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777237632 00000100:00100000:0.0:1789760791.574650:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:0.0:1789760791.574662:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+11:13046:x1876699777237632:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:0.0:1789760791.574690:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760791.574718:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30600/0xc2b9a3a7398585c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c74 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.574868:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398585cc lrc: 3/1,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.574887:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398585cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.574900:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398585cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760791.574946:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00000004:00200000:0.0:1789760791.574950:0:6466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760791.574970:0:6466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398585cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.575004:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30600/0xc2b9a3a7398585c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c74 expref: 13 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.575031:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398585cc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c74 expref: 12 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.575201:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:0.0:1789760791.575204:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760791.575209:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d31800, rc 0) 00000100:00100000:0.0:1789760791.575292:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+12:13046:x1876699777237632:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 632us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.575300:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:3.0:1789760791.578509:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760791.578722:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777237888 00000100:00100000:2.0:1789760791.578744:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777237888 00000100:00100000:2.0:1789760791.578953:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:2.0:1789760791.578970:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:13046:x1876699777237888:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:2.0:1789760791.579043:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760791.579091:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398585cc lrc: 0/0,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c74 expref: 12 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.579117:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:2.0:1789760791.579123:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760791.579154:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.579563:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.579579:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760791.580036:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f948743 reply state 000000007088bef7 transno 4294967369 ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.580083:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.580092:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:2.0:1789760791.580095:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789760791.580098:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760791.580110:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00000100:00100000:2.0:1789760791.580349:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+13:13046:x1876699777237888:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 1382us (1848us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789760791.580357:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:2.0:1789760791.636254:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.636620:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777238016 00000100:00100000:0.0:1789760791.636634:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777238016 00000100:00100000:0.0:1789760791.636714:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:0.0:1789760791.636736:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13050:x1876699777238016:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760791.636763:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760791.636834:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30600/0xc2b9a3a7398585da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c7b expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.636923:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.636941:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.636953:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.636971:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.636979:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637009:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637316:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30a00/0xc2b9a3a7398585ef lrc: 3/1,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637326:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30a00/0xc2b9a3a7398585ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637334:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30a00/0xc2b9a3a7398585ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760791.637360:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30a00/0xc2b9a3a7398585ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637375:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637597:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637605:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637613:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31000 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760791.637619:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637628:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637643:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760791.637653:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760791.637658:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637666:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a7398585e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637682:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637689:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637695:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637701:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760791.637705:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637711:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637720:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5489b1d00) 00010000:00010000:0.0:1789760791.637722:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760791.637736:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637743:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30200/0xc2b9a3a7398585e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637782:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30600/0xc2b9a3a7398585da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c7b expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637919:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30a00/0xc2b9a3a7398585ef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c7b expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.637927:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16000) 00010000:00010000:0.0:1789760791.637929:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760791.637932:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d30a00, rc 0) 00000100:00100000:0.0:1789760791.638028:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:13050:x1876699777238016:12345-192.168.203.38@tcp:101:dd.500 Request processed in 1302us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.638038:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:0.0:1789760791.641887:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.641991:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760791.642095:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777238144 00000100:00100000:1.0:1789760791.642108:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777238144 00000100:00100000:1.0:1789760791.642184:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:1.0:1789760791.642196:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+13:13050:x1876699777238144:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:1.0:1789760791.642236:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760791.642261:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f800/0xc2b9a3a7398585f6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c82 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.642342:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398585fd lrc: 3/1,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.642359:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398585fd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.642373:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398585fd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760791.642641:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00000004:00200000:1.0:1789760791.642646:0:12655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00010000:00010000:1.0:1789760791.642695:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f800/0xc2b9a3a7398585f6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c82 expref: 15 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.642720:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398585fd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c82 expref: 14 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.642741:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:1.0:1789760791.642744:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1789760791.642748:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54ee00, rc 0) 00000100:00100000:1.0:1789760791.642858:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+14:13050:x1876699777238144:12345-192.168.203.38@tcp:101:dd.500 Request processed in 662us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760791.642866:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:3.0:1789760791.648274:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777238272 00000100:00100000:3.0:1789760791.648296:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777238272 00000100:00100000:3.0:1789760791.648402:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1789760791.648415:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2405:x1876699777238272:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760791.648435:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760791.648470:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30a00/0xc2b9a3a7398585ef lrc: 0/0,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c7b expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760791.648515:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16000) 00010000:00010000:3.0:1789760791.648521:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760791.648601:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777238272:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 190us (6730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.648610:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:1.0:1789760791.649083:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760791.649521:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777238528 00000100:00100000:2.0:1789760791.649530:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777238528 00000100:00100000:2.0:1789760791.649585:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:2.0:1789760791.649595:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+14:13050:x1876699777238528:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:2.0:1789760791.649619:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760791.649639:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39c00/0xc2b9a3a739858604 lrc: 2/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c89 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.649838:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 3/0,1 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.649856:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.649869:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.650012:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.650062:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.650087:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.650333:0:6465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab72680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798246784:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789760791.650406:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760791.650473:0:6465:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789760791.650822:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798246784 00000100:00100000:3.0:1789760791.650833:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798246784 00000100:00100000:3.0:1789760791.650882:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789760791.650893:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6465:x1876699798246784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789760791.651025:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6465:x1876699798246784:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.651034:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789760791.651197:0:6465:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967365 gen 2 00000004:00080000:0.0:1789760791.651205:0:6465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967365 committed transno 4294967365 00000100:00100000:0.0:1789760791.651254:0:6465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab72680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6465:1876699798246784:0@lo:1000:mdt00_000.0 00000004:00080000:0.0:1789760791.651850:0:6465:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x6:0x0], index 1: 0 00000004:00080000:0.0:1789760791.651861:0:6465:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789760791.653467:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30600/0xc2b9a3a739858619 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.653496:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30600/0xc2b9a3a739858619 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.653510:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30600/0xc2b9a3a739858619 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.653573:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.653604:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.653611:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.653620:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.653627:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d38e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760791.654170:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.654182:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 5/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.654199:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:0.0:1789760791.654202:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760791.654445:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 3/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.654454:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d38e00/0xc2b9a3a73985860b lrc: 0/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760791.654478:0:6465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2318d2a reply state 000000004ce513b5 transno 4294967370 ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.654494:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.654501:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x2ab29dc6 (ffff97e543c0a400) 00010000:00010000:0.0:1789760791.654514:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760791.654518:0:6465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789760791.654571:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39c00/0xc2b9a3a739858604 lrc: 0/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c89 expref: 17 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.654589:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30600/0xc2b9a3a739858619 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c89 expref: 16 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.654598:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1d00) 00010000:00010000:0.0:1789760791.654601:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760791.654603:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d30600, rc 0) 00000100:00100000:0.0:1789760791.654763:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+17:13050:x1876699777238528:12345-192.168.203.38@tcp:101:dd.500 Request processed in 5167us (5679us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789760791.654773:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:1.0:1789760791.665776:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760791.670084:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777238656 00000100:00100000:3.0:1789760791.670106:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777238656 00000100:00100000:2.0:1789760791.670540:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1789760791.670551:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1876699777238656:12345-192.168.203.38@tcp:8:dd.500 00010000:00080000:2.0:1789760791.670598:0:8112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:2.0:1789760791.670638:0:8112:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739858627 00002000:00100000:2.0:1789760791.670654:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ac82f857-edfe-4201-bbe8-4599ba569acb/ffff97e550f77800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 30670848 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760791.670668:0:8112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760791.671014:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789760791.671060:0:8112:0:(import.c:65:import_set_state_nolock()) ffff97e550f72800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760791.671162:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777238656:12345-192.168.203.38@tcp:8:dd.500 Request processed in 610us (5401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760791.671170:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1789760791.673367:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.673466:0:13387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777238784 00000100:00100000:0.0:1789760791.673478:0:13387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777238784 00000100:00100000:0.0:1789760791.673562:0:13387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:0.0:1789760791.673573:0:13387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+6:13050:x1876699777238784:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760791.673596:0:13387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760791.673623:0:13387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985862e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c90 expref: -99 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760791.673658:0:13387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789760791.673683:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=467s v=(0 0) 00010000:00010000:0.0:1789760791.673688:0:13387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.673700:0:13387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985862e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c90 expref: 7 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.673760:0:13387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985862e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c90 expref: 7 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.673776:0:13387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d30200, rc 0) 00000100:00100000:0.0:1789760791.673876:0:13387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13050:x1876699777238784:12345-192.168.203.38@tcp:101:dd.500 Request processed in 304us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.673884:0:13387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00080000:2.0:1789760791.674145:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760791.699750:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760791.700080:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777238912 00000100:00100000:2.0:1789760791.700094:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777238912 00002000:00100000:2.0:1789760791.700166:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x6:0x0] (0->1048575) req@ffff97e546387100 x1876699777238912/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760791.700207:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546387100 with x1876699777238912 ext(0->1048575) 00002000:00010000:2.0:1789760791.700225:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e546387100 00000100:00100000:2.0:1789760791.700255:0:13389:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 3 deadline 0 time 467884458471 state 0x0 ref 1 00000100:00100000:2.0:1789760791.700268:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 3 deadline 467934458471 time 467884458471 state 0x1 ref 1 00000100:00100000:2.0:1789760791.700297:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 467934458471 time 467884505757 state 0x0 ref 1 00000100:00100000:2.0:1789760791.700310:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777238912:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:1.0:1789760791.731930:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760791.732011:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777239040 00000100:00100000:3.0:1789760791.732023:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777239040 00002000:00100000:3.0:1789760791.732088:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x6:0x0] (1048576->2097151) req@ffff97e57fc28e00 x1876699777239040/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760791.732101:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57fc28e00 with x1876699777239040 ext(1048576->2097151) 00002000:00010000:3.0:1789760791.732106:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57fc28e00 00000100:00100000:3.0:1789760791.732131:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 467934505757 time 467884505757 state 0x1 ref 2 00000100:00100000:3.0:1789760791.732172:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 467934505757 time 467916381388 state 0x0 ref 2 00000100:00100000:3.0:1789760791.732187:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2406:x1876699777239040:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760791.752482:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798246912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789760791.752582:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760791.752741:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798246912 00000100:00100000:0.0:1789760791.752753:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798246912 00000100:00100000:0.0:1789760791.753118:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789760791.753129:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798246912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789760791.753174:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760791.753301:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798246912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.753308:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789760791.753374:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798246912:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1789760791.784034:0:9084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000100:00100000:3.0:1789760791.798257:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2406:x1876699777239040:12345-192.168.203.38@tcp:4:dd.500 Request processed in 66055us (66324us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789760791.798277:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 1 00002000:00100000:3.0:1789760791.798297:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x6:0x0] (1048576->2097151) req@ffff97e57fc28e00 x1876699777239040/t4294967348(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760791.798309:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57fc28e00 with x1876699777239040 ext(1048576->2097151) 00002000:00010000:3.0:1789760791.798317:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57fc28e00 00000100:00100000:2.0:1789760791.799149:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2404:x1876699777238912:12345-192.168.203.38@tcp:4:dd.500 Request processed in 98834us (99416us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789760791.799159:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1789760791.799170:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 467934505757 time 467916381388 state 0x2 ref 0 00002000:00100000:2.0:1789760791.799183:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x6:0x0] (0->1048575) req@ffff97e546387100 x1876699777238912/t4294967349(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760791.799192:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546387100 with x1876699777238912 ext(0->1048575) 00002000:00010000:2.0:1789760791.799196:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e546387100 00000100:00100000:3.0:1789760791.802860:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760791.803003:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777239168 00000100:00100000:1.0:1789760791.803086:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777239168 00002000:00100000:1.0:1789760791.803157:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x6:0x0] (2097152->3145727) req@ffff97e546385c00 x1876699777239168/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760791.803171:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546385c00 with x1876699777239168 ext(2097152->3145727) 00002000:00010000:1.0:1789760791.803178:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e546385c00 00000100:00100000:1.0:1789760791.803198:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 467934505757 time 467916381388 state 0x0 ref 1 00000100:00100000:1.0:1789760791.803213:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 467966381388 time 467916381388 state 0x1 ref 1 00000100:00100000:1.0:1789760791.803268:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 467966381388 time 467987476086 state 0x0 ref 1 00000100:00100000:1.0:1789760791.803283:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+10:2403:x1876699777239168:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:1.0:1789760791.815109:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2403:x1876699777239168:12345-192.168.203.38@tcp:4:dd.500 Request processed in 11812us (12247us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789760791.815128:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1789760791.815140:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 467966381388 time 467987476086 state 0x2 ref 0 00002000:00100000:1.0:1789760791.815160:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x6:0x0] (2097152->3145727) req@ffff97e546385c00 x1876699777239168/t4294967350(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760791.815171:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546385c00 with x1876699777239168 ext(2097152->3145727) 00002000:00010000:1.0:1789760791.815179:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e546385c00 00000100:00100000:0.0:1789760791.823939:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.823996:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760791.824088:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777239296 00000100:00100000:1.0:1789760791.824101:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777239296 00000100:00100000:3.0:1789760791.824155:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777239424 00000100:00100000:3.0:1789760791.824159:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777239424 00002000:00100000:1.0:1789760791.824167:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x6:0x0] (3145728->4194303) req@ffff97e44a184380 x1876699777239296/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760791.824179:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44a184380 with x1876699777239296 ext(3145728->4194303) 00002000:00010000:1.0:1789760791.824186:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e44a184380 00000100:00100000:1.0:1789760791.824202:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 467966381388 time 467987476086 state 0x0 ref 1 00000100:00100000:3.0:1789760791.824203:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:1.0:1789760791.824214:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 468037476086 time 467987476086 state 0x1 ref 1 00000100:00100000:3.0:1789760791.824219:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1876699777239424:12345-192.168.203.38@tcp:8:dd.500 00000100:00100000:1.0:1789760791.824244:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468037476086 time 468008453375 state 0x0 ref 1 00010000:00080000:3.0:1789760791.824254:0:8110:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp t0 exp 0000000000000000 cur 468 last 0 00000100:00100000:1.0:1789760791.824255:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2403:x1876699777239296:12345-192.168.203.38@tcp:4:dd.500 00000020:00000080:3.0:1789760791.824289:0:8110:0:(genops.c:1385:class_connect()) connect: client ac82f857-edfe-4201-bbe8-4599ba569acb, cookie 0xc2b9a3a739858635 00002000:00100000:3.0:1789760791.824303:0:8110:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ac82f857-edfe-4201-bbe8-4599ba569acb/ffff97e542b49000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 201064448 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789760791.824328:0:8110:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789760791.824616:0:8110:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789760791.824654:0:8110:0:(import.c:65:import_set_state_nolock()) ffff97e542b4c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760791.824699:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2402:x1876699777239424:12345-192.168.203.38@tcp:8:dd.500 Request processed in 479us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.824707:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:3.0:1789760791.831159:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760791.831224:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777239552 00000100:00100000:0.0:1789760791.831237:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777239552 00000100:00080000:2.0:1789760791.831312:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760791.831341:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:0.0:1789760791.831370:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:13050:x1876699777239552:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760791.831395:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760791.831427:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a73985863c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c97 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760791.831464:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789760791.831494:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1789760791.831500:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.831512:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a73985863c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c97 expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.831536:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a73985863c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c97 expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.831553:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d31c00, rc 0) 00000100:00100000:0.0:1789760791.831637:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13050:x1876699777239552:12345-192.168.203.38@tcp:101:dd.500 Request processed in 271us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760791.831645:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:2.0:1789760791.838609:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2403:x1876699777239296:12345-192.168.203.38@tcp:4:dd.500 Request processed in 14339us (14595us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789760791.838628:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:2.0:1789760791.838640:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468037476086 time 468008453375 state 0x2 ref 0 00002000:00100000:2.0:1789760791.838660:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x6:0x0] (3145728->4194303) req@ffff97e44a184380 x1876699777239296/t4294967351(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760791.838688:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44a184380 with x1876699777239296 ext(3145728->4194303) 00002000:00010000:2.0:1789760791.838695:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e44a184380 00000100:00100000:3.0:1789760791.856974:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760791.857113:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777239680 00000100:00100000:1.0:1789760791.857125:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777239680 00002000:00100000:1.0:1789760791.857192:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->1048575) req@ffff97e546386a00 x1876699777239680/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760791.857204:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546386a00 with x1876699777239680 ext(0->1048575) 00002000:00010000:1.0:1789760791.857211:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e546386a00 00000100:00100000:1.0:1789760791.857231:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468037476086 time 468008453375 state 0x0 ref 1 00000100:00100000:1.0:1789760791.857244:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468058453375 time 468008453375 state 0x1 ref 1 00000100:00100000:0.0:1789760791.872323:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760791.872452:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777239808 00000100:00100000:3.0:1789760791.872477:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777239808 00002000:00100000:3.0:1789760791.872539:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1048576->2097151) req@ffff97e44a184a80 x1876699777239808/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760791.872552:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44a184a80 with x1876699777239808 ext(1048576->2097151) 00002000:00010000:3.0:1789760791.872558:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44a184a80 00000100:00100000:3.0:1789760791.872581:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468058453375 time 468008453375 state 0x1 ref 2 00000100:00100000:3.0:1789760791.874408:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468108603560 time 468058603560 state 0x1 ref 2 00000100:00100000:3.0:1789760791.874452:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2404:x1876699777239680:12345-192.168.203.38@tcp:4:dd.500 00000001:00100000:3.0:1789760791.931020:0:8141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac82f857-edfe-4201-bbe8-4599ba569acb 00000100:00100000:1.0:1789760791.935550:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+9:2404:x1876699777239680:12345-192.168.203.38@tcp:4:dd.500 Request processed in 61102us (78575us total) trans 4294967554 rc 0/0 00000100:00100000:1.0:1789760791.935569:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 4 00002000:00100000:1.0:1789760791.935587:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->1048575) req@ffff97e546386a00 x1876699777239680/t4294967554(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760791.935598:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546386a00 with x1876699777239680 ext(0->1048575) 00002000:00010000:1.0:1789760791.935607:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e546386a00 00000100:00100000:1.0:1789760791.935652:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468108603560 time 468119856465 state 0x0 ref 1 00000100:00100000:1.0:1789760791.935670:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:2403:x1876699777239808:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760791.946590:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760791.946636:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777239936 00000100:00100000:2.0:1789760791.946649:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777239936 00002000:00100000:2.0:1789760791.946716:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x6:0x0] (2097152->3145727) req@ffff97e57ab71c00 x1876699777239936/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760791.946739:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab71c00 with x1876699777239936 ext(2097152->3145727) 00002000:00010000:2.0:1789760791.946745:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab71c00 00000100:00100000:2.0:1789760791.946772:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468169856465 time 468119856465 state 0x1 ref 2 00000100:00100000:2.0:1789760791.948991:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2403:x1876699777239808:12345-192.168.203.38@tcp:4:dd.500 Request processed in 13312us (76667us total) trans 4294967555 rc 0/0 00000100:00100000:2.0:1789760791.949007:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 5 00002000:00100000:2.0:1789760791.949023:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1048576->2097151) req@ffff97e44a184a80 x1876699777239808/t4294967555(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760791.949036:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44a184a80 with x1876699777239808 ext(1048576->2097151) 00002000:00010000:2.0:1789760791.949044:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44a184a80 00000100:00100000:2.0:1789760791.960142:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760791.960306:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777240064 00000100:00100000:1.0:1789760791.960319:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777240064 00002000:00100000:1.0:1789760791.960441:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x6:0x0] (3145728->4194303) req@ffff97e57ab73800 x1876699777240064/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760791.960457:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab73800 with x1876699777240064 ext(3145728->4194303) 00002000:00010000:1.0:1789760791.960482:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab73800 00000100:00100000:1.0:1789760791.960506:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468169856465 time 468119856465 state 0x1 ref 2 00000100:00100000:1.0:1789760791.974951:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760791.975231:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777240192 00000100:00100000:2.0:1789760791.975244:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777240192 00002000:00100000:2.0:1789760791.975309:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x6:0x0] (4194304->5242879) req@ffff97e5449d6d80 x1876699777240192/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760791.975324:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d6d80 with x1876699777240192 ext(4194304->5242879) 00002000:00010000:2.0:1789760791.975350:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d6d80 00000100:00100000:2.0:1789760791.975387:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468169856465 time 468119856465 state 0x1 ref 3 00000100:00100000:3.0:1789760791.992290:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468226483404 time 468176483404 state 0x1 ref 3 00000100:00100000:3.0:1789760791.992341:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+11:2403:x1876699777239936:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760791.992816:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760791.993238:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777240320 00000100:00100000:3.0:1789760791.993249:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777240320 00002000:00100000:3.0:1789760791.993301:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x6:0x0] (5242880->6291455) req@ffff97e44a187100 x1876699777240320/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/0 e 0 to 0 dl 1789760802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760791.993314:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44a187100 with x1876699777240320 ext(5242880->6291455) 00002000:00010000:3.0:1789760791.993321:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e44a187100 00000100:00100000:3.0:1789760791.993340:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468226483404 time 468176483404 state 0x1 ref 4 00000100:00100000:1.0:1789760792.018437:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.018870:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777240448 00000100:00100000:0.0:1789760792.018885:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777240448 00002000:00100000:0.0:1789760792.018950:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x6:0x0] (6291456->7340031) req@ffff97e5449d4e00 x1876699777240448/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760792.018964:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d4e00 with x1876699777240448 ext(6291456->7340031) 00002000:00010000:0.0:1789760792.018971:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d4e00 00000100:00100000:0.0:1789760792.019031:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468226483404 time 468176483404 state 0x1 ref 5 00000100:00100000:0.0:1789760792.025976:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+13:2403:x1876699777239936:12345-192.168.203.38@tcp:4:dd.500 Request processed in 33644us (79386us total) trans 4294967556 rc 0/0 00000100:00100000:0.0:1789760792.025994:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 6 00002000:00100000:0.0:1789760792.026011:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x6:0x0] (2097152->3145727) req@ffff97e57ab71c00 x1876699777239936/t4294967556(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760792.026025:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab71c00 with x1876699777239936 ext(2097152->3145727) 00002000:00010000:0.0:1789760792.026033:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab71c00 00000100:00100000:2.0:1789760792.034314:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.034479:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777240576 00000100:00100000:1.0:1789760792.034492:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777240576 00002000:00100000:1.0:1789760792.034559:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x6:0x0] (7340032->8388607) req@ffff97e57ab70a80 x1876699777240576/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760792.034574:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab70a80 with x1876699777240576 ext(7340032->8388607) 00002000:00010000:1.0:1789760792.034580:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ab70a80 00000100:00100000:1.0:1789760792.034605:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468226483404 time 468176483404 state 0x1 ref 5 00000100:00100000:1.0:1789760792.042528:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468276721813 time 468226721813 state 0x1 ref 5 00000100:00100000:1.0:1789760792.042578:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+12:2404:x1876699777240064:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760792.062457:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+14:2404:x1876699777240064:12345-192.168.203.38@tcp:4:dd.500 Request processed in 19889us (102320us total) trans 4294967557 rc 0/0 00000100:00100000:0.0:1789760792.062475:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 7 00002000:00100000:0.0:1789760792.062492:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x6:0x0] (3145728->4194303) req@ffff97e57ab73800 x1876699777240064/t4294967557(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760792.062503:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab73800 with x1876699777240064 ext(3145728->4194303) 00002000:00010000:0.0:1789760792.062510:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ab73800 00000100:00100000:0.0:1789760792.071431:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.071589:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777240704 00000100:00100000:2.0:1789760792.071602:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777240704 00002000:00100000:2.0:1789760792.071664:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5242879) req@ffff97e57f032d80 x1876699777240704/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760792.071677:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f032d80 with x1876699777240704 ext(4194304->5242879) 00002000:00010000:2.0:1789760792.071684:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f032d80 00000100:00100000:2.0:1789760792.071705:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468276721813 time 468226721813 state 0x1 ref 5 00010000:00010000:0.0:1789760792.072298:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760792.078505:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.078572:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777240832 00000100:00100000:3.0:1789760792.078585:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777240832 00002000:00100000:3.0:1789760792.078649:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5242880->6291455) req@ffff97e5449d7800 x1876699777240832/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760792.078687:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d7800 with x1876699777240832 ext(5242880->6291455) 00002000:00010000:3.0:1789760792.078694:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d7800 00000100:00100000:3.0:1789760792.078736:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468276721813 time 468226721813 state 0x1 ref 6 00000100:00100000:0.0:1789760792.092668:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468326862849 time 468276862849 state 0x1 ref 6 00000100:00100000:0.0:1789760792.092715:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+17:2404:x1876699777240192:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:3.0:1789760792.092887:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.093054:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777240960 00000100:00100000:1.0:1789760792.093064:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777240960 00002000:00100000:1.0:1789760792.093115:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x6:0x0] (6291456->7340031) req@ffff97e546385180 x1876699777240960/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760792.093127:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546385180 with x1876699777240960 ext(6291456->7340031) 00002000:00010000:1.0:1789760792.093134:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e546385180 00000100:00100000:1.0:1789760792.093151:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468326862849 time 468276862849 state 0x1 ref 7 00000100:00100000:2.0:1789760792.107709:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+19:2404:x1876699777240192:12345-192.168.203.38@tcp:4:dd.500 Request processed in 15000us (132754us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789760792.107736:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 8 00002000:00100000:2.0:1789760792.107755:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x6:0x0] (4194304->5242879) req@ffff97e5449d6d80 x1876699777240192/t4294967352(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760792.107767:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d6d80 with x1876699777240192 ext(4194304->5242879) 00002000:00010000:2.0:1789760792.107776:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d6d80 00000100:00100000:3.0:1789760792.113091:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.113140:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.113389:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777241344 00000100:00100000:2.0:1789760792.113403:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777241344 00000100:00100000:2.0:1789760792.113481:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1789760792.113493:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+17:13050:x1876699777241344:12345-192.168.203.38@tcp:35:dd.500 00000100:00100000:2.0:1789760792.114008:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+18:13050:x1876699777241344:12345-192.168.203.38@tcp:35:dd.500 Request processed in 515us (865us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789760792.114018:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:1.0:1789760792.114407:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777241088 00000100:00100000:1.0:1789760792.114423:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777241088 00002000:00100000:1.0:1789760792.114465:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7340032->8388607) req@ffff97e546386d80 x1876699777241088/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760792.114477:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546386d80 with x1876699777241088 ext(7340032->8388607) 00002000:00010000:1.0:1789760792.114485:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e546386d80 00000100:00100000:1.0:1789760792.114503:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468326862849 time 468276862849 state 0x1 ref 7 00000100:00100000:0.0:1789760792.145299:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468379493353 time 468329493353 state 0x1 ref 7 00000100:00100000:0.0:1789760792.145347:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+18:2405:x1876699777240320:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760792.176111:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+20:2405:x1876699777240320:12345-192.168.203.38@tcp:4:dd.500 Request processed in 30773us (183312us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789760792.176131:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 9 00002000:00100000:0.0:1789760792.176148:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x6:0x0] (5242880->6291455) req@ffff97e44a187100 x1876699777240320/t4294967353(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:82/0 lens 488/448 e 0 to 0 dl 1789760802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760792.176160:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44a187100 with x1876699777240320 ext(5242880->6291455) 00002000:00010000:0.0:1789760792.176169:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e44a187100 00000100:00100000:2.0:1789760792.195781:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468429975216 time 468379975216 state 0x1 ref 6 00000100:00100000:2.0:1789760792.195870:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+19:2406:x1876699777240448:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:1.0:1789760792.212917:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.215660:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777241600 00000100:00100000:3.0:1789760792.215681:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777241600 00000100:00100000:3.0:1789760792.216184:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:3.0:1789760792.216199:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+18:13061:x1876699777241600:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760792.216235:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760792.216261:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542e00/0xc2b9a3a739858643 lrc: 2/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211c9e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.216418:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 3/0,1 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.216438:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.216452:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.216469:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.216477:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.216497:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760792.216976:0:6466:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x7:0x0], index 0: 0 00000004:00080000:3.0:1789760792.216986:0:6466:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x7:0x0], index 1: 0 00010000:00010000:3.0:1789760792.219755:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542400/0xc2b9a3a739858658 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219785:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542400/0xc2b9a3a739858658 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219818:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542400/0xc2b9a3a739858658 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219870:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219879:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219886:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219894:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219901:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:3.0:1789760792.219907:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219916:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 5/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219951:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:3.0:1789760792.219954:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760792.219959:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 3/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.219966:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543200/0xc2b9a3a73985864a lrc: 0/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760792.219987:0:6466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccf3608a reply state 000000006e7d681a transno 4294967372 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.220000:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.220007:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x151ecd9f (ffff97e544c16600) 00010000:00010000:3.0:1789760792.220009:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789760792.220013:0:6466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760792.221014:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+21:2406:x1876699777240448:12345-192.168.203.38@tcp:4:dd.500 Request processed in 25161us (202582us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789760792.221042:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 10 00002000:00100000:2.0:1789760792.223021:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x6:0x0] (6291456->7340031) req@ffff97e5449d4e00 x1876699777240448/t4294967354(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00010000:00010000:3.0:1789760792.223174:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542e00/0xc2b9a3a739858643 lrc: 0/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c9e expref: 21 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.223204:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542400/0xc2b9a3a739858658 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c9e expref: 20 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.223216:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff97e544c16100) 00010000:00010000:3.0:1789760792.223219:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789760792.223224:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f542400, rc 0) 00000100:00100000:3.0:1789760792.223299:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+21:13061:x1876699777241600:12345-192.168.203.38@tcp:101:dd.0 Request processed in 7103us (10393us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789760792.223309:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 183 00002000:00100000:2.0:1789760792.223372:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d4e00 with x1876699777240448 ext(6291456->7340031) 00002000:00010000:2.0:1789760792.223389:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d4e00 00000100:00100000:1.0:1789760792.239580:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.239626:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.239782:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.240472:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777241728 00000100:00100000:0.0:1789760792.240497:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777241728 00000100:00100000:0.0:1789760792.240603:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777241856 00000100:00100000:0.0:1789760792.240608:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777241856 00000100:00100000:3.0:1789760792.240632:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777241984 00000100:00100000:3.0:1789760792.240637:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777241984 00000100:00100000:2.0:1789760792.240764:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:2.0:1789760792.240779:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:13061:x1876699777241728:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760792.240820:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760792.240847:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ca5 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760792.240879:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789760792.240907:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789760792.240912:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.240924:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.240943:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.240985:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d38c00, rc 0) 00000100:00100000:2.0:1789760792.241351:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+20:13061:x1876699777241728:12345-192.168.203.38@tcp:101:dd.0 Request processed in 574us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.241359:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:2.0:1789760792.241395:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:2.0:1789760792.241403:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+19:13071:x1876699777241856:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760792.241412:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760792.241421:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6289818/0xc2b9a3a73985866d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cac expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.241440:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.241449:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.241453:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789760792.241458:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6289818/0xc2b9a3a73985866d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cac expref: 20 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.241627:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.241645:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 20 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.241678:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8112:1876699798247040:192.168.203.38@tcp:104: 00000100:00100000:2.0:1789760792.241848:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760792.242531:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1789760792.242550:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+21:13067:x1876699777241984:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760792.242567:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760792.242587:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000730ecbe6/0xc2b9a3a739858674 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cb3 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760792.242614:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789760792.242632:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789760792.242636:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760792.242646:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000730ecbe6/0xc2b9a3a739858674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cb3 expref: 22 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.242662:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000730ecbe6/0xc2b9a3a739858674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cb3 expref: 22 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.242694:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54e400, rc 0) 00000100:00100000:1.0:1789760792.242881:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+22:13067:x1876699777241984:12345-192.168.203.38@tcp:101:dd.0 Request processed in 338us (3098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.242889:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:3.0:1789760792.246447:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.246600:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777242112 00000100:00100000:0.0:1789760792.246613:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777242112 00000100:00100000:0.0:1789760792.246673:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:0.0:1789760792.246685:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+21:13064:x1876699777242112:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760792.246709:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760792.246744:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985867b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cba expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.246781:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789760792.246804:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789760792.246812:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985867b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cba expref: 22 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.246827:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985867b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cba expref: 22 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.246868:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d31800, rc 0) 00000100:00100000:0.0:1789760792.246935:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+22:13064:x1876699777242112:12345-192.168.203.38@tcp:101:dd.0 Request processed in 252us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760792.246942:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:3.0:1789760792.247613:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.247845:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777242240 00000100:00100000:0.0:1789760792.247853:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777242240 00000100:00100000:0.0:1789760792.247903:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:0.0:1789760792.247912:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+22:13062:x1876699777242240:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760792.247927:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760792.247941:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858682 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cc1 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.247967:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789760792.247971:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1789760792.247977:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858682 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc1 expref: 23 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.247988:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858682 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc1 expref: 23 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.247999:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d30800, rc 0) 00000100:00100000:0.0:1789760792.248076:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+23:13062:x1876699777242240:12345-192.168.203.38@tcp:101:dd.0 Request processed in 156us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760792.248083:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:0.0:1789760792.249321:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468483518863 time 468433518863 state 0x1 ref 5 00000100:00100000:0.0:1789760792.249348:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+21:2405:x1876699777240576:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:0.0:1789760792.253247:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8112:1876699798247040:192.168.203.38@tcp:104: 00010000:00010000:0.0:1789760792.253302:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6289818/0xc2b9a3a73985866d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cac expref: 22 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.253329:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d38400, rc 0) 00000100:00100000:0.0:1789760792.253391:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+22:13071:x1876699777241856:12345-192.168.203.38@tcp:101:dd.0 Request processed in 11988us (13762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760792.253402:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:0.0:1789760792.255109:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.255476:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777242368 00000100:00100000:3.0:1789760792.255489:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777242368 00000100:00100000:3.0:1789760792.255562:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:3.0:1789760792.255574:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+22:13070:x1876699777242368:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760792.255604:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760792.255630:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858689 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cc8 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.255707:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789760792.255714:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789760792.255741:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858689 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc8 expref: 23 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.255757:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858689 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc8 expref: 23 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.255773:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f542e00, rc 0) 00000100:00100000:2.0:1789760792.257192:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+23:13070:x1876699777242368:12345-192.168.203.38@tcp:101:dd.0 Request processed in 1606us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.257205:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:2.0:1789760792.257338:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.257593:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777242496 00000100:00100000:3.0:1789760792.257604:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777242496 00000100:00100000:3.0:1789760792.257660:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:3.0:1789760792.257672:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+23:13072:x1876699777242496:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1789760792.257695:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760792.257729:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004aa23c20/0xc2b9a3a739858690 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ccf expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.257779:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789760792.257813:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(5 0) 00010000:00010000:3.0:1789760792.257822:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aa23c20/0xc2b9a3a739858690 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ccf expref: 24 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.257837:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004aa23c20/0xc2b9a3a739858690 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ccf expref: 24 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.257850:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f543200, rc 0) 00000100:00100000:2.0:1789760792.257923:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+24:13072:x1876699777242496:12345-192.168.203.38@tcp:101:dd.0 Request processed in 252us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.257932:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:0.0:1789760792.263096:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e5449d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798247168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760792.263197:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.263638:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798247168 00000100:00100000:1.0:1789760792.263649:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798247168 00000100:00100000:1.0:1789760792.263726:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789760792.263746:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798247168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789760792.263830:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789760792.263898:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798247168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.263906:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789760792.264089:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e5449d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798247168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760792.273126:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+23:2405:x1876699777240576:12345-192.168.203.38@tcp:4:dd.500 Request processed in 23772us (238813us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789760792.273144:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 11 00002000:00100000:0.0:1789760792.273167:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6:0x0] (7340032->8388607) req@ffff97e57ab70a80 x1876699777240576/t4294967355(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760792.273179:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab70a80 with x1876699777240576 ext(7340032->8388607) 00002000:00010000:0.0:1789760792.273186:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57ab70a80 00000100:00100000:1.0:1789760792.289921:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.290026:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777242624 00000100:00100000:3.0:1789760792.290039:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777242624 00002000:00100000:3.0:1789760792.290104:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x7:0x0] (3145728->4194303) req@ffff97e5449d4000 x1876699777242624/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.290118:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d4000 with x1876699777242624 ext(3145728->4194303) 00002000:00010000:3.0:1789760792.290125:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d4000 00000100:00100000:3.0:1789760792.290156:0:8118:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 468474359901 state 0x0 ref 1 00000100:00100000:3.0:1789760792.290176:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 3 deadline 468474459901 time 468474359901 state 0x1 ref 1 00000100:00100000:1.0:1789760792.290382:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468474459901 time 468474579381 state 0x0 ref 1 00000100:00100000:1.0:1789760792.290399:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+23:2403:x1876699777242624:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760792.295050:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.295218:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777242752 00000100:00100000:1.0:1789760792.295241:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777242752 00002000:00100000:1.0:1789760792.295305:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x7:0x0] (2097152->3145727) req@ffff97e57f030700 x1876699777242752/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760792.295318:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f030700 with x1876699777242752 ext(2097152->3145727) 00002000:00010000:1.0:1789760792.295325:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f030700 00000100:00100000:1.0:1789760792.295390:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468474679381 time 468474579381 state 0x1 ref 2 00000100:00100000:1.0:1789760792.295441:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468474679381 time 468479649133 state 0x0 ref 2 00000100:00100000:1.0:1789760792.295458:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+24:2404:x1876699777242752:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760792.299435:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468533629159 time 468483629159 state 0x1 ref 4 00000100:00100000:0.0:1789760792.299478:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+23:2404:x1876699777240704:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760792.305927:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.307014:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777242880 00000100:00100000:1.0:1789760792.307031:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777242880 00000100:00100000:1.0:1789760792.307108:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:1.0:1789760792.307120:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+25:13069:x1876699777242880:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760792.307144:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760792.307173:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f38f6d02/0xc2b9a3a739858697 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cd6 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.307353:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(5 0) 00010000:00010000:1.0:1789760792.307361:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789760792.307370:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f38f6d02/0xc2b9a3a739858697 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cd6 expref: 26 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.307387:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f38f6d02/0xc2b9a3a739858697 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cd6 expref: 26 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.307404:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54fa00, rc 0) 00000100:00100000:0.0:1789760792.310354:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.310409:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777243008 00000100:00100000:3.0:1789760792.310423:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777243008 00002000:00100000:3.0:1789760792.310484:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x7:0x0] (7340032->8388607) req@ffff97e57f031c00 x1876699777243008/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.310499:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f031c00 with x1876699777243008 ext(7340032->8388607) 00002000:00010000:3.0:1789760792.310506:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f031c00 00000100:00100000:3.0:1789760792.310542:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468479749133 time 468479649133 state 0x1 ref 3 00000100:00100000:3.0:1789760792.310575:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468479749133 time 468494782914 state 0x0 ref 3 00000100:00100000:3.0:1789760792.310590:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2403:x1876699777243008:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:1.0:1789760792.317955:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+26:13069:x1876699777242880:12345-192.168.203.38@tcp:101:dd.0 Request processed in 10818us (12023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.317972:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:0.0:1789760792.328182:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2403:x1876699777242624:12345-192.168.203.38@tcp:4:dd.0 Request processed in 37702us (38191us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789760792.328202:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 16 00002000:00100000:0.0:1789760792.328219:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x7:0x0] (3145728->4194303) req@ffff97e5449d4000 x1876699777242624/t4294967356(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.328232:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d4000 with x1876699777242624 ext(3145728->4194303) 00002000:00010000:0.0:1789760792.328240:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d4000 00000100:00100000:2.0:1789760792.331468:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.331619:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777243136 00000100:00100000:0.0:1789760792.331632:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777243136 00002000:00100000:0.0:1789760792.331698:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7:0x0] (0->1048575) req@ffff97e57ab71f80 x1876699777243136/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.331711:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab71f80 with x1876699777243136 ext(0->1048575) 00010000:00010000:0.0:1789760792.331731:0:8119:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 26 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.331753:0:8119:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 26 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760792.331762:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97e57ab71f80 00000100:00100000:0.0:1789760792.331814:0:8119:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e5501f3c00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966100 gen 0 rate 10000 depth 3 token 3 deadline 0 time 468515996549 state 0x0 ref 1 00000100:00100000:0.0:1789760792.331828:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e5501f3c00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966100 gen 0 rate 10000 depth 3 token 3 deadline 468516096549 time 468515996549 state 0x1 ref 1 00000100:00100000:0.0:1789760792.331861:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e5501f3c00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966100 gen 0 rate 10000 depth 3 token 2 deadline 468516096549 time 468516069450 state 0x0 ref 1 00000100:00100000:0.0:1789760792.331889:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+26:2404:x1876699777243136:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760792.341208:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2404:x1876699777242752:12345-192.168.203.38@tcp:4:dd.0 Request processed in 45739us (46158us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789760792.341227:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 17 00002000:00100000:0.0:1789760792.341244:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x7:0x0] (2097152->3145727) req@ffff97e57f030700 x1876699777242752/t4294967357(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.341256:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f030700 with x1876699777242752 ext(2097152->3145727) 00002000:00010000:0.0:1789760792.341262:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f030700 00000100:00100000:0.0:1789760792.349193:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.350931:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777243264 00000100:00100000:2.0:1789760792.350950:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777243264 00000100:00100000:2.0:1789760792.351033:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:2.0:1789760792.351045:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+28:13063:x1876699777243264:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760792.351482:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760792.351509:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085af4ac7/0xc2b9a3a73985869e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cdd expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.351553:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x7:0x0].0x0 since=0s v=(6 0) 00010000:00010000:2.0:1789760792.351561:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789760792.351569:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085af4ac7/0xc2b9a3a73985869e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cdd expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.351603:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085af4ac7/0xc2b9a3a73985869e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cdd expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.351621:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d38e00, rc 0) 00000100:00100000:2.0:1789760792.351744:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+29:13063:x1876699777243264:12345-192.168.203.38@tcp:101:dd.0 Request processed in 701us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.351752:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:2.0:1789760792.358503:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2404:x1876699777240704:12345-192.168.203.38@tcp:4:dd.500 Request processed in 59028us (287069us total) trans 4294967558 rc 0/0 00000100:00100000:3.0:1789760792.358701:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468592727756 time 468542727756 state 0x1 ref 4 00000100:00100000:3.0:1789760792.358736:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2404:x1876699777240832:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760792.359778:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 12 00002000:00100000:2.0:1789760792.359807:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5242879) req@ffff97e57f032d80 x1876699777240704/t4294967558(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760792.359819:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f032d80 with x1876699777240704 ext(4194304->5242879) 00002000:00010000:2.0:1789760792.359827:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57f032d80 00000100:00100000:0.0:1789760792.360731:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.360761:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777243392 00000100:00100000:0.0:1789760792.360771:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777243392 00002000:00100000:0.0:1789760792.360851:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x7:0x0] (0->1048575) req@ffff97e57f71b100 x1876699777243392/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.360862:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f71b100 with x1876699777243392 ext(0->1048575) 00002000:00010000:0.0:1789760792.360867:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f71b100 00000100:00100000:0.0:1789760792.360912:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468494882914 time 468494782914 state 0x1 ref 2 00000100:00100000:0.0:1789760792.360937:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468494882914 time 468545146720 state 0x0 ref 2 00000100:00100000:0.0:1789760792.360950:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2403:x1876699777243392:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760792.361151:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.361222:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.361244:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777243520 00000100:00100000:0.0:1789760792.361261:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777243520 00002000:00100000:0.0:1789760792.361285:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x7:0x0] (4194304->5242879) req@ffff97e57f71a680 x1876699777243520/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.361294:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f71a680 with x1876699777243520 ext(4194304->5242879) 00002000:00010000:0.0:1789760792.361297:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f71a680 00000100:00100000:0.0:1789760792.361306:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468545246720 time 468545146720 state 0x1 ref 3 00000100:00100000:0.0:1789760792.361327:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777243648 00000100:00100000:0.0:1789760792.361330:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777243648 00002000:00100000:0.0:1789760792.361347:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x7:0x0] (5242880->6291455) req@ffff97e57f71ad80 x1876699777243648/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.361355:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f71ad80 with x1876699777243648 ext(5242880->6291455) 00002000:00010000:0.0:1789760792.361358:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f71ad80 00000100:00100000:1.0:1789760792.361364:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468545246720 time 468545568708 state 0x0 ref 3 00000100:00100000:1.0:1789760792.361382:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+32:2403:x1876699777243520:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760792.363964:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468545668708 time 468545568708 state 0x1 ref 4 00000100:00100000:1.0:1789760792.363978:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.364089:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468545668708 time 468548294261 state 0x0 ref 4 00000100:00100000:3.0:1789760792.364117:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+33:2406:x1876699777243648:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760792.364158:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777243776 00000100:00100000:0.0:1789760792.364168:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777243776 00002000:00100000:0.0:1789760792.364222:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x7:0x0] (1048576->2097151) req@ffff97e5449d4700 x1876699777243776/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.364244:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d4700 with x1876699777243776 ext(1048576->2097151) 00002000:00010000:0.0:1789760792.364252:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d4700 00000100:00100000:0.0:1789760792.364267:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468548394261 time 468548294261 state 0x1 ref 5 00000100:00100000:0.0:1789760792.364281:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468548394261 time 468548490352 state 0x0 ref 5 00000100:00100000:0.0:1789760792.364293:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2403:x1876699777243776:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760792.371467:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.371757:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777243904 00000100:00100000:2.0:1789760792.371770:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777243904 00002000:00100000:2.0:1789760792.371850:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x7:0x0] (6291456->7340031) req@ffff97e57f718e00 x1876699777243904/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760792.371863:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f718e00 with x1876699777243904 ext(6291456->7340031) 00002000:00010000:2.0:1789760792.371870:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f718e00 00000100:00100000:2.0:1789760792.371928:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468548590352 time 468548490352 state 0x1 ref 6 00000100:00100000:2.0:1789760792.371960:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468548590352 time 468556168512 state 0x0 ref 6 00000100:00100000:2.0:1789760792.372568:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+37:2404:x1876699777243904:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760792.372825:0:8118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 10 min 3 max 116 00000100:00100000:2.0:1789760792.372835:0:8118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_010' 00000100:00100000:2.0:1789760792.372953:0:13388:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 10 min 3 max 116 00000100:00100000:2.0:1789760792.374537:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2403:x1876699777243008:12345-192.168.203.38@tcp:4:dd.0 Request processed in 63936us (64181us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1789760792.374553:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 18 00002000:00100000:2.0:1789760792.374571:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x7:0x0] (7340032->8388607) req@ffff97e57f031c00 x1876699777243008/t4294967358(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760792.374583:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f031c00 with x1876699777243008 ext(7340032->8388607) 00002000:00010000:2.0:1789760792.374591:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f031c00 00000100:00100000:3.0:1789760792.374995:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2403:x1876699777243392:12345-192.168.203.38@tcp:4:dd.0 Request processed in 14043us (14276us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1789760792.375007:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 19 00002000:00100000:3.0:1789760792.375016:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x7:0x0] (0->1048575) req@ffff97e57f71b100 x1876699777243392/t4294967359(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.375026:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f71b100 with x1876699777243392 ext(0->1048575) 00002000:00010000:3.0:1789760792.375030:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f71b100 00000100:00100000:0.0:1789760792.377298:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2404:x1876699777243136:12345-192.168.203.38@tcp:4:dd.0 Request processed in 45397us (45830us total) trans 4294967559 rc 0/0 00000100:00100000:0.0:1789760792.377315:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1789760792.377326:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e5501f3c00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966100 gen 0 rate 10000 depth 3 token 2 deadline 468516096549 time 468516069450 state 0x2 ref 0 00002000:00100000:0.0:1789760792.377345:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7:0x0] (0->1048575) req@ffff97e57ab71f80 x1876699777243136/t4294967559(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.377355:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ab71f80 with x1876699777243136 ext(0->1048575) 00010000:00010000:0.0:1789760792.377368:0:8119:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 30 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.377391:0:8119:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 30 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760792.377401:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff97e57ab71f80 00000100:00100000:1.0:1789760792.381836:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2403:x1876699777243520:12345-192.168.203.38@tcp:4:dd.0 Request processed in 20407us (20634us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789760792.381856:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 20 00002000:00100000:1.0:1789760792.381874:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x7:0x0] (4194304->5242879) req@ffff97e57f71a680 x1876699777243520/t4294967360(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760792.381885:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f71a680 with x1876699777243520 ext(4194304->5242879) 00002000:00010000:1.0:1789760792.381893:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f71a680 00000100:00100000:0.0:1789760792.391306:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.391353:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777244032 00000100:00100000:0.0:1789760792.391367:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777244032 00010000:00010000:0.0:1789760792.391423:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 30 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.391473:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:0.0:1789760792.391484:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2405:x1876699777244032:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760792.391502:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789760792.391540:0:6451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1789760792.391544:0:6451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1789760791 00002000:00010000:0.0:1789760792.391547:0:6451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1789760791 00010000:00010000:0.0:1789760792.391554:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 30 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391570:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 30 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391602:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3cafe3/0xc2b9a3a739858666 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ca5 expref: 30 pid: 8112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391627:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391632:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391644:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6289818/0xc2b9a3a73985866d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cac expref: 29 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391656:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6289818/0xc2b9a3a73985866d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cac expref: 29 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391667:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391670:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391677:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985867b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cba expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391686:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985867b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cba expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391706:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391710:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391716:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc1 expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391738:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858682 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc1 expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391746:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391749:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391754:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858689 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc8 expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391764:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858689 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc8 expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391771:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391773:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391778:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004aa23c20/0xc2b9a3a739858690 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ccf expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391825:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aa23c20/0xc2b9a3a739858690 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ccf expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391835:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391843:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391850:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f38f6d02/0xc2b9a3a739858697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cd6 expref: 29 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391858:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f38f6d02/0xc2b9a3a739858697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cd6 expref: 29 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391864:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391867:0:6451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789760792.391871:0:6451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085af4ac7/0xc2b9a3a73985869e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cdd expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391879:0:6451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085af4ac7/0xc2b9a3a73985869e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cdd expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.391924:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000085af4ac7/0xc2b9a3a73985869e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cdd expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.391943:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247296:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760792.392060:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f38f6d02/0xc2b9a3a739858697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cd6 expref: 29 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.392073:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247424:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760792.392109:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004aa23c20/0xc2b9a3a739858690 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ccf expref: 29 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.392133:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247552:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760792.392169:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858689 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc8 expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.392180:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247680:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760792.392211:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858682 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc1 expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.392223:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247808:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760792.392252:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985867b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cba expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.392262:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f719500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247936:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760792.392289:0:6451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d6289818/0xc2b9a3a73985866d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cac expref: 29 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760792.392300:0:6451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f718380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798248064:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760792.392320:0:6451:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e5502d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760792.396053:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2404:x1876699777240832:12345-192.168.203.38@tcp:4:dd.500 Request processed in 37318us (317546us total) trans 4294967560 rc 0/0 00000100:00100000:2.0:1789760792.396073:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 13 00002000:00100000:2.0:1789760792.396093:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5242880->6291455) req@ffff97e5449d7800 x1876699777240832/t4294967560(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760792.396106:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d7800 with x1876699777240832 ext(5242880->6291455) 00002000:00010000:2.0:1789760792.396114:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d7800 00000100:00100000:3.0:1789760792.399176:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2406:x1876699777243648:12345-192.168.203.38@tcp:4:dd.0 Request processed in 35054us (37935us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1789760792.399193:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 21 00002000:00100000:3.0:1789760792.399211:0:13391:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x7:0x0] (5242880->6291455) req@ffff97e57f71ad80 x1876699777243648/t4294967361(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.399222:0:13391:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f71ad80 with x1876699777243648 ext(5242880->6291455) 00002000:00010000:3.0:1789760792.399240:0:13391:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f71ad80 00000100:00100000:0.0:1789760792.399773:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247296:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760792.399805:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247424:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760792.399817:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247552:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760792.399843:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247680:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760792.399852:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247936:192.168.203.38@tcp:105: 00000100:00100000:0.0:1789760792.399861:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f718380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798248064:192.168.203.38@tcp:105: 00000100:00100000:1.0:1789760792.400238:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2403:x1876699777243776:12345-192.168.203.38@tcp:4:dd.0 Request processed in 35945us (36268us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789760792.400248:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 22 00002000:00100000:1.0:1789760792.400258:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x7:0x0] (1048576->2097151) req@ffff97e5449d4700 x1876699777243776/t4294967362(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760792.400268:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d4700 with x1876699777243776 ext(1048576->2097151) 00002000:00010000:1.0:1789760792.400273:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d4700 00000100:00100000:3.0:1789760792.405000:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2404:x1876699777243904:12345-192.168.203.38@tcp:4:dd.0 Request processed in 32998us (33528us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789760792.405019:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:3.0:1789760792.405033:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468548590352 time 468556168512 state 0x2 ref 0 00002000:00100000:3.0:1789760792.405052:0:13385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x7:0x0] (6291456->7340031) req@ffff97e57f718e00 x1876699777243904/t4294967363(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.405063:0:13385:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57f718e00 with x1876699777243904 ext(6291456->7340031) 00002000:00010000:3.0:1789760792.405071:0:13385:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e57f718e00 00000100:00100000:2.0:1789760792.408784:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468642979396 time 468592979396 state 0x1 ref 2 00000100:00100000:2.0:1789760792.408859:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2403:x1876699777240960:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:1.0:1789760792.429284:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.429335:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.429493:0:6451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f719180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6451:1876699798247808:192.168.203.38@tcp:105: 00010000:00010000:0.0:1789760792.429549:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760792.429634:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+30:2405:x1876699777244032:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 38150us (38342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760792.429649:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1789760792.429881:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777244160 00000100:00100000:3.0:1789760792.429891:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777244160 00002000:00100000:3.0:1789760792.429961:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x7:0x0] (2097152->3145727) req@ffff97e5449d5500 x1876699777244160/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.429972:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d5500 with x1876699777244160 ext(2097152->3145727) 00002000:00010000:3.0:1789760792.429977:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d5500 00000100:00100000:3.0:1789760792.429995:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468548590352 time 468556168512 state 0x0 ref 1 00000100:00100000:3.0:1789760792.430009:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468556268512 time 468556168512 state 0x1 ref 1 00000100:00100000:3.0:1789760792.430030:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777244288 00000100:00100000:3.0:1789760792.430034:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777244288 00002000:00100000:3.0:1789760792.430051:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x7:0x0] (7340032->8388607) req@ffff97e5449d6680 x1876699777244288/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.430059:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d6680 with x1876699777244288 ext(7340032->8388607) 00002000:00010000:3.0:1789760792.430063:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d6680 00000100:00100000:3.0:1789760792.430078:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468556268512 time 468556168512 state 0x1 ref 2 00000100:00100000:3.0:1789760792.430098:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468614406549 time 468614306549 state 0x1 ref 2 00000100:00100000:3.0:1789760792.430110:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+31:2404:x1876699777244160:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:0.0:1789760792.430111:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 1 deadline 468614406549 time 468614318217 state 0x0 ref 2 00000100:00100000:0.0:1789760792.430121:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+31:2404:x1876699777244288:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760792.439776:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.439918:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777244416 00000100:00100000:0.0:1789760792.439931:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777244416 00002000:00100000:0.0:1789760792.440003:0:14781:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x7:0x0] (5242880->6291455) req@ffff97e44c682680 x1876699777244416/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.440020:0:14781:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44c682680 with x1876699777244416 ext(5242880->6291455) 00002000:00010000:0.0:1789760792.440028:0:14781:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44c682680 00000100:00100000:0.0:1789760792.440079:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 1 deadline 468614418217 time 468614318217 state 0x1 ref 3 00000100:00100000:0.0:1789760792.440107:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468614418217 time 468624315469 state 0x0 ref 3 00000100:00100000:0.0:1789760792.440119:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+34:2405:x1876699777244416:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:2.0:1789760792.445858:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2403:x1876699777240960:12345-192.168.203.38@tcp:4:dd.500 Request processed in 37001us (352954us total) trans 4294967561 rc 0/0 00000100:00100000:2.0:1789760792.445886:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 14 00002000:00100000:2.0:1789760792.445902:0:13388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6291456->7340031) req@ffff97e546385180 x1876699777240960/t4294967561(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760792.445915:0:13388:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546385180 with x1876699777240960 ext(6291456->7340031) 00002000:00010000:2.0:1789760792.445923:0:13388:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e546385180 00000100:00100000:0.0:1789760792.446221:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2404:x1876699777244160:12345-192.168.203.38@tcp:4:dd.0 Request processed in 16110us (16951us total) trans 4294967562 rc 0/0 00000100:00100000:0.0:1789760792.446240:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 24 00002000:00100000:0.0:1789760792.446247:0:13389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x7:0x0] (2097152->3145727) req@ffff97e5449d5500 x1876699777244160/t4294967562(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.446255:0:13389:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d5500 with x1876699777244160 ext(2097152->3145727) 00002000:00010000:0.0:1789760792.446259:0:13389:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d5500 00000100:00100000:3.0:1789760792.456410:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2404:x1876699777244288:12345-192.168.203.38@tcp:4:dd.0 Request processed in 26274us (27059us total) trans 4294967563 rc 0/0 00000100:00100000:3.0:1789760792.456427:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 25 00002000:00100000:3.0:1789760792.456444:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7:0x0] (7340032->8388607) req@ffff97e5449d6680 x1876699777244288/t4294967563(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.456456:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d6680 with x1876699777244288 ext(7340032->8388607) 00002000:00010000:3.0:1789760792.456464:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d6680 00000100:00100000:0.0:1789760792.458737:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+36:2405:x1876699777244416:12345-192.168.203.38@tcp:4:dd.0 Request processed in 18594us (18952us total) trans 4294967564 rc 0/0 00000100:00100000:0.0:1789760792.458753:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1789760792.458886:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468614418217 time 468624315469 state 0x2 ref 0 00002000:00100000:0.0:1789760792.458907:0:14781:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x7:0x0] (5242880->6291455) req@ffff97e44c682680 x1876699777244416/t4294967564(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.458918:0:14781:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44c682680 with x1876699777244416 ext(5242880->6291455) 00002000:00010000:0.0:1789760792.458926:0:14781:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44c682680 00000100:00100000:0.0:1789760792.458968:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468642979396 time 468643175741 state 0x0 ref 1 00000100:00100000:0.0:1789760792.458984:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+35:2404:x1876699777241088:12345-192.168.203.38@tcp:4:dd.500 00000100:00100000:2.0:1789760792.461020:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.461193:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777244544 00000100:00100000:1.0:1789760792.461215:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777244544 00002000:00100000:1.0:1789760792.461276:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x7:0x0] (1048576->2097151) req@ffff97e44c680700 x1876699777244544/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760792.461289:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44c680700 with x1876699777244544 ext(1048576->2097151) 00002000:00010000:1.0:1789760792.461295:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44c680700 00000100:00100000:1.0:1789760792.461312:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468614418217 time 468624315469 state 0x0 ref 1 00000100:00100000:1.0:1789760792.461343:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468624415469 time 468624315469 state 0x1 ref 1 00000100:00100000:1.0:1789760792.461390:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468624415469 time 468645599287 state 0x0 ref 1 00000100:00100000:1.0:1789760792.461404:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+37:2403:x1876699777244544:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760792.468829:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.469222:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777244672 00000100:00100000:2.0:1789760792.469235:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777244672 00002000:00100000:2.0:1789760792.469297:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x7:0x0] (3145728->4194303) req@ffff97e57ff0d500 x1876699777244672/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760792.469310:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ff0d500 with x1876699777244672 ext(3145728->4194303) 00002000:00010000:2.0:1789760792.469316:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ff0d500 00000100:00100000:2.0:1789760792.469340:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468645699287 time 468645599287 state 0x1 ref 2 00000100:00100000:2.0:1789760792.469386:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468645699287 time 468653594738 state 0x0 ref 2 00000100:00100000:2.0:1789760792.469399:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2404:x1876699777244672:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:1.0:1789760792.474062:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.474283:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.474602:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.474707:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777245184 00000100:00100000:2.0:1789760792.474730:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777245184 00000100:00100000:2.0:1789760792.474844:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:2.0:1789760792.474857:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565dd8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+21:13071:x1876699777245184:12345-192.168.203.38@tcp:35:dd.0 00000001:00080000:2.0:1789760792.475230:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967373 00000100:00100000:2.0:1789760792.475380:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565dd8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+23:13071:x1876699777245184:12345-192.168.203.38@tcp:35:dd.0 Request processed in 525us (777us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789760792.475406:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000020:00080000:2.0:1789760792.475411:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789760792.478237:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777244800 00000100:00100000:0.0:1789760792.478256:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777244800 00002000:00100000:0.0:1789760792.478323:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (4194304->5242879) req@ffff97e5449d5880 x1876699777244800/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.478337:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d5880 with x1876699777244800 ext(4194304->5242879) 00002000:00010000:0.0:1789760792.478344:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d5880 00000100:00100000:0.0:1789760792.478378:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468653694738 time 468653594738 state 0x1 ref 3 00000100:00100000:2.0:1789760792.478384:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777244928 00000100:00100000:2.0:1789760792.478389:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777244928 00000100:00100000:0.0:1789760792.478405:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468653694738 time 468662613516 state 0x0 ref 3 00002000:00100000:2.0:1789760792.478411:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x7:0x0] (6291456->7340031) req@ffff97e5449d4a80 x1876699777244928/t0(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789760792.478417:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+42:2403:x1876699777244800:12345-192.168.203.38@tcp:4:dd.0 00002000:00100000:2.0:1789760792.478419:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d4a80 with x1876699777244928 ext(6291456->7340031) 00002000:00010000:2.0:1789760792.478423:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d4a80 00000100:00100000:2.0:1789760792.478430:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468662713516 time 468662613516 state 0x1 ref 4 00000100:00100000:2.0:1789760792.478450:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 1 deadline 468662713516 time 468662660566 state 0x0 ref 4 00000100:00100000:2.0:1789760792.478459:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+42:2403:x1876699777244928:12345-192.168.203.38@tcp:4:dd.0 00000100:00100000:3.0:1789760792.490986:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+44:2404:x1876699777241088:12345-192.168.203.38@tcp:4:dd.500 Request processed in 31991us (377893us total) trans 4294967565 rc 0/0 00000100:00100000:3.0:1789760792.491003:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1789760792.491016:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468642979396 time 468643175741 state 0x2 ref 0 00002000:00100000:3.0:1789760792.491036:0:14781:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x6:0x0] (7340032->8388607) req@ffff97e546386d80 x1876699777241088/t4294967565(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760792.491047:0:14781:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e546386d80 with x1876699777241088 ext(7340032->8388607) 00002000:00010000:3.0:1789760792.491055:0:14781:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e546386d80 00000100:00100000:0.0:1789760792.498779:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777244544:12345-192.168.203.38@tcp:4:dd.0 Request processed in 37367us (37763us total) trans 4294967566 rc 0/0 00000100:00100000:0.0:1789760792.498876:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 27 00002000:00100000:0.0:1789760792.498892:0:13390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x7:0x0] (1048576->2097151) req@ffff97e44c680700 x1876699777244544/t4294967566(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760792.498902:0:13390:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e44c680700 with x1876699777244544 ext(1048576->2097151) 00002000:00010000:0.0:1789760792.498908:0:13390:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e44c680700 00000100:00100000:3.0:1789760792.510583:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2404:x1876699777244672:12345-192.168.203.38@tcp:4:dd.0 Request processed in 41169us (41752us total) trans 4294967567 rc 0/0 00000100:00100000:3.0:1789760792.510601:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 28 00002000:00100000:3.0:1789760792.510640:0:13393:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x7:0x0] (3145728->4194303) req@ffff97e57ff0d500 x1876699777244672/t4294967567(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.510652:0:13393:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e57ff0d500 with x1876699777244672 ext(3145728->4194303) 00002000:00010000:3.0:1789760792.510659:0:13393:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e57ff0d500 00000100:00100000:2.0:1789760792.512310:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777244800:12345-192.168.203.38@tcp:4:dd.0 Request processed in 33880us (38250us total) trans 4294967568 rc 0/0 00000100:00100000:2.0:1789760792.512323:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 29 00002000:00100000:2.0:1789760792.512337:0:8120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (4194304->5242879) req@ffff97e5449d5880 x1876699777244800/t4294967568(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760792.512348:0:8120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d5880 with x1876699777244800 ext(4194304->5242879) 00002000:00010000:2.0:1789760792.512354:0:8120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d5880 00000100:00100000:3.0:1789760792.521995:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+45:2403:x1876699777244928:12345-192.168.203.38@tcp:4:dd.0 Request processed in 43519us (47695us total) trans 4294967569 rc 0/0 00000100:00100000:3.0:1789760792.522019:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:3.0:1789760792.522033:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e55028fa00 key jobid={dd.0}&opcode={ost_write} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 1 deadline 468662713516 time 468662660566 state 0x2 ref 0 00002000:00100000:3.0:1789760792.522052:0:13392:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x7:0x0] (6291456->7340031) req@ffff97e5449d4a80 x1876699777244928/t4294967569(0) o4->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/448 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.522063:0:13392:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d4a80 with x1876699777244928 ext(6291456->7340031) 00002000:00010000:3.0:1789760792.522071:0:13392:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e5449d4a80 00000100:00100000:0.0:1789760792.538095:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.538767:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777245312 00000100:00100000:3.0:1789760792.538780:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777245312 00000100:00100000:3.0:1789760792.538920:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1789760792.538934:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+45:6390:x1876699777245312:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760792.538955:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 8 locks, starting at 0 00002000:00010000:3.0:1789760792.538984:0:6450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789760792.538987:0:6450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789760791 00002000:00010000:3.0:1789760792.538990:0:6450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1789760791 00010000:00010000:3.0:1789760792.539024:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a73985863c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c97 expref: 45 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760792.539491:0:6450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 1048576 -> 8388608 00002000:00010000:0.0:1789760792.539496:0:6450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 1789760791 -> 1789760792 00002000:00010000:0.0:1789760792.539499:0:6450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 1789760791 -> 1789760792 00010000:00010000:0.0:1789760792.539518:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6289818/0xc2b9a3a73985866d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cac expref: 44 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.539536:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f38f6d02/0xc2b9a3a739858697 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cd6 expref: 43 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.539551:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985867b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cba expref: 42 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.539602:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.539647:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777245440 00000100:00100000:3.0:1789760792.539667:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777245440 00010000:00010000:0.0:1789760792.539690:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858682 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc1 expref: 41 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.539703:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858689 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cc8 expref: 40 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.539716:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004aa23c20/0xc2b9a3a739858690 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ccf expref: 39 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.539737:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085af4ac7/0xc2b9a3a73985869e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cdd expref: 38 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.539757:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760792.539925:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+37:6390:x1876699777245312:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 994us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760792.539935:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1789760792.540380:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:2.0:1789760792.540392:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+39:10517:x1876699777245440:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760792.540407:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:2.0:1789760792.540436:0:6452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789760792.540439:0:6452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789760791 00002000:00010000:2.0:1789760792.540441:0:6452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1789760791 00010000:00010000:2.0:1789760792.540461:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985862e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c90 expref: 39 pid: 13387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760792.540491:0:6452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789760792.540494:0:6452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1789760791 00002000:00010000:2.0:1789760792.540496:0:6452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1789760791 00010000:00010000:2.0:1789760792.540504:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000730ecbe6/0xc2b9a3a739858674 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cb3 expref: 38 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.540519:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760792.540565:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+37:10517:x1876699777245440:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 175us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.540573:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:3.0:1789760792.625620:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.625731:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777245696 00000100:00100000:1.0:1789760792.625742:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777245696 00000100:00100000:1.0:1789760792.625931:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:1.0:1789760792.625943:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+23:13098:x1876699777245696:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760792.625968:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760792.625986:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f000/0xc2b9a3a7398586a5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ce4 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.626079:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a7398586ac lrc: 3/1,0 mode: --/PR res: [0x240000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.626093:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a7398586ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.626103:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a7398586ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760792.626113:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xc:0x0]: returning size 16777216 00010000:00010000:1.0:1789760792.626254:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f000/0xc2b9a3a7398586a5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ce4 expref: 26 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.626307:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a7398586ac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ce4 expref: 25 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.626315:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1d00) 00010000:00010000:1.0:1789760792.626318:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760792.626321:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54f600, rc 0) 00000100:00100000:1.0:1789760792.626380:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+25:13098:x1876699777245696:12345-192.168.203.38@tcp:101:dd.0 Request processed in 440us (768us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789760792.626386:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:3.0:1789760792.629865:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.630009:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777245952 00000100:00100000:0.0:1789760792.630018:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777245952 00000100:00100000:0.0:1789760792.630142:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:0.0:1789760792.630151:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+25:13099:x1876699777245952:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1789760792.630169:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760792.630196:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a7398586ba lrc: 2/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211ceb expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.630531:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398586c1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.630555:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398586c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.630566:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398586c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760792.630577:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xc:0x0]: returning size 16777216 00010000:00010000:0.0:1789760792.630702:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a7398586ba lrc: 0/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ceb expref: 28 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.630741:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398586c1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ceb expref: 27 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.630751:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1d00) 00010000:00010000:0.0:1789760792.630753:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760792.630757:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d31800, rc 0) 00000100:00100000:0.0:1789760792.630839:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+27:13099:x1876699777245952:12345-192.168.203.38@tcp:101:dd.0 Request processed in 689us (983us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789760792.630846:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:3.0:1789760792.631083:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.631118:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.631145:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777246336 00000100:00100000:1.0:1789760792.631152:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777246336 00000100:00100000:1.0:1789760792.631197:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:1.0:1789760792.631205:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+27:13097:x1876699777246336:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760792.631219:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760792.631230:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e800/0xc2b9a3a7398586cf lrc: 2/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cf2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.631242:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777246080 00000100:00100000:2.0:1789760792.631246:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777246080 00000100:00100000:2.0:1789760792.631288:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00010000:00010000:1.0:1789760792.631292:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fe00/0xc2b9a3a7398586d6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.631295:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2405:x1876699777246080:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760792.631302:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fe00/0xc2b9a3a7398586d6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.631304:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760792.631310:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fe00/0xc2b9a3a7398586d6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760792.631318:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xc:0x0]: returning size 16777216 00010000:00010000:2.0:1789760792.631319:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a7398586ac lrc: 0/0,0 mode: --/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ce4 expref: 29 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.631331:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1d00) 00010000:00010000:2.0:1789760792.631334:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760792.631355:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+28:2405:x1876699777246080:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.631367:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00010000:00010000:1.0:1789760792.631398:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e800/0xc2b9a3a7398586cf lrc: 0/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf2 expref: 29 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.631412:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fe00/0xc2b9a3a7398586d6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf2 expref: 28 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.631419:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1d00) 00010000:00010000:1.0:1789760792.631422:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760792.631425:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54fe00, rc 0) 00000100:00100000:1.0:1789760792.631640:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+28:13097:x1876699777246336:12345-192.168.203.38@tcp:101:dd.0 Request processed in 435us (556us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789760792.631647:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:3.0:1789760792.633715:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.633828:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777246464 00000100:00100000:2.0:1789760792.633838:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777246464 00000100:00100000:2.0:1789760792.633895:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:2.0:1789760792.633905:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+37:13098:x1876699777246464:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1789760792.633923:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760792.633941:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211cf9 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760792.633968:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6:0x0] initial LVB size: 8388608, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x1 00010000:00010000:2.0:1789760792.633989:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789760792.633993:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.634003:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 38 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.634019:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 38 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.634032:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d38200, rc 0) 00000100:00100000:2.0:1789760792.634085:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+38:13098:x1876699777246464:12345-192.168.203.38@tcp:101:dd.0 Request processed in 181us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.634092:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:2.0:1789760792.640750:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.640832:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.640857:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.640963:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777246976 00000100:00100000:1.0:1789760792.640971:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777246976 00000100:00100000:1.0:1789760792.641012:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:1.0:1789760792.641019:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+38:13101:x1876699777246976:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1789760792.641035:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760792.641050:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d00 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.641073:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760792.641077:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760792.641084:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 39 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.641097:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 39 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.641120:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54e200, rc 0) 00000100:00100000:1.0:1789760792.641163:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+39:13101:x1876699777246976:12345-192.168.203.38@tcp:101:dd.0 Request processed in 144us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.641169:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:0.0:1789760792.641247:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777246720 00000100:00100000:0.0:1789760792.641251:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777246720 00000100:00100000:0.0:1789760792.641284:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1789760792.641291:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+28:13099:x1876699777246720:12345-192.168.203.38@tcp:35:dd.0 00000100:00100000:0.0:1789760792.641559:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+29:13099:x1876699777246720:12345-192.168.203.38@tcp:35:dd.0 Request processed in 267us (816us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789760792.641566:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1789760792.641624:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777246848 00000100:00100000:3.0:1789760792.641629:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777246848 00000100:00100000:3.0:1789760792.641670:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:3.0:1789760792.641678:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548b18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+29:2403:x1876699777246848:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760792.641688:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760792.641706:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a7398586c1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211ceb expref: 29 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.641729:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1d00) 00010000:00010000:3.0:1789760792.641733:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760792.641750:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548b18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+28:2403:x1876699777246848:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 74us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760792.641756:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1789760792.647554:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.647751:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777247104 00000100:00100000:3.0:1789760792.647761:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777247104 00002000:00100000:3.0:1789760792.647838:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6:0x0] (0->1048575) req@ffff97e5449d5c00 x1876699777247104/t0(0) o3->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/0 e 0 to 0 dl 1789760803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.647850:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d5c00 with x1876699777247104 ext(0->1048575) 00002000:00010000:3.0:1789760792.647856:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d5c00 00000100:00100000:3.0:1789760792.647879:0:8119:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff97e54658cc00 key jobid={dd.0}&opcode={ost_read} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 468832084265 state 0x0 ref 1 00000100:00100000:3.0:1789760792.647890:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e54658cc00 key jobid={dd.0}&opcode={ost_read} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 3 deadline 468832184265 time 468832084265 state 0x1 ref 1 00000100:00100000:3.0:1789760792.647928:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e54658cc00 key jobid={dd.0}&opcode={ost_read} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468832184265 time 468832137042 state 0x0 ref 1 00000100:00100000:3.0:1789760792.647940:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2406:x1876699777247104:12345-192.168.203.38@tcp:3:dd.0 00000100:00100000:3.0:1789760792.655545:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.655955:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777247232 00000100:00100000:2.0:1789760792.655964:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777247232 00000100:00100000:2.0:1789760792.656024:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:2.0:1789760792.656034:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+28:2404:x1876699777247232:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760792.656050:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760792.656076:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fe00/0xc2b9a3a7398586d6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf2 expref: 28 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.656096:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1d00) 00010000:00010000:2.0:1789760792.656100:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760792.656212:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+27:2404:x1876699777247232:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 179us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.656220:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:2.0:1789760792.679886:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.679974:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777247488 00000100:00100000:0.0:1789760792.680010:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777247488 00000100:00100000:0.0:1789760792.680078:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:0.0:1789760792.680092:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+27:13097:x1876699777247488:12345-192.168.203.38@tcp:35:dd.0 00000100:00100000:0.0:1789760792.680327:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+28:13097:x1876699777247488:12345-192.168.203.38@tcp:35:dd.0 Request processed in 236us (450us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789760792.680335:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:3.0:1789760792.682647:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2406:x1876699777247104:12345-192.168.203.38@tcp:3:dd.0 Request processed in 34645us (35038us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760792.682660:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:3.0:1789760792.682671:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e54658cc00 key jobid={dd.0}&opcode={ost_read} rule@0xffff97e449966c00 gen 0 rate 10000 depth 3 token 2 deadline 468832184265 time 468832137042 state 0x2 ref 0 00002000:00100000:3.0:1789760792.682687:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6:0x0] (0->1048575) req@ffff97e5449d5c00 x1876699777247104/t0(0) o3->ac82f857-edfe-4201-bbe8-4599ba569acb@192.168.203.38@tcp:83/0 lens 488/440 e 0 to 0 dl 1789760803 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760792.682697:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e5449d5c00 with x1876699777247104 ext(0->1048575) 00002000:00010000:3.0:1789760792.682702:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97e5449d5c00 00000100:00100000:1.0:1789760792.751961:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.752339:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777247744 00000100:00100000:2.0:1789760792.752353:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777247744 00000100:00100000:2.0:1789760792.752549:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1789760792.752563:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+28:13111:x1876699777247744:12345-192.168.203.38@tcp:35:dd.0 00000100:00100000:2.0:1789760792.752947:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+29:13111:x1876699777247744:12345-192.168.203.38@tcp:35:dd.0 Request processed in 386us (1000us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789760792.752955:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1789760792.774556:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.774648:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777247872 00000100:00100000:1.0:1789760792.774662:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777247872 00000100:00100000:1.0:1789760792.774771:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:1.0:1789760792.774782:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+29:13113:x1876699777247872:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:1.0:1789760792.774842:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760792.774870:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a7398586f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d07 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.774957:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a7398586f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.774974:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a7398586f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.774987:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a7398586f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760792.775027:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00000004:00200000:1.0:1789760792.775031:0:12655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789760792.775067:0:12655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a7398586f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.775122:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a7398586f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d07 expref: 31 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.775150:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a7398586f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d07 expref: 30 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.775160:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:1.0:1789760792.775163:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789760792.775167:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54fc00, rc 0) 00000100:00100000:1.0:1789760792.775252:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+30:13113:x1876699777247872:12345-192.168.203.38@tcp:101:rm.0 Request processed in 472us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.775260:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:2.0:1789760792.776034:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760792.776070:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798248192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760792.776133:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760792.776399:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798248192 00000100:00100000:3.0:1789760792.776408:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798248192 00000100:00100000:3.0:1789760792.776456:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789760792.776466:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798248192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760792.776489:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 98631680 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760792.776539:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798248192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760792.776545:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789760792.776683:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798248192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760792.779384:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.779883:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e44c680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798248320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760792.779945:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760792.780009:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798248320 00000100:00100000:2.0:1789760792.780017:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798248320 00000100:00100000:2.0:1789760792.780084:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789760792.780093:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798248320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760792.780118:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 98631680 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760792.780161:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798248320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.780169:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789760792.780224:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e44c680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798248320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789760792.780771:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777248128 00000100:00100000:0.0:1789760792.780778:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777248128 00000100:00100000:0.0:1789760792.780859:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:0.0:1789760792.780867:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+30:13113:x1876699777248128:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1789760792.780882:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760792.780910:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d0e expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760792.781019:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00010000:00010000:0.0:1789760792.781176:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858700 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d0e expref: 32 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.781192:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5489b1100) 00010000:00010000:0.0:1789760792.781195:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760792.781209:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d0e expref: 32 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.781229:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d30800, rc 0) 00000100:00100000:0.0:1789760792.781280:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+31:13113:x1876699777248128:12345-192.168.203.38@tcp:101:rm.0 Request processed in 415us (1919us total) trans 4294967381 rc 301/301 00000100:00100000:0.0:1789760792.781288:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:3.0:1789760792.784835:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.785196:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777248256 00000100:00100000:0.0:1789760792.785466:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777248256 00000100:00100000:0.0:1789760792.785550:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:0.0:1789760792.785563:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+31:13113:x1876699777248256:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:3.0:1789760792.790747:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+31:13113:x1876699777248256:12345-192.168.203.38@tcp:37:rm.0 Request processed in 5172us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760792.790784:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:0.0:1789760792.795437:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.795531:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777248512 00000100:00100000:3.0:1789760792.795543:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777248512 00000100:00100000:3.0:1789760792.795631:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1789760792.795643:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+31:13113:x1876699777248512:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:3.0:1789760792.796206:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+32:13113:x1876699777248512:12345-192.168.203.38@tcp:35:rm.0 Request processed in 557us (826us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1789760792.796216:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:0.0:1789760792.803432:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760792.803581:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777248768 00000100:00100000:2.0:1789760792.803594:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777248768 00000100:00100000:2.0:1789760792.803671:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:2.0:1789760792.803683:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+32:13113:x1876699777248768:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1789760792.803725:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760792.803755:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a73985870e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d15 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.803914:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739858715 lrc: 3/1,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.803933:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739858715 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.803947:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739858715 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760792.803979:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00010000:00010000:2.0:1789760792.804132:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd01200/0xc2b9a3a73985870e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d15 expref: 35 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.804157:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739858715 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d15 expref: 34 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.804168:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:2.0:1789760792.804171:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789760792.804175:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd00800, rc 0) 00000100:00100000:2.0:1789760792.804320:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+34:13113:x1876699777248768:12345-192.168.203.38@tcp:101:rm.0 Request processed in 638us (905us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1789760792.804328:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:1.0:1789760792.810231:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.810363:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777248896 00000100:00100000:3.0:1789760792.810388:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777248896 00000100:00100000:3.0:1789760792.810459:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:3.0:1789760792.810469:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13113:x1876699777248896:12345-192.168.203.38@tcp:41:rm.0 00000004:00000024:3.0:1789760792.810545:0:6466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7678722048 00000100:00100000:3.0:1789760792.810637:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13113:x1876699777248896:12345-192.168.203.38@tcp:41:rm.0 Request processed in 168us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760792.810645:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:3.0:1789760792.813562:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.813683:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777249152 00000100:00100000:0.0:1789760792.813697:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777249152 00000100:00100000:0.0:1789760792.813783:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:0.0:1789760792.813838:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+34:13113:x1876699777249152:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1789760792.813921:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789760792.813958:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30600/0xc2b9a3a739858619 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c89 expref: 34 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.813985:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1d00) 00010000:00010000:0.0:1789760792.814004:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a7398586f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d07 expref: 33 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814014:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:0.0:1789760792.814018:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760792.814045:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 3/0,1 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814075:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814087:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814124:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 3/0,1 mode: --/PW res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814133:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814140:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814276:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814285:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.814293:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789760792.815385:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8576 00000004:00080000:0.0:1789760792.815400:0:6467:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 468999611349ns, next at 469999608024ns, rc = 0 00000040:00080000:0.0:1789760792.815557:0:6467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00000004:00080000:0.0:1789760792.815565:0:6467:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 468999777038ns, next at 469999775572ns, rc = 0 00010000:00010000:0.0:1789760792.815656:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815672:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815684:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815707:0:6467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815714:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815732:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815765:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760792.815830:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815836:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815843:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815849:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760792.815854:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815862:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815876:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1100) 00010000:00010000:0.0:1789760792.815879:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760792.815883:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815899:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31800/0xc2b9a3a739858731 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815918:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815924:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815929:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815933:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760792.815935:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815940:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815949:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:0.0:1789760792.815951:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760792.815954:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 2/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815959:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d30800/0xc2b9a3a739858723 lrc: 0/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760792.815969:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5970fb0 reply state 0000000079e424c3 transno 4294967384 ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815982:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.815994:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x2ab29dc6 (ffff97e543c0a400) 00010000:00010000:0.0:1789760792.815996:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789760792.816000:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760792.816105:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+34:13113:x1876699777249152:12345-192.168.203.38@tcp:36:rm.0 Request processed in 2264us (2553us total) trans 4294967384 rc 0/0 00000100:00100000:0.0:1789760792.816114:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 191 00010000:00010000:3.0:1789760792.816986:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760792.816999:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.817011:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760792.817015:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.817024:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.817075:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xc:0x0].0x0 (ffff97e5489b1100) 00010000:00010000:3.0:1789760792.817078:0:6454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789760792.817082:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 1/0,0 mode: --/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.817089:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31200/0xc2b9a3a739858738 lrc: 0/0,0 mode: --/PW res: [0x240000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.817112:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760792.817114:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760792.817117:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760792.824654:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.824763:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777249408 00000100:00100000:1.0:1789760792.824777:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777249408 00000100:00100000:1.0:1789760792.824884:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:1.0:1789760792.824897:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+34:13113:x1876699777249408:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1789760792.824979:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760792.825016:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542400/0xc2b9a3a739858658 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c9e expref: 34 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825043:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff97e544c16100) 00010000:00010000:1.0:1789760792.825069:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760792.825099:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 3/0,1 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825116:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825149:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825163:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825171:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825178:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825314:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825323:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.825331:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789760792.826276:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00000040:00080000:1.0:1789760792.826301:0:9081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8640 00010000:00010000:1.0:1789760792.826375:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826388:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826398:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826416:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826422:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826429:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826452:0:9081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789760792.826478:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826484:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826490:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826497:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54ec00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760792.826502:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826510:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826523:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff97e5461f2600) 00010000:00010000:1.0:1789760792.826526:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789760792.826530:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 2/0,0 mode: --/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826545:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ec00/0xc2b9a3a73985874d lrc: 0/0,0 mode: --/EX res: [0x240000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826570:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826576:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826581:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826587:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826592:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54f200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760792.826595:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826600:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 5/0,0 mode: CW/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826606:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:1.0:1789760792.826608:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760792.826611:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 3/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826616:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f200/0xc2b9a3a73985873f lrc: 0/0,0 mode: --/CW res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760792.826627:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025d34d71 reply state 000000004799db7b transno 4294967385 ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826644:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.826652:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x151ecd9f (ffff97e544c16600) 00010000:00010000:1.0:1789760792.826654:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760792.826657:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760792.826773:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+35:13113:x1876699777249408:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1874us (2130us total) trans 4294967385 rc 0/0 00000100:00100000:1.0:1789760792.826782:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00010000:00010000:3.0:1789760792.827259:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760792.827269:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.827277:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54e000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760792.827280:0:6453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.827287:0:6453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.827300:0:6453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff97e5461f2600) 00010000:00010000:3.0:1789760792.827303:0:6453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789760792.827306:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 1/0,0 mode: --/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.827313:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54e000/0xc2b9a3a739858754 lrc: 0/0,0 mode: --/PW res: [0x240000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.827332:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760792.827342:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760792.827344:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760792.832266:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.832326:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760792.832411:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777249792 00000100:00100000:0.0:1789760792.832424:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777249792 00000100:00100000:0.0:1789760792.832499:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:0.0:1789760792.832512:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e565ddb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+35:13113:x1876699777249792:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:0.0:1789760792.832859:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e565ddb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+36:13113:x1876699777249792:12345-192.168.203.38@tcp:35:rm.0 Request processed in 348us (531us total) trans 4294967386 rc 0/0 00000100:00100000:0.0:1789760792.832866:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1789760792.833089:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777249536 00000100:00100000:3.0:1789760792.833095:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777249536 00000100:00100000:3.0:1789760792.833141:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:3.0:1789760792.833149:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777249536:12345-192.168.203.38@tcp:103:rm.0 00010000:00010000:3.0:1789760792.833160:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760792.833195:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858578 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c51 expref: 7 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.833217:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16000) 00010000:00010000:3.0:1789760792.833229:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760792.833249:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2404:x1876699777249536:12345-192.168.203.38@tcp:103:rm.0 Request processed in 102us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760792.833256:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:3.0:1789760792.836257:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760792.836490:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777250048 00000100:00100000:1.0:1789760792.836502:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777250048 00000100:00100000:1.0:1789760792.836566:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:1.0:1789760792.836577:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+36:13113:x1876699777250048:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1789760792.836653:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789760792.836690:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57fd00800/0xc2b9a3a739858715 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d15 expref: 36 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.836726:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398585fd lrc: 0/0,0 mode: --/PR res: [0x240000402:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c82 expref: 35 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.836740:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:1.0:1789760792.836745:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760792.836836:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.836868:0:12655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.836882:0:12655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760792.836911:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f758000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798248448:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1789760792.836982:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.837045:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41540 going to sleep for 11 seconds 00000100:00100000:3.0:1789760792.837246:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798248448 00000100:00100000:3.0:1789760792.837252:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798248448 00000100:00100000:3.0:1789760792.837295:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789760792.837304:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:12655:x1876699798248448:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1789760792.837317:0:7305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760792.837332:0:7305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a73985875b expref: -99 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837359:0:7305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 5 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837380:0:7305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a73985875b expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837415:0:7305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 5 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.837429:0:7305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 5 pid: 6467 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.837442:0:7305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798248576:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760792.837511:0:7305:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449101840 going to sleep for 11 seconds 00000100:00100000:1.0:1789760792.840701:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760792.840891:0:7305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7305:1876699798248576:192.168.203.38@tcp:104: 00010000:00010000:3.0:1789760792.840937:0:7305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985875b expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.840952:0:7305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760792.840955:0:7305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760792.840959:0:7305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985875b expref: 7 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.840971:0:7305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f543200, rc 0) 00000100:00100000:3.0:1789760792.841039:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:12655:x1876699798248448:12345-0@lo:101:mdt00_004.0 Request processed in 3736us (4056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760792.841048:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789760792.841282:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f758000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798248448:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1789760792.841305:0:12655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760792.841316:0:12655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.842636:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777250176 00000100:00100000:2.0:1789760792.842652:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777250176 00010000:00010000:2.0:1789760792.842727:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 6 pid: 6467 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.842853:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:2.0:1789760792.842864:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+6:2403:x1876699777250176:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760792.842883:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760792.842893:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 6 pid: 6467 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.842909:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 6 pid: 6467 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.842971:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d38000/0xc2b9a3a73985858d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211c5f expref: 6 pid: 6467 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.842992:0:9898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760792.843002:0:9898:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985875b expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.843015:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc2b9a3a73985875b expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.843025:0:9898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xc2b9a3a73985875b expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.843084:0:9898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a73985875b expref: 6 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.843102:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e546384a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9898:1876699798248704:0@lo:105: 00000100:00100000:2.0:1789760792.843183:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760792.843234:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760792.843369:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798248704 00000100:00100000:1.0:1789760792.843376:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798248704 00000100:00100000:1.0:1789760792.843420:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789760792.843428:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9898:x1876699798248704:12345-0@lo:105: 00010000:00010000:1.0:1789760792.843441:0:6448:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.843452:0:6448:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.843475:0:6448:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.843485:0:6448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.843494:0:6448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.843517:0:6448:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.843544:0:6448:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97e57f54e800) 00000100:00100000:1.0:1789760792.843587:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9898:x1876699798248704:12345-0@lo:105: Request processed in 160us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.843594:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1789760792.843812:0:12655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.843824:0:12655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760792.843864:0:12655:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1789760792.843911:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.843918:0:12655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.843930:0:12655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760792.843947:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798248832:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1789760792.843983:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760792.844010:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e449101840 going to sleep for 11 seconds 00000100:00100000:2.0:1789760792.844101:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e546384a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9898:1876699798248704:0@lo:105: 00010000:00010000:2.0:1789760792.844116:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760792.844209:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777250176:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1345us (3522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.844218:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:1.0:1789760792.844286:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798248832 00000100:00100000:1.0:1789760792.844291:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798248832 00000100:00100000:1.0:1789760792.844321:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789760792.844328:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:12655:x1876699798248832:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1789760792.844345:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760792.844363:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858770 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739858769 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.844388:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858770 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739858769 expref: 8 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.844401:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858770 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739858769 expref: 8 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.844410:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5461f2800) 00010000:00010000:1.0:1789760792.844413:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760792.844416:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54ec00, rc 0) 00000100:00100000:1.0:1789760792.844450:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798248832:12345-0@lo:101:mdt00_004.0 Request processed in 123us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.844478:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789760792.844515:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798248832:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1789760792.844528:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.844538:0:12655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760792.844555:0:12655:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1789760792.844596:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798248960:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760792.844625:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.844641:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41000 going to sleep for 11 seconds 00000100:00100000:1.0:1789760792.844655:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798248960 00000100:00100000:1.0:1789760792.844658:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798248960 00000100:00100000:1.0:1789760792.844678:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789760792.844683:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798248960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760792.844756:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798248960:12345-0@lo:1000:mdt00_004.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.844763:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789760792.844785:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798248960:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760792.844839:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798249088:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760792.844860:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.844871:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41000 going to sleep for 11 seconds 00000100:00100000:1.0:1789760792.844881:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798249088 00000100:00100000:1.0:1789760792.844884:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798249088 00000100:00100000:1.0:1789760792.844901:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789760792.844914:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798249088:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789760792.845185:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798249088:12345-0@lo:1000:mdt00_004.0 Request processed in 271us (324us total) trans 0 rc 1/1 00000100:00100000:1.0:1789760792.845192:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789760792.845219:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798249088:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789760792.845269:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845277:0:12655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845287:0:12655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760792.845299:0:12655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798249216:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1789760792.845322:0:12655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.845336:0:12655:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760792.845347:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798249216 00000100:00100000:1.0:1789760792.845350:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798249216 00000100:00100000:1.0:1789760792.845367:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789760792.845373:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12655:x1876699798249216:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1789760792.845381:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760792.845396:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a73985877e lrc: 2/0,0 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2b9a3a739858777 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845414:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a73985877e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xc2b9a3a739858777 expref: 9 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845426:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a73985877e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739858777 expref: 9 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845441:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e5461f2500) 00010000:00010000:1.0:1789760792.845444:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760792.845447:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54f000, rc 0) 00000100:00100000:1.0:1789760792.845475:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:12655:x1876699798249216:12345-0@lo:101:mdt00_004.0 Request processed in 103us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.845482:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789760792.845507:0:12655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12655:1876699798249216:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1789760792.845518:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845528:0:12655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845549:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845559:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.845567:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789760792.846965:0:12655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].6, 424 off36992 00000040:00080000:1.0:1789760792.847049:0:12655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].6, 504 off37688 00000004:00080000:1.0:1789760792.847775:0:12655:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97e579e41000 with version 13 00000004:00080000:1.0:1789760792.847821:0:7275:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97e543e40f00 version 13 rpc_version 13 00000020:00100000:1.0:1789760792.847865:0:7275:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789760792.847879:0:7275:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97e57f75b480 x1876699798249472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789760792.847924:0:7275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798249472:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789760792.848000:0:7275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.848033:0:7275:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e579e41240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760792.848192:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798249472 00000100:00100000:1.0:1789760792.848200:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798249472 00000100:00100000:1.0:1789760792.850680:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789760792.850705:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7275:x1876699798249472:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789760792.851921:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7275:x1876699798249472:12345-0@lo:1000:osp_up0-1.0 Request processed in 1221us (3914us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789760792.851935:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789760792.852260:0:7275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7275:1876699798249472:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1789760792.852379:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xb:0x0]: returning size 16384 00010000:00010000:1.0:1789760792.852407:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852418:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852427:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852434:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54f600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760792.852440:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852447:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852568:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:1.0:1789760792.852572:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760792.852589:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852596:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54f600/0xc2b9a3a739858785 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852615:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852624:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852631:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852654:0:12655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789760792.852669:0:12655:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760792.852675:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852682:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852688:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852704:0:12655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1789760792.852708:0:12655:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789760792.852713:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760792.852739:0:12655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852747:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760792.852755:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852762:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54fe00 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:3.0:1789760792.852766:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760792.852774:0:6454:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852836:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852843:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789760792.852858:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+35:13113:x1876699777250048:12345-192.168.203.38@tcp:36:rm.0 Request processed in 16281us (16614us total) trans 4294967387 rc 0/0 00000100:00100000:1.0:1789760792.852866:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 193 00010000:00010000:3.0:1789760792.852869:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 1/0,0 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852875:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54fe00/0xc2b9a3a739858777 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a73985877e expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852894:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760792.852897:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852902:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54e800 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:3.0:1789760792.852905:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760792.852911:0:6454:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852927:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852933:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760792.852948:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852955:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f54e800/0xc2b9a3a73985875b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xc2b9a3a739858762 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760792.852964:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760792.852966:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760792.852967:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760792.852981:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760792.852998:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798249728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789760792.853162:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57fff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798249600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760792.853258:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760792.853352:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798249728 00000100:00100000:2.0:1789760792.853360:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798249728 00000100:00100000:2.0:1789760792.853417:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789760792.853427:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3462:x1876699798249728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760792.853441:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760792.853464:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543200/0xc2b9a3a739858762 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a73985875b expref: 10 pid: 7305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.853478:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760792.853482:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760792.853513:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3462:x1876699798249728:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.853519:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760792.853573:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760792.853636:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798249600 00000100:00100000:2.0:1789760792.853641:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798249600 00000100:00100000:2.0:1789760792.853675:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789760792.853683:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3464:x1876699798249600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760792.853691:0:6450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760792.853703:0:6450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a73985877e lrc: 0/0,0 mode: --/EX res: [0x240000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xc2b9a3a739858777 expref: 9 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.853724:0:6450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e5461f2500) 00010000:00010000:2.0:1789760792.853732:0:6450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760792.853761:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3464:x1876699798249600:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.853767:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789760792.853827:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798249600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760792.853974:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57fff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798249728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760792.854232:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760793.095073:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760793.643312:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760793.644705:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777250304 00000100:00100000:3.0:1789760793.644731:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777250304 00000100:00100000:3.0:1789760793.644847:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:3.0:1789760793.644862:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:13124:x1876699777250304:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:3.0:1789760793.644888:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760793.644914:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a73985878c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d1c expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.644996:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858793 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.645316:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.645333:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760793.645389:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789760793.645394:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789760793.645419:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.645447:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a73985878c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d1c expref: 7 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.645492:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858793 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d1c expref: 6 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.645503:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760793.645506:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760793.645510:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f542000, rc 0) 00000100:00080000:2.0:1789760793.645686:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760793.646117:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+6:13124:x1876699777250304:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 1257us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760793.646127:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:1.0:1789760793.656304:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760793.656355:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760793.656404:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777250432 00000100:00100000:1.0:1789760793.656415:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777250432 00000100:00100000:1.0:1789760793.656471:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777250688 00000100:00100000:1.0:1789760793.656474:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777250688 00000100:00100000:1.0:1789760793.656497:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:1.0:1789760793.656507:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777250432:12345-192.168.203.38@tcp:41:mkdir.0 00000004:00000024:1.0:1789760793.656562:0:6467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760793.656648:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777250432:12345-192.168.203.38@tcp:41:mkdir.0 Request processed in 142us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760793.656656:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:1.0:1789760793.656674:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1789760793.656681:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+6:13124:x1876699777250688:12345-192.168.203.38@tcp:36:mkdir.0 00010000:00010000:1.0:1789760793.656744:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760793.656780:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f542000/0xc2b9a3a739858793 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d1c expref: 6 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656847:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760793.656853:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760793.656951:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656968:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656980:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.656992:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657003:0:6467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858770 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xc2b9a3a739858769 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657021:0:6467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657063:0:6467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858770 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xc2b9a3a739858769 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.657082:0:6467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f758a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6467:1876699798249856:0@lo:104: 00000100:00100000:1.0:1789760793.657131:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760793.657185:0:6467:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e542e21f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760793.657216:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798249856 00000100:00100000:1.0:1789760793.657221:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798249856 00000100:00100000:1.0:1789760793.657256:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789760793.657271:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6467:x1876699798249856:12345-0@lo:104: 00010000:00010000:1.0:1789760793.657286:0:6448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657335:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760793.657341:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6467:x1876699798249856:12345-0@lo:104: Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760793.657348:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:1.0:1789760793.657369:0:6454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760793.657377:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657387:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542c00 already unused, calling callback (ffffffffc1efbee0) 00010000:00010000:1.0:1789760793.657393:0:6454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760793.657404:0:6454:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657431:0:6454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657439:0:6454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760793.657463:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657472:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97e57f542c00/0xc2b9a3a739858769 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xc2b9a3a739858770 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.657506:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760793.657509:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760793.657511:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760793.657524:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798249984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760793.657557:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760793.657595:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798249984 00000100:00100000:1.0:1789760793.657600:0:6452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798249984 00010000:00010000:1.0:1789760793.657619:0:6452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858770 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xc2b9a3a739858769 expref: 8 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.657643:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789760793.657650:0:6452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3462:x1876699798249984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760793.657659:0:6452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789760793.657972:0:6467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f758a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6467:1876699798249856:0@lo:104: 00010000:00010000:1.0:1789760793.657994:0:6467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760793.711062:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967366 is committed 00010000:00010000:0.0:1789760793.723994:0:6452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858770 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xc2b9a3a739858769 expref: 7 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.724354:0:6452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5461f2800) 00010000:00010000:0.0:1789760793.724362:0:6452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.724373:0:6452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.724382:0:6452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.724421:0:6452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760793.724520:0:6452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798249984:12345-0@lo:103:ldlm_bl.0 Request processed in 66869us (66960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760793.724531:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:1.0:1789760793.724605:0:6467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.724615:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.724948:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798249984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760793.726488:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a7398587a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726513:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a7398587a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726539:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a7398587a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760793.726566:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081a325fc reply state 000000009cb2f5ed transno 4294967367 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a7398587a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726578:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01c00/0xc2b9a3a7398587a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726587:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff97e543c0a800) 00010000:00010000:2.0:1789760793.726591:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760793.726595:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760793.726601:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 16384 00010000:00010000:2.0:1789760793.726611:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726618:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726625:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726632:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54ee00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.726638:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726662:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726848:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760793.726853:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.726858:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726864:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a73985879a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760793.726884:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081a325fc reply state 000000009cb2f5ed transno 4294967367 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726893:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54fa00/0xc2b9a3a7398587a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.726900:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5461f2800) 00010000:00010000:2.0:1789760793.726903:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789760793.726906:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789760793.727081:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13124:x1876699777250688:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 70395us (70720us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789760793.727092:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:3.0:1789760793.757089:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760793.757139:0:6465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777250816 00000100:00100000:3.0:1789760793.757152:0:6465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777250816 00000100:00100000:3.0:1789760793.757219:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:3.0:1789760793.757230:0:6465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13125:x1876699777250816:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1789760793.757262:0:6465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760793.757290:0:6465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a7398587af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d23 expref: -99 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.757373:0:6465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543400/0xc2b9a3a7398587b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.757390:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543400/0xc2b9a3a7398587b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.757405:0:6465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543400/0xc2b9a3a7398587b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760793.757467:0:6465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789760793.757472:0:6465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789760793.757503:0:6465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543400/0xc2b9a3a7398587b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.757530:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a7398587af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d23 expref: 9 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.757550:0:6465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543400/0xc2b9a3a7398587b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d23 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.757559:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:3.0:1789760793.757562:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760793.757566:0:6465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f543400, rc 0) 00000100:00100000:3.0:1789760793.757637:0:6465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+8:13125:x1876699777250816:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 409us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760793.757644:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:3.0:1789760793.761056:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760793.761157:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777251072 00000100:00100000:2.0:1789760793.761169:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777251072 00000100:00100000:2.0:1789760793.761234:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:2.0:1789760793.761245:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+8:13125:x1876699777251072:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760793.761268:0:6466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760793.761272:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789760793.761315:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543400/0xc2b9a3a7398587b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d23 expref: 8 pid: 6465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761337:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760793.761341:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760793.761357:0:6466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a7398587bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d2a expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761528:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761545:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761557:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761570:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761578:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761585:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761655:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761662:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761670:0:6466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760793.761685:0:6466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 16384 00010000:00010000:2.0:1789760793.761699:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761706:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761724:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761731:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.761736:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761744:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761754:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff97e543c0a800) 00010000:00010000:2.0:1789760793.761757:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.761761:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761769:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00200/0xc2b9a3a7398587d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761815:0:6466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761822:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761828:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761841:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761848:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.761851:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761859:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761867:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760793.761869:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.761872:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761879:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a7398587c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761888:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761894:0:6466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761899:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761905:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.761907:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761921:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761929:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5461f2800) 00010000:00010000:2.0:1789760793.761931:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.761933:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761939:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a7398587cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761965:0:6466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a7398587bd lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d2a expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761978:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760793.761981:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.761985:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a7398587bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d2a expref: 8 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.761994:0:6466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01600, rc 0) 00000100:00100000:2.0:1789760793.762071:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13125:x1876699777251072:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 827us (1027us total) trans 0 rc 301/301 00000100:00100000:2.0:1789760793.762081:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:3.0:1789760793.765429:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760793.765758:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777251200 00000100:00100000:2.0:1789760793.765771:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777251200 00000100:00100000:2.0:1789760793.765868:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:2.0:1789760793.765885:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+7:13125:x1876699777251200:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1789760793.765926:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760793.765953:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a7398587d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d31 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.766034:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a7398587e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.766050:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a7398587e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.766064:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a7398587e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760793.766108:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760793.766113:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760793.766135:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a7398587e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.766163:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a7398587d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d31 expref: 9 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.766182:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01a00/0xc2b9a3a7398587e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d31 expref: 8 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.766192:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760793.766195:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760793.766199:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01a00, rc 0) 00000100:00100000:2.0:1789760793.766319:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+8:13125:x1876699777251200:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 440us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760793.766326:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:3.0:1789760793.772772:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760793.772884:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777251456 00000100:00100000:1.0:1789760793.772898:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777251456 00000100:00100000:1.0:1789760793.772961:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:1.0:1789760793.772971:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+8:13125:x1876699777251456:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1789760793.772997:0:12655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760793.773015:0:12655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a7398587e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d38 expref: -99 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773081:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773095:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773106:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773116:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773123:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773130:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760793.773239:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 16384 00010000:00010000:1.0:1789760793.773333:0:12655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773340:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773345:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773361:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773367:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54f400 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760793.773371:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773378:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773402:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760793.773406:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760793.773410:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773416:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f400/0xc2b9a3a7398587ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773427:0:12655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773433:0:12655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773439:0:12655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773444:0:12655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54ee00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760793.773446:0:12655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773461:0:12655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773471:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5461f2800) 00010000:00010000:1.0:1789760793.773473:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760793.773477:0:12655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773483:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ee00/0xc2b9a3a7398587f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773517:0:12655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a7398587e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d38 expref: 10 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773528:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:1.0:1789760793.773531:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760793.773534:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ea00/0xc2b9a3a7398587e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d38 expref: 10 pid: 12655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.773543:0:12655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54ea00, rc 0) 00000100:00100000:1.0:1789760793.773611:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+9:13125:x1876699777251456:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 642us (854us total) trans 4294967368 rc 301/301 00000100:00100000:1.0:1789760793.773619:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:3.0:1789760793.777033:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760793.777309:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777251712 00000100:00100000:1.0:1789760793.777320:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777251712 00000100:00100000:1.0:1789760793.777373:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:1.0:1789760793.777382:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+9:13125:x1876699777251712:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1789760793.777533:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858803 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.777549:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.777560:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760793.778373:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034543e54 reply state 0000000071a83b4d transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.778518:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54ec00/0xc2b9a3a739858803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.778529:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff97e543c0a800) 00010000:00010000:1.0:1789760793.778531:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1789760793.778536:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789760793.778546:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 16384 00000100:00100000:1.0:1789760793.778635:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+11:13125:x1876699777251712:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 1250us (2272us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789760793.778642:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:3.0:1789760793.781687:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760793.781762:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777251968 00000100:00100000:3.0:1789760793.781776:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777251968 00000100:00100000:3.0:1789760793.781874:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:3.0:1789760793.781888:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+11:13125:x1876699777251968:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1789760793.782210:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+12:13125:x1876699777251968:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 325us (537us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789760793.782235:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:3.0:1789760793.797766:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760793.798047:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777252096 00000100:00100000:2.0:1789760793.798061:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777252096 00000100:00100000:2.0:1789760793.798163:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:2.0:1789760793.798176:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+12:13126:x1876699777252096:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:2.0:1789760793.798217:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760793.798243:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a73985880a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d3f expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798334:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798352:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798377:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798390:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798398:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798406:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798522:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a73985881f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798531:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a73985881f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798558:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a73985881f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760793.798596:0:6467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 16384 00000004:00200000:2.0:1789760793.798601:0:6467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760793.798623:0:6467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a73985881f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798646:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798654:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798661:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798668:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.798672:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798681:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798695:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:2.0:1789760793.798698:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.798704:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798721:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01600/0xc2b9a3a739858811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798747:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798754:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798761:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798766:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.798769:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798775:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798822:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5461f2800) 00010000:00010000:2.0:1789760793.798826:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.798830:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798835:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd00800/0xc2b9a3a739858818 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798868:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01e00/0xc2b9a3a73985880a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d3f expref: 14 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798883:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a73985881f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d3f expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.798904:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff97e543c0a800) 00010000:00010000:2.0:1789760793.798906:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760793.798908:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57fd01200, rc 0) 00000100:00100000:2.0:1789760793.798982:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44a185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+13:13126:x1876699777252096:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 809us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760793.798990:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:3.0:1789760793.801889:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760793.802526:0:12655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777252352 00000100:00100000:3.0:1789760793.802539:0:12655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777252352 00000100:00100000:3.0:1789760793.802609:0:12655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:3.0:1789760793.802621:0:12655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+13:13126:x1876699777252352:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:3.0:1789760793.802689:0:12655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760793.802735:0:12655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e57fd01200/0xc2b9a3a73985881f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d3f expref: 13 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.802756:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff97e543c0a800) 00010000:00010000:3.0:1789760793.802762:0:12655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760793.802815:0:12655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a739858826 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.802831:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a739858826 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.802842:0:12655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a739858826 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760793.803105:0:12655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012788bc6 reply state 0000000077864b0e transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a739858826 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.803121:0:12655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f543000/0xc2b9a3a739858826 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.803127:0:12655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff97e543c0a800) 00010000:00010000:3.0:1789760793.803140:0:12655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789760793.803143:0:12655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760793.803152:0:12655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 16384 00000100:00100000:3.0:1789760793.803250:0:12655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+14:13126:x1876699777252352:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 630us (1371us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789760793.803258:0:12655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 203 00000001:00080000:3.0:1789760793.862609:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967386 is committed 00000004:00080000:3.0:1789760793.862634:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 8 committed 00000004:00080000:3.0:1789760793.862646:0:7272:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 8 committed 00000001:00080000:3.0:1789760793.862678:0:7272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967387 is committed 00000020:00080000:3.0:1789760793.862733:0:7272:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97e57a6333c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789760793.862740:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e57d520600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97e57a633840 00000020:00080000:3.0:1789760793.862744:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].5 00010000:00010000:2.0:1789760793.863159:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863173:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863182:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863189:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.863195:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863203:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863228:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:2.0:1789760793.863232:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.863237:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863244:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f542200/0xc2b9a3a73985854e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863288:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863292:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863296:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863299:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d39a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.863300:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863304:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863309:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:2.0:1789760793.863311:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789760793.863312:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863316:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39a00/0xc2b9a3a7398585be lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863322:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863326:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863329:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863336:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d39200 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.863338:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863342:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863346:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x0 (ffff97e544c16200) 00010000:00010000:2.0:1789760793.863347:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760793.863349:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863352:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39200/0xc2b9a3a7398585d3 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863366:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863370:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863373:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863375:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d39600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.863377:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863381:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863392:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x2ab29dc6 (ffff97e543c0a400) 00010000:00010000:2.0:1789760793.863394:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.863396:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863400:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d39600/0xc2b9a3a739858612 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6465 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863407:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863410:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863414:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863417:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543c00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.863418:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863421:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863425:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x151ecd9f (ffff97e544c16600) 00010000:00010000:2.0:1789760793.863427:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.863428:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863431:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f543c00/0xc2b9a3a739858651 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6466 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863441:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863445:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863449:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863451:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31a00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.863453:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863456:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863470:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x2ab29dc6 (ffff97e543c0a400) 00010000:00010000:2.0:1789760793.863475:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.863478:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863483:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e542d31a00/0xc2b9a3a73985872a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x2ab29dc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863496:0:3448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.863503:0:3448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789760793.863598:0:7272:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e579870e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e57ff3b800 00000020:00080000:3.0:1789760793.863603:0:7272:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].5 00000100:00100000:0.0:1789760793.864099:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798250112:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1789760793.864182:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ac17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798250240:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1789760793.864193:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789760793.864254:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 5 committed batchid 4 00000100:00100000:3.0:1789760793.864255:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760793.864319:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798250240 00000100:00100000:3.0:1789760793.864319:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798250112 00000100:00100000:0.0:1789760793.864328:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798250240 00000100:00100000:3.0:1789760793.864328:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798250112 00010000:00010000:2.0:1789760793.864426:0:3448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.864441:0:3448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54fc00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:2.0:1789760793.864446:0:3448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.864453:0:3448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.864469:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00010000:00010000:2.0:1789760793.864469:0:3448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb:0x0].0x151ecd9f (ffff97e544c16600) 00010000:00010000:2.0:1789760793.864476:0:3448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760793.864480:0:3448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.864488:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3464:x1876699798250240:12345-0@lo:6:osp-syn-1-1.0 00000020:00080000:1.0:1789760793.864488:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4 00010000:00010000:2.0:1789760793.864489:0:3448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97e57f54fc00/0xc2b9a3a739858746 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xb:0x0].0x151ecd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789760793.864522:0:8110:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:6 count 1 00010000:00010000:0.0:1789760793.864545:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.864565:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 38 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.864581:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 38 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.864587:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789760793.864591:0:8110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760793.864595:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 5/0,1 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.864616:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00010000:00010000:0.0:1789760793.864624:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 38 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.864632:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3463:x1876699798250112:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1789760793.864640:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 38 pid: 8112 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.864651:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8110:1876699798250368:192.168.203.38@tcp:104: 00002000:00080000:3.0:1789760793.864652:0:8114:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:6 count 1 00002000:00010000:3.0:1789760793.864687:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8388608, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0x1 00010000:00010000:3.0:1789760793.864695:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.864733:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 38 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.864743:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 38 pid: 8114 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.864753:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f71b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8110:1876699798250496:192.168.203.38@tcp:104: 00000100:00100000:0.0:1789760793.864779:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff97e57a633600 going to sleep for 11 seconds 00000100:00080000:0.0:1789760793.864816:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760793.864827:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789760793.865172:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1789760793.865185:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.865192:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.865211:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.865223:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.865231:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.865324:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760793.865433:0:7281:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760793.865441:0:7281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.865450:0:7281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760793.865454:0:7281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.865463:0:7281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.865481:0:7281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.865490:0:7281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001753abf6/0xc2b9a3a739858834 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.865516:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760793.865518:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760793.865521:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760793.872034:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760793.872081:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760793.872100:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8110:1876699798250368:192.168.203.38@tcp:104: 00000100:00100000:0.0:1789760793.872120:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f71b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8110:1876699798250496:192.168.203.38@tcp:104: 00000100:00100000:3.0:1789760793.872122:0:9898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777252608 00000100:00100000:3.0:1789760793.872131:0:9898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777252608 00010000:00010000:0.0:1789760793.872154:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.872193:0:9898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 39 pid: 8114 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.872209:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777252480 00000100:00100000:1.0:1789760793.872214:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777252480 00010000:00010000:1.0:1789760793.872234:0:6451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 40 pid: 8112 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760793.872240:0:9898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:3.0:1789760793.872250:0:9898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e548b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+40:2404:x1876699777252608:12345-192.168.203.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789760793.872258:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00010000:00010000:3.0:1789760793.872269:0:9898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760793.872276:0:9898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 40 pid: 8114 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.872278:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+40:2405:x1876699777252480:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760793.872285:0:6451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760793.872289:0:9898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 40 pid: 8114 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.872290:0:6451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 40 pid: 8112 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760793.872967:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760793.875954:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777252736 00000100:00100000:0.0:1789760793.875976:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777252736 00000100:00100000:0.0:1789760793.876074:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:0.0:1789760793.876086:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+14:13132:x1876699777252736:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760793.876117:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760793.876145:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30000/0xc2b9a3a73985883b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d46 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876230:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876248:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876264:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876276:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876283:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876290:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876430:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30c00/0xc2b9a3a739858850 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876438:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30c00/0xc2b9a3a739858850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876463:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30c00/0xc2b9a3a739858850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760793.876487:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 16384 00000004:00200000:0.0:1789760793.876491:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789760793.876521:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30c00/0xc2b9a3a739858850 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876534:0:9081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876541:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876547:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876554:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876560:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760793.876565:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876573:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876587:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e5461f2c00) 00010000:00010000:0.0:1789760793.876590:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760793.876595:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876612:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30e00/0xc2b9a3a739858842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876628:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876634:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876640:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876645:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31600 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:0.0:1789760793.876648:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876654:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876662:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c7d905a (ffff97e5461f2800) 00010000:00010000:0.0:1789760793.876665:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760793.876669:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876675:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31600/0xc2b9a3a739858849 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c7d905a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876704:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30000/0xc2b9a3a73985883b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d46 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876730:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d30c00/0xc2b9a3a739858850 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d46 expref: 15 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.876744:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff97e543c0a800) 00010000:00010000:0.0:1789760793.876751:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789760793.876755:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e542d30c00, rc 0) 00000100:00100000:0.0:1789760793.876882:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+15:13132:x1876699777252736:12345-192.168.203.38@tcp:101:dd.500 Request processed in 798us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760793.876891:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 204 00010000:00010000:1.0:1789760793.876899:0:6451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 40 pid: 8112 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.876929:0:6451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096bd2ec3/0xc2b9a3a7398586eb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d00 expref: 40 pid: 8112 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.876947:0:6451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760793.877128:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+39:2405:x1876699777252480:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4849us (5045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760793.877138:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00080000:0.0:1789760793.879477:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789760793.880129:0:9898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce57471b/0xc2b9a3a7398586e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211cf9 expref: 38 pid: 8114 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.880157:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.880163:0:9898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760793.880170:0:9898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760793.880181:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1789760793.880186:0:9898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.880225:0:9898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760793.880270:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777252992 00000100:00100000:0.0:1789760793.880282:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777252992 00000100:00100000:3.0:1789760793.880303:0:9898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e548b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+37:2404:x1876699777252608:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 8054us (8283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760793.880315:0:9898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:0.0:1789760793.880350:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:0.0:1789760793.880363:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+15:13132:x1876699777252992:12345-192.168.203.38@tcp:101:dd.500 00010000:00010000:0.0:1789760793.880389:0:6467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760793.880411:0:6467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a739858857 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcddbef5e65211d4d expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.880629:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.880647:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.880659:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.880916:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.880926:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.880937:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.880945:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.880973:0:8110:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789760793.884439:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798250240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 19948us (20174us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789760793.884457:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:3.0:1789760793.884518:0:6453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760793.884529:0:6453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.884545:0:6453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760793.884550:0:6453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.884562:0:6453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.884587:0:6453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.884594:0:6453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f68f673/0xc2b9a3a73985882d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.884619:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760793.884621:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760793.884623:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760793.884784:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31400/0xc2b9a3a739858865 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.884822:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31400/0xc2b9a3a739858865 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.884854:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31400/0xc2b9a3a739858865 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760793.884904:0:3464:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e57ac17800/2, rc 0, transno 4294967364 00000100:00100000:1.0:1789760793.884925:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798250240:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1789760793.885939:0:6467:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00000100:00100000:2.0:1789760793.887407:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3463:x1876699798250112:12345-0@lo:6:osp-syn-0-1.0 Request processed in 22773us (23205us total) trans 4294967570 rc 0/0 00000100:00100000:2.0:1789760793.887422:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000004:00080000:3.0:1789760793.887638:0:3463:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e57ac14e00/2, rc 0, transno 4294967570 00000100:00100000:3.0:1789760793.887692:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ac14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3463:1876699798250112:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1789760793.887760:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a73985886c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887781:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a73985886c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887809:0:6467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a73985886c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887873:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887881:0:6467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887889:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887896:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31e00 already unused, calling callback (ffffffffc1eef4f0) 00010000:00010000:1.0:1789760793.887901:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887909:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887925:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff97e543c0a800) 00010000:00010000:1.0:1789760793.887929:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760793.887934:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887940:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31e00/0xc2b9a3a73985885e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760793.887956:0:6467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b04e533 reply state 00000000fde4ee8f transno 4294967372 ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31400/0xc2b9a3a739858865 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887969:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31400/0xc2b9a3a739858865 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.887975:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x4009f790 (ffff97e5489b1300) 00010000:00010000:1.0:1789760793.887983:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760793.887987:0:6467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789760793.888032:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e542d31000/0xc2b9a3a739858857 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d4d expref: 18 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.888049:0:6467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e57f54f000/0xc2b9a3a73985886c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xcddbef5e65211d4d expref: 17 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760793.888058:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff97e5461f2a00) 00010000:00010000:1.0:1789760793.888060:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760793.888063:0:6467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e57f54f000, rc 0) 00000100:00100000:1.0:1789760793.888132:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+18:13132:x1876699777252992:12345-192.168.203.38@tcp:101:dd.500 Request processed in 7772us (7957us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789760793.888140:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:1.0:1789760793.895337:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760793.895418:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777253120 00000100:00100000:0.0:1789760793.895433:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777253120 00000100:00100000:0.0:1789760793.895526:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468642979396 time 468643175741 state 0x0 ref 1 00000100:00100000:0.0:1789760793.895541:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 468693175741 time 468643175741 state 0x1 ref 1 00000100:00100000:0.0:1789760793.895574:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 468693175741 time 470079782227 state 0x0 ref 1 00000100:00100000:0.0:1789760793.895592:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+37:2403:x1876699777253120:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760793.895653:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789760793.895662:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.895678:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789760793.895683:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760793.895689:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760793.895704:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760793.896896:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760793.959906:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967571 is committed 00002000:00010000:3.0:1789760793.960049:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789760793.960053:0:13385:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789760793 00002000:00010000:3.0:1789760793.960056:0:13385:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789760793 00002000:00010000:3.0:1789760793.960058:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789760793.960072:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.960084:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.960093:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.960101:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760793.960105:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.960116:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.960137:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.960144:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf2fb3da/0xc2b9a3a73985887a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760793.960347:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967570 is committed 00000100:00100000:3.0:1789760793.960547:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777253120:12345-192.168.203.38@tcp:4:dd.500 Request processed in 64956us (65217us total) trans 4294967571 rc 0/0 00000100:00100000:3.0:1789760793.960576:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:3.0:1789760793.960586:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 468693175741 time 470079782227 state 0x2 ref 0 00000100:00100000:1.0:1789760793.993382:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760793.993474:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777253248 00000100:00100000:2.0:1789760793.993484:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777253248 00000100:00100000:2.0:1789760793.993541:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 468693175741 time 470079782227 state 0x0 ref 1 00000100:00100000:2.0:1789760793.993553:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470129782227 time 470079782227 state 0x1 ref 1 00000100:00100000:2.0:1789760793.993635:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470129782227 time 470177843826 state 0x0 ref 1 00000100:00100000:2.0:1789760793.993648:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777253248:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760793.993716:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 1048576, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x803 00010000:00010000:2.0:1789760793.993725:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.993740:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1789760793.993744:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.993750:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.993764:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.107819:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967572 is committed 00002000:00010000:2.0:1789760794.108056:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1789760794.108062:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1789760794.108079:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.108093:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.108104:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.108113:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760794.108118:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.108151:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.108176:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.108184:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786ed12b/0xc2b9a3a739858881 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.108430:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777253248:12345-192.168.203.38@tcp:4:dd.500 Request processed in 114717us (114990us total) trans 4294967572 rc 0/0 00000100:00100000:2.0:1789760794.108443:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1789760794.108457:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470129782227 time 470177843826 state 0x2 ref 0 00000100:00100000:0.0:1789760794.113350:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760794.113517:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777253376 00000100:00100000:3.0:1789760794.113531:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777253376 00000100:00100000:3.0:1789760794.113606:0:14781:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470129782227 time 470177843826 state 0x0 ref 1 00000100:00100000:3.0:1789760794.113623:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470227843826 time 470177843826 state 0x1 ref 1 00000100:00100000:3.0:1789760794.113688:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470227843826 time 470297896710 state 0x0 ref 1 00000100:00100000:3.0:1789760794.113702:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777253376:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760794.113775:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 2097152, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x1007 00010000:00010000:3.0:1789760794.113861:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.113881:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1789760794.113886:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.113894:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.113910:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.119061:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760794.158096:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760794.158145:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760794.158179:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760794.158218:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760794.158347:0:6460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777253504 00000100:00100000:2.0:1789760794.158361:0:6460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777253504 00000100:00100000:2.0:1789760794.158434:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 398 00000100:00100000:2.0:1789760794.158446:0:6460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777253504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1789760794.158535:0:6460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c9a29f0-58a4-4591-8db4-e258df357379+13:2404:x1876699777253504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 90us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760794.158543:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 398 00000100:00100000:0.0:1789760794.160832:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777253760 00000100:00100000:0.0:1789760794.160860:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777253760 00000100:00100000:0.0:1789760794.160932:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777253632 00000100:00100000:0.0:1789760794.160936:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777253632 00000100:00100000:0.0:1789760794.160959:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777253888 00000100:00100000:0.0:1789760794.160963:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777253888 00000100:00100000:0.0:1789760794.160988:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 518 00000100:00100000:0.0:1789760794.160998:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777253760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760794.161095:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777253760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 98us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760794.161103:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 518 00000100:00100000:0.0:1789760794.161121:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 519 00000100:00100000:0.0:1789760794.161127:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777253632:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760794.161158:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777253632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760794.161164:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 519 00000100:00100000:0.0:1789760794.161175:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 520 00000100:00100000:0.0:1789760794.161181:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f75bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777253888:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1789760794.162045:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f75bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e138f4d1-d0ec-4b86-a7ba-bb29c025f420+5:2404:x1876699777253888:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 858us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760794.162055:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 520 00000100:00080000:2.0:1789760794.162853:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760794.162861:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789760794.168619:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967573 is committed 00002000:00010000:0.0:1789760794.168736:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789760794.168742:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789760794.168761:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.168775:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.168827:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.168836:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760794.168841:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.168852:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.168876:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.168883:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.169051:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777253376:12345-192.168.203.38@tcp:4:dd.500 Request processed in 55345us (55709us total) trans 4294967573 rc 0/0 00000100:00100000:0.0:1789760794.169063:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:0.0:1789760794.169074:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470227843826 time 470297896710 state 0x2 ref 0 00000100:00100000:0.0:1789760794.174309:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760794.174396:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777254016 00000100:00100000:1.0:1789760794.174409:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777254016 00000100:00100000:1.0:1789760794.174485:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470227843826 time 470297896710 state 0x0 ref 1 00000100:00100000:1.0:1789760794.174502:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470347896710 time 470297896710 state 0x1 ref 1 00000100:00100000:1.0:1789760794.174559:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470347896710 time 470358766966 state 0x0 ref 1 00000100:00100000:1.0:1789760794.174573:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777254016:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760794.174641:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 3145728, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x1807 00010000:00010000:1.0:1789760794.174653:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.174674:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1789760794.174679:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.174687:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.174715:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760794.220246:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1789760794.220261:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1789760794.220280:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.220313:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.220323:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.220332:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54e000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760794.220338:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.220349:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.220387:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.220396:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985888f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.220528:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777254016:12345-192.168.203.38@tcp:4:dd.500 Request processed in 45951us (46226us total) trans 4294967574 rc 0/0 00000100:00100000:0.0:1789760794.220541:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:0.0:1789760794.220554:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470347896710 time 470358766966 state 0x2 ref 0 00000001:00080000:3.0:1789760794.224537:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967574 is committed 00000100:00100000:3.0:1789760794.226015:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760794.226113:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777254144 00000100:00100000:2.0:1789760794.226127:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777254144 00000100:00100000:2.0:1789760794.226229:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470347896710 time 470358766966 state 0x0 ref 1 00000100:00100000:2.0:1789760794.226246:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470408766966 time 470358766966 state 0x1 ref 1 00000100:00100000:2.0:1789760794.226277:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470408766966 time 470410486169 state 0x0 ref 1 00000100:00100000:2.0:1789760794.226292:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777254144:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760794.226353:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 4194304, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x2007 00010000:00010000:2.0:1789760794.226373:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.226394:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1789760794.226399:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.226406:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.226423:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760794.274774:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1789760794.274813:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1789760794.274832:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.274847:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.274858:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.274867:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760794.274872:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.274882:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.274905:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.274913:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013595056/0xc2b9a3a739858896 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.275031:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777254144:12345-192.168.203.38@tcp:4:dd.500 Request processed in 48734us (49020us total) trans 4294967575 rc 0/0 00000100:00100000:3.0:1789760794.275063:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1789760794.275076:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470408766966 time 470410486169 state 0x2 ref 0 00000001:00080000:0.0:1789760794.277409:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967575 is committed 00000100:00100000:2.0:1789760794.280969:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760794.281098:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777254272 00000100:00100000:3.0:1789760794.281110:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777254272 00000100:00100000:3.0:1789760794.281184:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470408766966 time 470410486169 state 0x0 ref 1 00000100:00100000:3.0:1789760794.281210:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470460486169 time 470410486169 state 0x1 ref 1 00000100:00100000:3.0:1789760794.281238:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470460486169 time 470465447352 state 0x0 ref 1 00000100:00100000:3.0:1789760794.281253:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777254272:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760794.281318:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 5242880, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x2807 00010000:00010000:3.0:1789760794.281329:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.281349:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1789760794.281355:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.281372:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.281388:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.345415:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967576 is committed 00002000:00010000:3.0:1789760794.345567:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1789760794.345576:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1789760794.345613:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.345629:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.345638:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.345646:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760794.345651:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.345662:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.345686:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.345694:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a73985889d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.345904:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777254272:12345-192.168.203.38@tcp:4:dd.500 Request processed in 64646us (64943us total) trans 4294967576 rc 0/0 00000100:00100000:3.0:1789760794.345915:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1789760794.345927:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470460486169 time 470465447352 state 0x2 ref 0 00000100:00100000:0.0:1789760794.350043:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760794.350146:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777254400 00000100:00100000:3.0:1789760794.350176:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777254400 00000100:00100000:3.0:1789760794.350251:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470460486169 time 470465447352 state 0x0 ref 1 00000100:00100000:3.0:1789760794.350267:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470515447352 time 470465447352 state 0x1 ref 1 00000100:00100000:3.0:1789760794.350335:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470515447352 time 470534543809 state 0x0 ref 1 00000100:00100000:3.0:1789760794.350350:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777254400:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760794.350432:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 6291456, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x3007 00010000:00010000:3.0:1789760794.350444:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.350463:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1789760794.350469:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.350476:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.350492:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760794.389909:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1789760794.389920:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1789760794.389935:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.389947:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.389971:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.389977:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760794.389981:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.389989:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.390008:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.390016:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.390144:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777254400:12345-192.168.203.38@tcp:4:dd.500 Request processed in 39790us (40109us total) trans 4294967577 rc 0/0 00000100:00100000:3.0:1789760794.390156:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1789760794.390169:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470515447352 time 470534543809 state 0x2 ref 0 00000001:00080000:2.0:1789760794.390249:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967577 is committed 00000100:00100000:0.0:1789760794.396354:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760794.397339:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777254528 00000100:00100000:2.0:1789760794.397353:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777254528 00000100:00100000:2.0:1789760794.397490:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470515447352 time 470534543809 state 0x0 ref 1 00000100:00100000:2.0:1789760794.397507:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 2 deadline 470584543809 time 470534543809 state 0x1 ref 1 00000100:00100000:2.0:1789760794.397780:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 470584543809 time 470581987419 state 0x0 ref 1 00000100:00100000:2.0:1789760794.397826:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777254528:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760794.397892:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 7340032, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x3807 00010000:00010000:2.0:1789760794.397903:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.397922:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1789760794.397928:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.397936:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.397952:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.430685:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967578 is committed 00002000:00010000:3.0:1789760794.431045:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:3.0:1789760794.431053:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789760794.431072:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.431109:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.431119:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.431127:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760794.431132:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.431143:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.431169:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.431177:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a7398588ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.431335:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777254528:12345-192.168.203.38@tcp:4:dd.500 Request processed in 33508us (34989us total) trans 4294967578 rc 0/0 00000100:00100000:3.0:1789760794.431347:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:3.0:1789760794.431568:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 470584543809 time 470581987419 state 0x2 ref 0 00000100:00100000:0.0:1789760794.438468:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760794.438593:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777254656 00000100:00100000:2.0:1789760794.438608:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777254656 00000100:00100000:2.0:1789760794.438699:0:14781:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 470584543809 time 470581987419 state 0x0 ref 1 00000100:00100000:2.0:1789760794.438726:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 470631987419 time 470581987419 state 0x1 ref 1 00000100:00100000:2.0:1789760794.438863:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470631987419 time 470623071995 state 0x0 ref 1 00000100:00100000:2.0:1789760794.438879:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777254656:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760794.438948:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0x4007 00010000:00010000:2.0:1789760794.438979:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.439003:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1789760794.439009:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.439018:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.439037:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760794.489163:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1789760794.489178:0:14781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789760793 -> 1789760794 00002000:00010000:2.0:1789760794.489181:0:14781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789760793 -> 1789760794 00002000:00010000:2.0:1789760794.489184:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:2.0:1789760794.489204:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.489221:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.489232:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.489240:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760794.489246:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.489283:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.489311:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.489319:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.489457:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777254656:12345-192.168.203.38@tcp:4:dd.500 Request processed in 50573us (50994us total) trans 4294967579 rc 0/0 00000100:00100000:2.0:1789760794.489469:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1789760794.489482:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470631987419 time 470623071995 state 0x2 ref 0 00000001:00080000:1.0:1789760794.489902:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967579 is committed 00000100:00100000:0.0:1789760794.494326:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760794.494408:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777254784 00000100:00100000:1.0:1789760794.494421:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777254784 00000100:00100000:1.0:1789760794.494500:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470631987419 time 470623071995 state 0x0 ref 1 00000100:00100000:1.0:1789760794.494517:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470673071995 time 470623071995 state 0x1 ref 1 00000100:00100000:1.0:1789760794.494553:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470673071995 time 470678761974 state 0x0 ref 1 00000100:00100000:1.0:1789760794.494567:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777254784:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760794.494634:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 9437184, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x4807 00010000:00010000:1.0:1789760794.494664:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.494685:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1789760794.494691:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.494700:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.494730:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760794.544930:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967580 is committed 00002000:00010000:3.0:1789760794.546256:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:3.0:1789760794.546288:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:3.0:1789760794.546306:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.546321:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.546330:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.546338:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54fe00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760794.546349:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.546360:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.546385:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.546393:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7cf0514/0xc2b9a3a7398588b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.546543:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777254784:12345-192.168.203.38@tcp:4:dd.500 Request processed in 51967us (52222us total) trans 4294967580 rc 0/0 00000100:00100000:3.0:1789760794.546555:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1789760794.546567:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470673071995 time 470678761974 state 0x2 ref 0 00000100:00100000:3.0:1789760794.558334:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760794.558982:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777254912 00000100:00100000:2.0:1789760794.558997:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777254912 00000100:00100000:2.0:1789760794.559092:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470673071995 time 470678761974 state 0x0 ref 1 00000100:00100000:2.0:1789760794.559110:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470728761974 time 470678761974 state 0x1 ref 1 00000100:00100000:2.0:1789760794.559275:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470728761974 time 470743482753 state 0x0 ref 1 00000100:00100000:2.0:1789760794.559295:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777254912:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760794.559364:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 10485760, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x5007 00010000:00010000:2.0:1789760794.559442:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.559480:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1789760794.559486:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.559495:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.559513:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.613700:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967581 is committed 00002000:00010000:2.0:1789760794.614233:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:2.0:1789760794.614239:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:2.0:1789760794.614553:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.614568:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.614577:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.614585:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760794.614591:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.614601:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.614654:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.614663:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398588c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.615018:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777254912:12345-192.168.203.38@tcp:4:dd.500 Request processed in 55721us (56691us total) trans 4294967581 rc 0/0 00000100:00100000:2.0:1789760794.615031:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1789760794.615043:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470728761974 time 470743482753 state 0x2 ref 0 00000100:00100000:3.0:1789760794.627380:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760794.628755:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777255040 00000100:00100000:0.0:1789760794.628773:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777255040 00000100:00100000:1.0:1789760794.630932:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470728761974 time 470743482753 state 0x0 ref 1 00000100:00100000:1.0:1789760794.630956:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470793482753 time 470743482753 state 0x1 ref 1 00000100:00100000:1.0:1789760794.631055:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470793482753 time 470815262604 state 0x0 ref 1 00000100:00100000:1.0:1789760794.631093:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777255040:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760794.631164:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 11534336, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x5807 00010000:00010000:1.0:1789760794.631176:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.631197:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1789760794.631202:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760794.631210:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760794.631251:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760794.673607:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967582 is committed 00002000:00010000:0.0:1789760794.673861:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:0.0:1789760794.673867:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:0.0:1789760794.673887:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.673904:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.673914:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.673923:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54fc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760794.673929:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.673939:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.673963:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.673992:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a7398588c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.674113:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777255040:12345-192.168.203.38@tcp:4:dd.500 Request processed in 43033us (46747us total) trans 4294967582 rc 0/0 00000100:00100000:0.0:1789760794.674125:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:0.0:1789760794.674137:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470793482753 time 470815262604 state 0x2 ref 0 00000100:00100000:2.0:1789760794.679119:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760794.679318:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777255168 00000100:00100000:3.0:1789760794.679330:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777255168 00000100:00100000:3.0:1789760794.679416:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470793482753 time 470815262604 state 0x0 ref 1 00000100:00100000:3.0:1789760794.679434:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470865262604 time 470815262604 state 0x1 ref 1 00000100:00100000:3.0:1789760794.681575:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470865262604 time 470865773265 state 0x0 ref 1 00000100:00100000:3.0:1789760794.681620:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e44c680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777255168:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760794.681686:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 12582912, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x6007 00010000:00010000:3.0:1789760794.681697:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.682153:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1789760794.682158:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.682166:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.682184:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.734093:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967583 is committed 00002000:00010000:0.0:1789760794.734449:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:0.0:1789760794.734456:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:0.0:1789760794.734475:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.734490:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.734500:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.734508:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760794.734514:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.734525:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.734575:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.734583:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a7398588ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.734760:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e44c680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777255168:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53155us (55649us total) trans 4294967583 rc 0/0 00000100:00100000:0.0:1789760794.734771:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:0.0:1789760794.734783:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470865262604 time 470865773265 state 0x2 ref 0 00000100:00100000:1.0:1789760794.741114:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760794.741222:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777255296 00000100:00100000:3.0:1789760794.741235:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777255296 00000100:00100000:3.0:1789760794.741311:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470865262604 time 470865773265 state 0x0 ref 1 00000100:00100000:3.0:1789760794.741353:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470915773265 time 470865773265 state 0x1 ref 1 00000100:00100000:3.0:1789760794.741490:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470915773265 time 470925697597 state 0x0 ref 1 00000100:00100000:3.0:1789760794.741506:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777255296:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760794.741570:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13631488, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x6807 00010000:00010000:3.0:1789760794.741581:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.741602:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1789760794.741606:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.741613:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.741630:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760794.820515:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967584 is committed 00002000:00010000:0.0:1789760794.820698:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789760794.820716:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789760794.820734:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.820748:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.820759:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.820767:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760794.820772:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.820843:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.820872:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.820882:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a7398588d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.821248:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777255296:12345-192.168.203.38@tcp:4:dd.500 Request processed in 79738us (80143us total) trans 4294967584 rc 0/0 00000100:00100000:0.0:1789760794.821260:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:0.0:1789760794.821273:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470915773265 time 470925697597 state 0x2 ref 0 00000100:00100000:0.0:1789760794.832752:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760794.832888:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777255424 00000100:00100000:3.0:1789760794.832904:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777255424 00000100:00100000:3.0:1789760794.832999:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470915773265 time 470925697597 state 0x0 ref 1 00000100:00100000:3.0:1789760794.833016:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470975697597 time 470925697597 state 0x1 ref 1 00000100:00100000:3.0:1789760794.833044:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470975697597 time 471017252347 state 0x0 ref 1 00000100:00100000:3.0:1789760794.833057:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777255424:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760794.833146:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 14680064, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x7007 00010000:00010000:3.0:1789760794.833160:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.833182:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1789760794.833187:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760794.833195:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.833212:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760794.875957:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:3.0:1789760794.875969:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:3.0:1789760794.875987:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.876003:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.876013:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.876022:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760794.876027:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.876058:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.876084:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760794.876094:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a7398588dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760794.876222:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777255424:12345-192.168.203.38@tcp:4:dd.500 Request processed in 43160us (43476us total) trans 4294967585 rc 0/0 00000100:00100000:3.0:1789760794.876235:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:3.0:1789760794.876249:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470975697597 time 471017252347 state 0x2 ref 0 00000001:00080000:2.0:1789760794.876365:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967585 is committed 00000100:00100000:3.0:1789760794.882993:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760794.883276:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777255552 00000100:00100000:0.0:1789760794.883291:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777255552 00000100:00100000:0.0:1789760794.883374:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 470975697597 time 471017252347 state 0x0 ref 1 00000100:00100000:0.0:1789760794.883391:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471067252347 time 471017252347 state 0x1 ref 1 00000100:00100000:0.0:1789760794.883425:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471067252347 time 471067634346 state 0x0 ref 1 00000100:00100000:0.0:1789760794.883439:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777255552:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760794.883502:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 15728640, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x7807 00010000:00010000:0.0:1789760794.883530:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.883550:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1789760794.883556:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760794.883563:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.883580:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760794.945878:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967586 is committed 00002000:00010000:0.0:1789760794.945995:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:0.0:1789760794.946001:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:0.0:1789760794.946019:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.946033:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.946042:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.946050:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760794.946055:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.946066:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.946110:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760794.946120:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aab8594/0xc2b9a3a7398588e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760794.946245:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777255552:12345-192.168.203.38@tcp:4:dd.500 Request processed in 62801us (63260us total) trans 4294967586 rc 0/0 00000100:00100000:0.0:1789760794.946257:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1789760794.946270:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471067252347 time 471067634346 state 0x2 ref 0 00000100:00100000:0.0:1789760794.952664:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760794.952909:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777255680 00000100:00100000:2.0:1789760794.952922:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777255680 00000100:00100000:2.0:1789760794.952995:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471067252347 time 471067634346 state 0x0 ref 1 00000100:00100000:2.0:1789760794.953012:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471117634346 time 471067634346 state 0x1 ref 1 00000100:00100000:2.0:1789760794.953047:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471117634346 time 471137256120 state 0x0 ref 1 00000100:00100000:2.0:1789760794.953062:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777255680:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760794.953123:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 16777216, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x8007 00010000:00010000:2.0:1789760794.953154:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.953188:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1789760794.953195:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.953203:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.953219:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.020502:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967587 is committed 00002000:00010000:2.0:1789760795.020973:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:2.0:1789760795.020981:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:2.0:1789760795.021004:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.021019:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.021029:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.021037:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760795.021043:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.021053:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.021101:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.021110:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a7398588ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.021287:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e5449d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777255680:12345-192.168.203.38@tcp:4:dd.500 Request processed in 68221us (68628us total) trans 4294967587 rc 0/0 00000100:00100000:2.0:1789760795.021299:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1789760795.021313:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471117634346 time 471137256120 state 0x2 ref 0 00000100:00100000:0.0:1789760795.034872:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760795.034940:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777255808 00000100:00100000:1.0:1789760795.034954:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777255808 00000100:00100000:1.0:1789760795.035055:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471117634346 time 471137256120 state 0x0 ref 1 00000100:00100000:1.0:1789760795.035073:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471187256120 time 471137256120 state 0x1 ref 1 00000100:00100000:1.0:1789760795.035109:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471187256120 time 471219318501 state 0x0 ref 1 00000100:00100000:1.0:1789760795.035123:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777255808:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760795.035182:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 17825792, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x8807 00010000:00010000:1.0:1789760795.035191:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.035207:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1789760795.035211:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.035216:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.035230:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760795.035905:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760795.076895:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967588 is committed 00002000:00010000:1.0:1789760795.077026:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:1.0:1789760795.077032:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:1.0:1789760795.077058:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.077073:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.077083:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.077092:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54ea00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760795.077098:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.077109:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.077130:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.077139:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.077363:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777255808:12345-192.168.203.38@tcp:4:dd.500 Request processed in 42228us (42493us total) trans 4294967588 rc 0/0 00000100:00100000:1.0:1789760795.077392:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:1.0:1789760795.077404:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471187256120 time 471219318501 state 0x2 ref 0 00000100:00100000:2.0:1789760795.082400:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760795.082681:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777255936 00000100:00100000:0.0:1789760795.082695:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777255936 00000100:00100000:0.0:1789760795.082781:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471187256120 time 471219318501 state 0x0 ref 1 00000100:00100000:0.0:1789760795.082830:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471269318501 time 471219318501 state 0x1 ref 1 00000100:00100000:0.0:1789760795.085346:0:8120:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471269318501 time 471269542270 state 0x0 ref 1 00000100:00100000:0.0:1789760795.085395:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e546384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777255936:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760795.085473:0:8120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 18874368, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x9007 00010000:00010000:0.0:1789760795.085483:0:8120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.085524:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1789760795.085529:0:8120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.085536:0:8120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.085553:0:8120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.142996:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760795.145635:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967589 is committed 00002000:00010000:1.0:1789760795.145989:0:8120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:1.0:1789760795.145994:0:8120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 36871 -> 38919 00010000:00010000:1.0:1789760795.146009:0:8120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.146022:0:8120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.146031:0:8120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.146039:0:8120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760795.146044:0:8120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.146054:0:8120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.146074:0:8120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.146081:0:8120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b9127af/0xc2b9a3a7398588f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.146200:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e546384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777255936:12345-192.168.203.38@tcp:4:dd.500 Request processed in 60826us (63809us total) trans 4294967589 rc 0/0 00000100:00100000:1.0:1789760795.146210:0:8120:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:1.0:1789760795.146219:0:8120:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471269318501 time 471269542270 state 0x2 ref 0 00000100:00100000:0.0:1789760795.151141:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760795.151196:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777256064 00000100:00100000:1.0:1789760795.151205:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777256064 00000100:00100000:1.0:1789760795.151261:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471269318501 time 471269542270 state 0x0 ref 1 00000100:00100000:1.0:1789760795.151276:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471319542270 time 471269542270 state 0x1 ref 1 00000100:00100000:1.0:1789760795.151314:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471319542270 time 471335515133 state 0x0 ref 1 00000100:00100000:1.0:1789760795.151328:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777256064:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760795.151377:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 19922944, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0x9807 00010000:00010000:1.0:1789760795.151387:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.151403:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1789760795.151408:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.151414:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.151434:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760795.191847:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:1.0:1789760795.191857:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 38919 -> 40967 00010000:00010000:1.0:1789760795.191871:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.191885:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.191895:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.191902:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54ea00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760795.191908:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.191916:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.191937:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.191946:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d3ea0d/0xc2b9a3a7398588ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.192049:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2403:x1876699777256064:12345-192.168.203.38@tcp:4:dd.500 Request processed in 40719us (40913us total) trans 4294967590 rc 0/0 00000100:00100000:1.0:1789760795.192072:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:1.0:1789760795.192081:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471319542270 time 471335515133 state 0x2 ref 0 00000001:00080000:3.0:1789760795.192616:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967590 is committed 00000100:00100000:0.0:1789760795.199328:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760795.199521:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777256192 00000100:00100000:2.0:1789760795.199530:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777256192 00000100:00100000:2.0:1789760795.199586:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471319542270 time 471335515133 state 0x0 ref 1 00000100:00100000:2.0:1789760795.199599:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471385515133 time 471335515133 state 0x1 ref 1 00000100:00100000:0.0:1789760795.203504:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471385515133 time 471387703796 state 0x0 ref 1 00000100:00100000:0.0:1789760795.203539:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777256192:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760795.203595:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 20971520, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xa007 00010000:00010000:0.0:1789760795.203605:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.203621:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1789760795.203626:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.203633:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.203649:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.260612:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967591 is committed 00002000:00010000:2.0:1789760795.260768:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:2.0:1789760795.260773:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 40967 -> 43015 00010000:00010000:2.0:1789760795.260814:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.260828:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.260850:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.260857:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760795.260861:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.260869:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.260888:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.260895:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002129b6ed/0xc2b9a3a739858906 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.260992:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777256192:12345-192.168.203.38@tcp:4:dd.500 Request processed in 57464us (61667us total) trans 4294967591 rc 0/0 00000100:00100000:2.0:1789760795.261002:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:2.0:1789760795.261013:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471385515133 time 471387703796 state 0x2 ref 0 00000100:00100000:0.0:1789760795.276420:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760795.276518:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777256320 00000100:00100000:2.0:1789760795.276528:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777256320 00000100:00100000:2.0:1789760795.276582:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471385515133 time 471387703796 state 0x0 ref 1 00000100:00100000:2.0:1789760795.276595:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471437703796 time 471387703796 state 0x1 ref 1 00000100:00100000:2.0:1789760795.276637:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471437703796 time 471460845604 state 0x0 ref 1 00000100:00100000:2.0:1789760795.276651:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777256320:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760795.276709:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 22020096, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xa807 00010000:00010000:2.0:1789760795.276719:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.276736:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1789760795.276740:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.276747:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.276762:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.322181:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967592 is committed 00002000:00010000:2.0:1789760795.322361:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:2.0:1789760795.322366:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 43015 -> 45063 00010000:00010000:2.0:1789760795.322381:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.322392:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.322400:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.322425:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760795.322429:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.322438:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.322458:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.322465:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a73985890d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.322565:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777256320:12345-192.168.203.38@tcp:4:dd.500 Request processed in 45911us (46151us total) trans 4294967592 rc 0/0 00000100:00100000:2.0:1789760795.322574:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1789760795.322584:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471437703796 time 471460845604 state 0x2 ref 0 00000100:00100000:2.0:1789760795.330650:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760795.330752:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777256448 00000100:00100000:1.0:1789760795.330762:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777256448 00000100:00100000:1.0:1789760795.330858:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471437703796 time 471460845604 state 0x0 ref 1 00000100:00100000:1.0:1789760795.330872:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471510845604 time 471460845604 state 0x1 ref 1 00000100:00100000:1.0:1789760795.330892:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471510845604 time 471515101554 state 0x0 ref 1 00000100:00100000:1.0:1789760795.330905:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777256448:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760795.330954:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 23068672, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xb007 00010000:00010000:1.0:1789760795.330964:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.330981:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1789760795.330986:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.330994:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.331008:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.404777:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967593 is committed 00002000:00010000:2.0:1789760795.404878:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:2.0:1789760795.404883:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 45063 -> 47111 00010000:00010000:2.0:1789760795.404897:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.404909:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.404932:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.404940:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54fc00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760795.404945:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.404954:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.404973:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.404980:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e0e8a0/0xc2b9a3a739858914 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.405172:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777256448:12345-192.168.203.38@tcp:4:dd.500 Request processed in 74263us (74527us total) trans 4294967593 rc 0/0 00000100:00100000:2.0:1789760795.405252:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1789760795.405262:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471510845604 time 471515101554 state 0x2 ref 0 00000100:00100000:2.0:1789760795.412235:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760795.412395:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777256576 00000100:00100000:0.0:1789760795.412405:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777256576 00000100:00100000:0.0:1789760795.412460:0:14781:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471510845604 time 471515101554 state 0x0 ref 1 00000100:00100000:0.0:1789760795.412474:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471565101554 time 471515101554 state 0x1 ref 1 00000100:00100000:0.0:1789760795.412509:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471565101554 time 471596718621 state 0x0 ref 1 00000100:00100000:0.0:1789760795.412523:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777256576:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760795.412573:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 24117248, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xb807 00010000:00010000:0.0:1789760795.412583:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.412598:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1789760795.412603:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760795.412609:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.412624:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760795.499149:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:1.0:1789760795.499170:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 47111 -> 49159 00010000:00010000:1.0:1789760795.499186:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.499199:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.499207:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.499215:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760795.499220:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.499229:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.499249:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.499256:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893e4188/0xc2b9a3a73985891b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760795.499344:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777256576:12345-192.168.203.38@tcp:4:dd.500 Request processed in 86820us (87117us total) trans 4294967594 rc 0/0 00000100:00100000:1.0:1789760795.499524:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1789760795.499533:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471565101554 time 471596718621 state 0x2 ref 0 00000001:00080000:3.0:1789760795.499646:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967594 is committed 00000100:00100000:0.0:1789760795.511407:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760795.511713:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777256704 00000100:00100000:3.0:1789760795.511723:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777256704 00000100:00100000:3.0:1789760795.511778:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471565101554 time 471596718621 state 0x0 ref 1 00000100:00100000:3.0:1789760795.511824:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471646718621 time 471596718621 state 0x1 ref 1 00000100:00100000:3.0:1789760795.511855:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471646718621 time 471696064571 state 0x0 ref 1 00000100:00100000:3.0:1789760795.511880:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777256704:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760795.511926:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 25165824, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc007 00010000:00010000:3.0:1789760795.511935:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.511950:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1789760795.511954:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760795.511961:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.511975:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.578176:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967595 is committed 00002000:00010000:3.0:1789760795.578257:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:3.0:1789760795.578262:0:13391:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789760794 -> 1789760795 00002000:00010000:3.0:1789760795.578265:0:13391:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789760794 -> 1789760795 00002000:00010000:3.0:1789760795.578267:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 49159 -> 51209 00010000:00010000:3.0:1789760795.578282:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.578294:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.578302:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.578328:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760795.578332:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.578340:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.578359:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.578366:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858922 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760795.578605:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777256704:12345-192.168.203.38@tcp:4:dd.500 Request processed in 66721us (67201us total) trans 4294967595 rc 0/0 00000100:00100000:3.0:1789760795.578615:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1789760795.578625:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471646718621 time 471696064571 state 0x2 ref 0 00000100:00100000:2.0:1789760795.585691:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760795.585751:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777256832 00000100:00100000:3.0:1789760795.585770:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777256832 00000100:00100000:3.0:1789760795.585859:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471646718621 time 471696064571 state 0x0 ref 1 00000100:00100000:3.0:1789760795.585873:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471746064571 time 471696064571 state 0x1 ref 1 00000100:00100000:3.0:1789760795.585891:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471746064571 time 471770101104 state 0x0 ref 1 00000100:00100000:3.0:1789760795.585917:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777256832:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760795.585963:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 26214400, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xc809 00010000:00010000:3.0:1789760795.585972:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.585989:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1789760795.585994:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760795.585999:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.586013:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.635953:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967596 is committed 00002000:00010000:0.0:1789760795.636044:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:0.0:1789760795.636050:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 51209 -> 53257 00010000:00010000:0.0:1789760795.636082:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.636097:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.636106:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.636114:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760795.636118:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.636127:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.636147:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.636154:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858929 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.636253:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777256832:12345-192.168.203.38@tcp:4:dd.500 Request processed in 50335us (50567us total) trans 4294967596 rc 0/0 00000100:00100000:0.0:1789760795.636262:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1789760795.636271:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471746064571 time 471770101104 state 0x2 ref 0 00000100:00100000:2.0:1789760795.651927:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760795.652101:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777256960 00000100:00100000:1.0:1789760795.652111:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777256960 00000100:00100000:1.0:1789760795.652165:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471746064571 time 471770101104 state 0x0 ref 1 00000100:00100000:1.0:1789760795.652179:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471820101104 time 471770101104 state 0x1 ref 1 00000100:00100000:1.0:1789760795.652210:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471820101104 time 471836418548 state 0x0 ref 1 00000100:00100000:1.0:1789760795.652225:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777256960:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760795.652275:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 27262976, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd009 00010000:00010000:1.0:1789760795.652285:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.652300:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1789760795.652305:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.652311:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.652325:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760795.693851:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:3.0:1789760795.693860:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 53257 -> 55305 00010000:00010000:3.0:1789760795.693873:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.693887:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.693896:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.693904:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54e800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760795.693909:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.693933:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.693954:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.693962:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858930 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760795.694061:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777256960:12345-192.168.203.38@tcp:4:dd.500 Request processed in 41835us (42142us total) trans 4294967597 rc 0/0 00000100:00100000:3.0:1789760795.694072:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1789760795.694081:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471820101104 time 471836418548 state 0x2 ref 0 00000001:00080000:2.0:1789760795.694727:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967597 is committed 00000100:00100000:1.0:1789760795.701421:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760795.701590:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777257088 00000100:00100000:2.0:1789760795.701600:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777257088 00000100:00100000:2.0:1789760795.701655:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471820101104 time 471836418548 state 0x0 ref 1 00000100:00100000:2.0:1789760795.701668:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471886418548 time 471836418548 state 0x1 ref 1 00000100:00100000:2.0:1789760795.702282:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471886418548 time 471886487707 state 0x0 ref 1 00000100:00100000:2.0:1789760795.702301:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777257088:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760795.702361:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 28311552, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd809 00010000:00010000:2.0:1789760795.702371:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.702386:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1789760795.702391:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.702397:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.702410:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760795.741486:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:2.0:1789760795.741496:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 55305 -> 57353 00010000:00010000:2.0:1789760795.741510:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.741523:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.741546:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.741553:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760795.741558:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.741568:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.741589:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.741597:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858937 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.741710:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777257088:12345-192.168.203.38@tcp:4:dd.500 Request processed in 39410us (40294us total) trans 4294967598 rc 0/0 00000100:00100000:2.0:1789760795.741720:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1789760795.741730:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471886418548 time 471886487707 state 0x2 ref 0 00000001:00080000:0.0:1789760795.741816:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967598 is committed 00000100:00100000:0.0:1789760795.748293:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760795.748390:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777257216 00000100:00100000:1.0:1789760795.748400:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777257216 00000100:00100000:1.0:1789760795.748456:0:8120:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471886418548 time 471886487707 state 0x0 ref 1 00000100:00100000:1.0:1789760795.748482:0:8120:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471936487707 time 471886487707 state 0x1 ref 1 00000100:00100000:1.0:1789760795.752748:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471936487707 time 471936945241 state 0x0 ref 1 00000100:00100000:1.0:1789760795.753412:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e581c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777257216:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760795.753471:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 29360128, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xe009 00010000:00010000:1.0:1789760795.753480:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.753497:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1789760795.753501:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760795.753507:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760795.753521:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760795.811817:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967599 is committed 00002000:00010000:3.0:1789760795.811919:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:3.0:1789760795.811925:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 57353 -> 59401 00010000:00010000:3.0:1789760795.811939:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.811951:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.811960:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.811986:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54e000 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760795.811991:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.812001:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.812022:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.812030:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042d4026c/0xc2b9a3a73985893e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760795.812167:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e581c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777257216:12345-192.168.203.38@tcp:4:dd.500 Request processed in 59393us (63877us total) trans 4294967599 rc 0/0 00000100:00100000:3.0:1789760795.812575:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1789760795.812586:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471936487707 time 471936945241 state 0x2 ref 0 00000100:00100000:2.0:1789760795.822846:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760795.822897:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777257344 00000100:00100000:3.0:1789760795.822907:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777257344 00000100:00100000:3.0:1789760795.822965:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471936487707 time 471936945241 state 0x0 ref 1 00000100:00100000:3.0:1789760795.822978:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471986945241 time 471936945241 state 0x1 ref 1 00000100:00100000:3.0:1789760795.823010:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471986945241 time 472007218449 state 0x0 ref 1 00000100:00100000:3.0:1789760795.823038:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777257344:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760795.823086:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 30408704, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xe809 00010000:00010000:3.0:1789760795.823096:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.823112:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789760795.823117:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760795.823124:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.823141:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760795.882512:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967600 is committed 00002000:00010000:0.0:1789760795.882627:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:0.0:1789760795.882633:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 59401 -> 61449 00010000:00010000:0.0:1789760795.882648:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.882662:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.882671:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.882679:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760795.882683:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.882701:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.882722:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.882730:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a739858945 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.882940:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777257344:12345-192.168.203.38@tcp:4:dd.500 Request processed in 59900us (60099us total) trans 4294967600 rc 0/0 00000100:00100000:0.0:1789760795.882950:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1789760795.882959:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471986945241 time 472007218449 state 0x2 ref 0 00000100:00100000:2.0:1789760795.892620:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760795.892659:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777257472 00000100:00100000:2.0:1789760795.892669:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777257472 00000100:00100000:2.0:1789760795.892744:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 471986945241 time 472007218449 state 0x0 ref 1 00000100:00100000:2.0:1789760795.892758:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472057218449 time 472007218449 state 0x1 ref 1 00000100:00100000:2.0:1789760795.892804:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472057218449 time 472076996963 state 0x0 ref 1 00000100:00100000:2.0:1789760795.892817:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777257472:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760795.892863:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 31457280, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xf009 00010000:00010000:2.0:1789760795.892873:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.892888:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1789760795.892891:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.892897:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.892911:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760795.945841:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:0.0:1789760795.945849:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 61449 -> 63497 00010000:00010000:0.0:1789760795.945872:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.945892:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.945902:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.945910:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760795.945915:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.945924:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760795.945965:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967601 is committed 00010000:00010000:0.0:1789760795.946062:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760795.946094:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a73985894c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760795.946191:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777257472:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53372us (53576us total) trans 4294967601 rc 0/0 00000100:00100000:0.0:1789760795.946202:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:0.0:1789760795.946211:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472057218449 time 472076996963 state 0x2 ref 0 00000100:00100000:2.0:1789760795.955678:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760795.955818:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777257600 00000100:00100000:3.0:1789760795.955836:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777257600 00000100:00100000:3.0:1789760795.955916:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472057218449 time 472076996963 state 0x0 ref 1 00000100:00100000:3.0:1789760795.955933:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472126996963 time 472076996963 state 0x1 ref 1 00000100:00100000:3.0:1789760795.955969:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472126996963 time 472140177598 state 0x0 ref 1 00000100:00100000:3.0:1789760795.955987:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777257600:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760795.956054:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 32505856, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xf809 00010000:00010000:3.0:1789760795.956066:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.956098:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789760795.956103:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760795.956112:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.956131:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760796.005854:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:2.0:1789760796.005870:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 63497 -> 65545 00010000:00010000:2.0:1789760796.005890:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.005906:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.005942:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.005951:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760796.005958:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.005969:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.005996:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.006004:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858953 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760796.006223:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777257600:12345-192.168.203.38@tcp:4:dd.500 Request processed in 50234us (50547us total) trans 4294967602 rc 0/0 00000100:00100000:2.0:1789760796.006236:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1789760796.006249:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472126996963 time 472140177598 state 0x2 ref 0 00000001:00080000:3.0:1789760796.007018:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967602 is committed 00000100:00100000:2.0:1789760796.015198:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760796.015495:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777257728 00000100:00100000:0.0:1789760796.015509:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777257728 00000100:00100000:0.0:1789760796.015585:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472126996963 time 472140177598 state 0x0 ref 1 00000100:00100000:0.0:1789760796.015602:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472190177598 time 472140177598 state 0x1 ref 1 00000100:00100000:0.0:1789760796.015643:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472190177598 time 472199851500 state 0x0 ref 1 00000100:00100000:0.0:1789760796.015668:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777257728:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760796.015745:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 33554432, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x10009 00010000:00010000:0.0:1789760796.015757:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.015779:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1789760796.015784:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.015844:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.015887:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.095848:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967603 is committed 00002000:00010000:0.0:1789760796.095974:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:0.0:1789760796.095980:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 65545 -> 67593 00010000:00010000:0.0:1789760796.095999:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.096012:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.096022:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.096029:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760796.096035:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.096046:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.096072:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.096079:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081760ffe/0xc2b9a3a73985895a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.096230:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777257728:12345-192.168.203.38@tcp:4:dd.500 Request processed in 80560us (81043us total) trans 4294967603 rc 0/0 00000100:00100000:0.0:1789760796.096241:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:0.0:1789760796.096255:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472190177598 time 472199851500 state 0x2 ref 0 00000100:00100000:2.0:1789760796.112780:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760796.113110:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777257856 00000100:00100000:1.0:1789760796.113124:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777257856 00000100:00100000:1.0:1789760796.113203:0:14781:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472190177598 time 472199851500 state 0x0 ref 1 00000100:00100000:1.0:1789760796.113233:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472249851500 time 472199851500 state 0x1 ref 1 00000100:00100000:1.0:1789760796.113267:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472249851500 time 472297475561 state 0x0 ref 1 00000100:00100000:1.0:1789760796.113309:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777257856:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760796.113384:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 34603008, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x10809 00010000:00010000:1.0:1789760796.113397:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.113419:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1789760796.113425:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.113432:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.113450:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.172813:0:6453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760796.183450:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967604 is committed 00002000:00010000:3.0:1789760796.183849:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:3.0:1789760796.183856:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 67593 -> 69641 00010000:00010000:3.0:1789760796.183875:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.183890:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.183900:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.183908:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54f800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.183914:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.183925:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.183973:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.183981:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce53960f/0xc2b9a3a739858961 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.184123:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777257856:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70810us (71353us total) trans 4294967604 rc 0/0 00000100:00100000:3.0:1789760796.184135:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:3.0:1789760796.184147:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472249851500 time 472297475561 state 0x2 ref 0 00000100:00100000:3.0:1789760796.190475:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760796.190540:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777257984 00000100:00100000:1.0:1789760796.190553:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777257984 00000100:00100000:1.0:1789760796.190701:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472249851500 time 472297475561 state 0x0 ref 1 00000100:00100000:1.0:1789760796.190720:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472347475561 time 472297475561 state 0x1 ref 1 00000100:00100000:1.0:1789760796.190850:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472347475561 time 472375058140 state 0x0 ref 1 00000100:00100000:1.0:1789760796.190865:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777257984:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760796.190932:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 35651584, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x11009 00010000:00010000:1.0:1789760796.190943:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.190982:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1789760796.190987:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.190995:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.191012:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.273541:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967605 is committed 00002000:00010000:3.0:1789760796.273666:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:3.0:1789760796.273672:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 69641 -> 71689 00010000:00010000:3.0:1789760796.273699:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.273715:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.273726:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.273820:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54e800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.273826:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.273862:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.273888:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.273909:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000346370e1/0xc2b9a3a739858968 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.274048:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777257984:12345-192.168.203.38@tcp:4:dd.500 Request processed in 83179us (83580us total) trans 4294967605 rc 0/0 00000100:00100000:3.0:1789760796.274062:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:3.0:1789760796.274075:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472347475561 time 472375058140 state 0x2 ref 0 00000100:00100000:0.0:1789760796.281147:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760796.282661:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777258112 00000100:00100000:3.0:1789760796.282869:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777258112 00000100:00100000:2.0:1789760796.283029:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472347475561 time 472375058140 state 0x0 ref 1 00000100:00100000:2.0:1789760796.283047:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472425058140 time 472375058140 state 0x1 ref 1 00000100:00100000:3.0:1789760796.283282:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472425058140 time 472467488863 state 0x0 ref 1 00000100:00100000:3.0:1789760796.283303:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777258112:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760796.283372:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 36700160, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x11809 00010000:00010000:3.0:1789760796.283383:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.283407:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789760796.283412:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.283427:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.283446:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.349351:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967606 is committed 00002000:00010000:3.0:1789760796.349476:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:3.0:1789760796.349481:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 71689 -> 73737 00010000:00010000:3.0:1789760796.349495:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.349508:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.349517:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.349524:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.349529:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.349539:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.349570:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.349596:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a73985896f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.350197:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777258112:12345-192.168.203.38@tcp:4:dd.500 Request processed in 66896us (69058us total) trans 4294967606 rc 0/0 00000100:00100000:3.0:1789760796.350208:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:3.0:1789760796.350220:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472425058140 time 472467488863 state 0x2 ref 0 00000100:00100000:0.0:1789760796.357046:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760796.357414:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777258240 00000100:00100000:2.0:1789760796.357424:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777258240 00000100:00100000:2.0:1789760796.357477:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472425058140 time 472467488863 state 0x0 ref 1 00000100:00100000:2.0:1789760796.357490:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472517488863 time 472467488863 state 0x1 ref 1 00000100:00100000:2.0:1789760796.357555:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472517488863 time 472541764052 state 0x0 ref 1 00000100:00100000:2.0:1789760796.357566:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777258240:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760796.357611:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 37748736, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x12009 00010000:00010000:2.0:1789760796.357619:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.357635:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1789760796.357639:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.357645:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.357659:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.359115:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798250624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760796.359178:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789760796.359212:0:9532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 472543422198ns, next at 473543419223ns, rc = 0 00000100:00100000:3.0:1789760796.359249:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760796.359257:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798250752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789760796.359277:0:14026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798250624 00000100:00100000:0.0:1789760796.359285:0:14026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798250624 00000100:00100000:0.0:1789760796.359347:0:14026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789760796.359357:0:14026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798250624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760796.359386:0:14026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 98631680 pending 27262976 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789760796.359498:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760796.361495:0:14026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1876699798250624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2130us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760796.361507:0:14026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789760796.361553:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798251264:0@lo:400:kworker.0 00000100:00100000:0.0:1789760796.361592:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760796.361642:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798251776:0@lo:400:kworker.0 00000100:00100000:0.0:1789760796.361668:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760796.361701:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798252288:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.361816:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798251008:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.361848:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760796.361878:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798251520:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.361899:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760796.361918:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798252032:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.361934:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760796.361956:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789760796.361962:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798250880:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.361984:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760796.362001:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798251392:0@lo:400:kworker.0 00000100:00100000:2.0:1789760796.362085:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798251264 00000100:00100000:2.0:1789760796.362093:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798251264 00000100:00100000:1.0:1789760796.362120:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760796.362140:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798251904:0@lo:400:kworker.0 00000100:00100000:2.0:1789760796.362141:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798251008 00000100:00100000:2.0:1789760796.362148:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798251008 00000100:00100000:2.0:1789760796.362182:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798251520 00000100:00100000:2.0:1789760796.362185:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798251520 00000100:00100000:2.0:1789760796.362208:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798252032 00000100:00100000:2.0:1789760796.362212:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798252032 00000100:00100000:2.0:1789760796.362229:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1789760796.362236:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798251264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760796.362286:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3462:x1876699798251264:12345-0@lo:400:kworker.0 Request processed in 50us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760796.362293:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1789760796.362306:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1789760796.362312:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798251008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.362332:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760796.362670:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1789760796.362679:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798251520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.362735:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1876699798251520:12345-0@lo:400:kworker.0 Request processed in 58us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.362742:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1789760796.362755:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1789760796.362761:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798252032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.362782:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1876699798252032:12345-0@lo:400:kworker.0 Request processed in 22us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.362805:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1789760796.362827:0:6459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798250880 00000100:00100000:1.0:1789760796.362831:0:6459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798250880 00000100:00100000:1.0:1789760796.362858:0:6459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789760796.362865:0:6459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798250880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.362894:0:6459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e543e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c2ee86d-cc6e-4694-9302-8ec928b8d70f+24:3464:x1876699798250880:12345-0@lo:400:kworker.0 Request processed in 30us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.362899:0:6459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789760796.362924:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798251392 00000100:00100000:1.0:1789760796.362928:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798251392 00000100:00100000:1.0:1789760796.362952:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789760796.362957:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798251392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.362984:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798251392:12345-0@lo:400:kworker.0 Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.362990:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789760796.363004:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798251776 00000100:00100000:1.0:1789760796.363007:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798251776 00000100:00100000:1.0:1789760796.363050:0:9533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798251904 00000100:00100000:1.0:1789760796.363052:0:9533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798251904 00000100:00100000:1.0:1789760796.363070:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789760796.363081:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798251776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.363108:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3462:x1876699798251776:12345-0@lo:400:kworker.0 Request processed in 28us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.363113:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789760796.363123:0:9533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789760796.363127:0:9533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798251904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.363146:0:9533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3464:x1876699798251904:12345-0@lo:400:kworker.0 Request processed in 18us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.363151:0:9533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789760796.363197:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1c2ee86d-cc6e-4694-9302-8ec928b8d70f:3464:1876699798250880:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.363973:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798251392:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.363988:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1876699798251904:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.363997:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1876699798251520:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.364006:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1876699798252032:0@lo:400:kworker.0 00000100:00100000:0.0:1789760796.365990:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760796.366084:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3462:1876699798251264:0@lo:400:kworker.0 00000100:00100000:0.0:1789760796.366118:0:3462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967570 gen 2 00000004:00080000:0.0:1789760796.366123:0:3462:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e57ac14e00, transno 4294967570 00000100:00100000:0.0:1789760796.366138:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798251776:0@lo:400:kworker.0 00000100:00100000:0.0:1789760796.366155:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789760796.366165:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798251136:0@lo:400:kworker.0 00000100:00100000:0.0:1789760796.366206:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760796.366228:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798251648:0@lo:400:kworker.0 00000100:00100000:0.0:1789760796.366252:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760796.366269:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798252160:0@lo:400:kworker.0 00000100:00100000:0.0:1789760796.366292:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760796.366455:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798252288 00000100:00100000:1.0:1789760796.366462:0:8114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798252288 00000100:00100000:1.0:1789760796.366517:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789760796.366525:0:8114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798252288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.366583:0:8114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798252288:12345-0@lo:400:kworker.0 Request processed in 59us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.366590:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789760796.367911:0:7305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798251136 00000100:00100000:1.0:1789760796.367920:0:7305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798251136 00000100:00100000:1.0:1789760796.367967:0:7305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789760796.367984:0:7305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798251136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.368043:0:7305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3462:x1876699798251136:12345-0@lo:400:kworker.0 Request processed in 61us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.368049:0:7305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789760796.368070:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798251648 00000100:00100000:1.0:1789760796.368073:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798251648 00000100:00100000:1.0:1789760796.368100:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798252160 00000100:00100000:1.0:1789760796.368102:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798252160 00000100:00100000:1.0:1789760796.368116:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1789760796.368122:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798251648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.368148:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3462:x1876699798251648:12345-0@lo:400:kworker.0 Request processed in 27us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.368154:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1789760796.368162:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1789760796.368167:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798252160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.368186:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3462:x1876699798252160:12345-0@lo:400:kworker.0 Request processed in 19us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.368191:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1789760796.368240:0:3462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967366 gen 2 00000004:00080000:1.0:1789760796.368246:0:3462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967366 committed transno 4294967366 00000020:00080000:1.0:1789760796.368251:0:3462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97e579e41180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789760796.368255:0:3462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e57f886200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97e579e41000 00000020:00080000:1.0:1789760796.368258:0:3462:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].6 00000020:00080000:1.0:1789760796.368261:0:3462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e57f886000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e57d2cac00 00000020:00080000:1.0:1789760796.368264:0:3462:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].6 00000100:00100000:1.0:1789760796.368287:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798251136:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.368307:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3462:1876699798251648:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.368316:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3462:1876699798252160:0@lo:400:kworker.0 00000100:00100000:1.0:1789760796.368327:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3462:1876699798252288:0@lo:400:kworker.0 00000100:00100000:2.0:1789760796.368960:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1876699798251008:12345-0@lo:400:kworker.0 Request processed in 6644us (7108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760796.368969:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00080000:2.0:1789760796.369053:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760796.369057:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760796.369060:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760796.369062:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:1.0:1789760796.369513:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 6 committed batchid 4 00000020:00080000:1.0:1789760796.369589:0:7284:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789760796.369623:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1876699798251008:0@lo:400:kworker.0 00000100:00100000:3.0:1789760796.370258:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760796.370471:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1876699798250624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760796.370558:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798250752 00000100:00100000:3.0:1789760796.370564:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798250752 00000100:00100000:3.0:1789760796.370619:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789760796.370628:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798250752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789760796.370648:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 98631680 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760796.370805:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3461:x1876699798250752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760796.370813:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789760796.370873:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798250752:0@lo:13:osp-pre-1-1.0 00002000:00010000:0.0:1789760796.427400:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:0.0:1789760796.427409:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 73737 -> 75785 00010000:00010000:0.0:1789760796.427423:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.427436:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.427445:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.427453:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760796.427458:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.427468:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.427504:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.427512:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858976 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.427601:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777258240:12345-192.168.203.38@tcp:4:dd.500 Request processed in 70032us (70559us total) trans 4294967607 rc 0/0 00000100:00100000:0.0:1789760796.427612:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1789760796.427621:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472517488863 time 472541764052 state 0x2 ref 0 00000001:00080000:3.0:1789760796.428568:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967607 is committed 00000100:00100000:0.0:1789760796.438020:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760796.438130:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777258368 00000100:00100000:2.0:1789760796.438212:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777258368 00000100:00100000:2.0:1789760796.438271:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472517488863 time 472541764052 state 0x0 ref 1 00000100:00100000:2.0:1789760796.438285:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472591764052 time 472541764052 state 0x1 ref 1 00000100:00100000:2.0:1789760796.438322:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472591764052 time 472622531134 state 0x0 ref 1 00000100:00100000:2.0:1789760796.438334:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777258368:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760796.438397:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 38797312, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x12809 00010000:00010000:2.0:1789760796.438407:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.438422:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1789760796.438426:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.438433:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.438453:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760796.475844:0:8119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:3.0:1789760796.475865:0:8119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 75785 -> 77833 00010000:00010000:3.0:1789760796.475880:0:8119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.475893:0:8119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.475903:0:8119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.475911:0:8119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.475916:0:8119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.475925:0:8119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.475947:0:8119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.475955:0:8119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a73985897d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760796.475986:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967608 is committed 00000100:00100000:3.0:1789760796.476095:0:8119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777258368:12345-192.168.203.38@tcp:4:dd.500 Request processed in 37758us (38079us total) trans 4294967608 rc 0/0 00000100:00100000:3.0:1789760796.476105:0:8119:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:3.0:1789760796.476115:0:8119:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472591764052 time 472622531134 state 0x2 ref 0 00000100:00100000:0.0:1789760796.483966:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760796.484124:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777258496 00000100:00100000:2.0:1789760796.484134:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777258496 00000100:00100000:2.0:1789760796.484912:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472591764052 time 472622531134 state 0x0 ref 1 00000100:00100000:2.0:1789760796.484939:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472672531134 time 472622531134 state 0x1 ref 1 00000100:00100000:3.0:1789760796.489115:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472672531134 time 472673312320 state 0x0 ref 1 00000100:00100000:3.0:1789760796.489152:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777258496:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760796.489226:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 39845888, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0x13009 00010000:00010000:3.0:1789760796.489236:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.489252:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789760796.489257:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.489263:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.489278:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.549516:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967609 is committed 00002000:00010000:3.0:1789760796.549615:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:3.0:1789760796.549620:0:14781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789760795 -> 1789760796 00002000:00010000:3.0:1789760796.549622:0:14781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789760795 -> 1789760796 00002000:00010000:3.0:1789760796.549625:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 77833 -> 79881 00010000:00010000:3.0:1789760796.549640:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.549653:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.549663:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.549684:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.549697:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.549706:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.549727:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.549734:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858984 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.549865:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777258496:12345-192.168.203.38@tcp:4:dd.500 Request processed in 60726us (65906us total) trans 4294967609 rc 0/0 00000100:00100000:3.0:1789760796.549875:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:3.0:1789760796.549885:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472672531134 time 472673312320 state 0x2 ref 0 00000100:00100000:1.0:1789760796.556240:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760796.556333:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777258624 00000100:00100000:0.0:1789760796.556355:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777258624 00000100:00100000:0.0:1789760796.556412:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472672531134 time 472673312320 state 0x0 ref 1 00000100:00100000:0.0:1789760796.556425:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472723312320 time 472673312320 state 0x1 ref 1 00000100:00100000:0.0:1789760796.556455:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472723312320 time 472740664225 state 0x0 ref 1 00000100:00100000:0.0:1789760796.556467:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777258624:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760796.556514:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 40894464, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x13809 00010000:00010000:0.0:1789760796.556524:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.556550:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1789760796.556555:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760796.556561:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.556575:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760796.603237:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967610 is committed 00002000:00010000:3.0:1789760796.603527:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:3.0:1789760796.603533:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 79881 -> 81929 00010000:00010000:3.0:1789760796.603549:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603572:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603599:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603607:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d30200 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.603612:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603622:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603643:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.603650:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f68f673/0xc2b9a3a73985898b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.603758:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777258624:12345-192.168.203.38@tcp:4:dd.500 Request processed in 47287us (47521us total) trans 4294967610 rc 0/0 00000100:00100000:3.0:1789760796.603768:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:3.0:1789760796.603778:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472723312320 time 472740664225 state 0x2 ref 0 00000100:00100000:0.0:1789760796.613921:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760796.614032:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777258752 00000100:00100000:2.0:1789760796.614043:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777258752 00000100:00100000:2.0:1789760796.614096:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472723312320 time 472740664225 state 0x0 ref 1 00000100:00100000:2.0:1789760796.614110:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472790664225 time 472740664225 state 0x1 ref 1 00000100:00100000:2.0:1789760796.614144:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472790664225 time 472798352641 state 0x0 ref 1 00000100:00100000:2.0:1789760796.614157:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777258752:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760796.614224:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 41943040, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x14009 00010000:00010000:2.0:1789760796.614233:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.614248:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1789760796.614253:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.614259:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.614272:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.677593:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967611 is committed 00002000:00010000:3.0:1789760796.677860:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:3.0:1789760796.677865:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 81929 -> 83977 00010000:00010000:3.0:1789760796.677881:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.677917:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.677928:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.677935:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.677940:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.677950:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.677972:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.677981:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a719abf9/0xc2b9a3a739858992 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.678193:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777258752:12345-192.168.203.38@tcp:4:dd.500 Request processed in 64033us (64278us total) trans 4294967611 rc 0/0 00000100:00100000:3.0:1789760796.678204:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:3.0:1789760796.678213:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472790664225 time 472798352641 state 0x2 ref 0 00000100:00100000:1.0:1789760796.692115:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760796.693961:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777258880 00000100:00100000:3.0:1789760796.693990:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777258880 00000100:00100000:3.0:1789760796.694050:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472790664225 time 472798352641 state 0x0 ref 1 00000100:00100000:3.0:1789760796.694065:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472848352641 time 472798352641 state 0x1 ref 1 00000100:00100000:3.0:1789760796.694089:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472848352641 time 472878298663 state 0x0 ref 1 00000100:00100000:3.0:1789760796.694105:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777258880:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760796.694150:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 42991616, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x14809 00010000:00010000:3.0:1789760796.694159:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.694174:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789760796.694179:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.694185:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.694198:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.762091:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967612 is committed 00002000:00010000:3.0:1789760796.762201:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:3.0:1789760796.762206:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 83977 -> 86025 00010000:00010000:3.0:1789760796.762220:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.762234:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.762260:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.762268:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.762273:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.762282:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.762302:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.762311:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a739858999 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.762428:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777258880:12345-192.168.203.38@tcp:4:dd.500 Request processed in 68323us (70319us total) trans 4294967612 rc 0/0 00000100:00100000:3.0:1789760796.762438:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:3.0:1789760796.762447:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472848352641 time 472878298663 state 0x2 ref 0 00000100:00100000:0.0:1789760796.779015:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1789760796.779077:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777259008 00000100:00100000:1.0:1789760796.779088:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777259008 00000100:00100000:1.0:1789760796.779212:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472848352641 time 472878298663 state 0x0 ref 1 00000100:00100000:1.0:1789760796.779226:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472928298663 time 472878298663 state 0x1 ref 1 00000100:00100000:1.0:1789760796.779257:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472928298663 time 472963465661 state 0x0 ref 1 00000100:00100000:1.0:1789760796.779270:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777259008:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:1.0:1789760796.779319:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 44040192, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x15009 00010000:00010000:1.0:1789760796.779482:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.779499:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1789760796.779504:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760796.779509:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760796.779659:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760796.845616:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967613 is committed 00002000:00010000:3.0:1789760796.845885:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:3.0:1789760796.845891:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 86025 -> 88073 00010000:00010000:3.0:1789760796.845988:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.846024:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.846035:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.846044:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f54f400 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760796.846049:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.846060:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.846087:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.846096:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005195596/0xc2b9a3a7398589a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.846267:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777259008:12345-192.168.203.38@tcp:4:dd.500 Request processed in 66994us (67255us total) trans 4294967613 rc 0/0 00000100:00100000:3.0:1789760796.846277:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:3.0:1789760796.846288:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472928298663 time 472963465661 state 0x2 ref 0 00000100:00100000:0.0:1789760796.855153:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760796.855258:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777259136 00000100:00100000:2.0:1789760796.855268:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777259136 00000100:00100000:2.0:1789760796.855326:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 472928298663 time 472963465661 state 0x0 ref 1 00000100:00100000:2.0:1789760796.855341:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473013465661 time 472963465661 state 0x1 ref 1 00000100:00100000:2.0:1789760796.855383:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473013465661 time 473039591174 state 0x0 ref 1 00000100:00100000:2.0:1789760796.855397:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777259136:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760796.855449:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 45088768, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x15809 00010000:00010000:2.0:1789760796.855459:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.855476:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789760796.855491:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.855499:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.855515:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760796.872278:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760796.872298:0:3464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e449344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798252416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789760796.872385:0:3464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760796.872456:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798252416 00000100:00100000:1.0:1789760796.872462:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798252416 00000100:00100000:1.0:1789760796.872508:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789760796.872518:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798252416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789760796.872551:0:6470:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789760796.872597:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3464:x1876699798252416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760796.872604:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789760796.872671:0:3464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e449344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3464:1876699798252416:0@lo:41:osp-pre-0-1.0 00002000:00010000:0.0:1789760796.931519:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:0.0:1789760796.931528:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 88073 -> 90121 00010000:00010000:0.0:1789760796.931543:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.931556:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.931564:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.931572:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760796.931586:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.931596:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.931616:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.931621:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7976ce/0xc2b9a3a7398589a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.931769:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777259136:12345-192.168.203.38@tcp:4:dd.500 Request processed in 76318us (76569us total) trans 4294967614 rc 0/0 00000100:00100000:0.0:1789760796.931777:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:0.0:1789760796.931812:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473013465661 time 473039591174 state 0x2 ref 0 00000001:00080000:0.0:1789760796.931849:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967614 is committed 00000100:00100000:2.0:1789760796.943436:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760796.943578:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777259264 00000100:00100000:3.0:1789760796.943599:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777259264 00000100:00100000:3.0:1789760796.943654:0:14781:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473013465661 time 473039591174 state 0x0 ref 1 00000100:00100000:3.0:1789760796.944910:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473089591174 time 473039591174 state 0x1 ref 1 00000100:00100000:3.0:1789760796.944949:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473089591174 time 473129157435 state 0x0 ref 1 00000100:00100000:3.0:1789760796.944969:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777259264:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760796.945280:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 46137344, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x16009 00010000:00010000:3.0:1789760796.945290:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.945306:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760796.945311:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.945318:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.945442:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760796.949693:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00000001:00080000:3.0:1789760796.949712:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000001:00080000:3.0:1789760796.950080:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967364 is committed 00000001:00080000:3.0:1789760796.950086:0:9084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00002000:00010000:3.0:1789760797.000447:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:3.0:1789760797.000456:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 90121 -> 92169 00010000:00010000:3.0:1789760797.000471:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.000505:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.000515:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.000523:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.000528:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.000537:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.000559:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.000567:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.000665:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2406:x1876699777259264:12345-192.168.203.38@tcp:4:dd.500 Request processed in 55699us (57233us total) trans 4294967615 rc 0/0 00000001:00080000:0.0:1789760797.000782:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967615 is committed 00000100:00100000:3.0:1789760797.002283:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1789760797.002297:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473089591174 time 473129157435 state 0x2 ref 0 00000100:00100000:2.0:1789760797.011040:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.011145:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777259392 00000100:00100000:3.0:1789760797.011170:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777259392 00000100:00100000:3.0:1789760797.011391:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473089591174 time 473129157435 state 0x0 ref 1 00000100:00100000:3.0:1789760797.011405:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473179157435 time 473129157435 state 0x1 ref 1 00000100:00100000:3.0:1789760797.011511:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473179157435 time 473195719109 state 0x0 ref 1 00000100:00100000:3.0:1789760797.011527:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777259392:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.011579:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 47185920, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x16809 00010000:00010000:3.0:1789760797.011589:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.011606:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760797.011612:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.011618:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.011633:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760797.012225:0:6461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760797.064470:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967616 is committed 00002000:00010000:3.0:1789760797.070145:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:3.0:1789760797.070156:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 92169 -> 94217 00010000:00010000:3.0:1789760797.070240:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.070255:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.070288:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.070296:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.070301:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.070311:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.070331:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.070339:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.070502:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777259392:12345-192.168.203.38@tcp:4:dd.500 Request processed in 58976us (59470us total) trans 4294967616 rc 0/0 00000100:00100000:3.0:1789760797.070512:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:3.0:1789760797.070522:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473179157435 time 473195719109 state 0x2 ref 0 00000100:00100000:0.0:1789760797.089096:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.089283:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777259520 00000100:00100000:3.0:1789760797.089293:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777259520 00000100:00100000:3.0:1789760797.089363:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473179157435 time 473195719109 state 0x0 ref 1 00000100:00100000:3.0:1789760797.089376:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473245719109 time 473195719109 state 0x1 ref 1 00000100:00100000:3.0:1789760797.089415:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473245719109 time 473273624198 state 0x0 ref 1 00000100:00100000:3.0:1789760797.089426:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777259520:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.089473:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 48234496, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x17009 00010000:00010000:3.0:1789760797.089482:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.089497:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760797.089502:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.089508:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.089523:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.143349:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967617 is committed 00002000:00010000:3.0:1789760797.143401:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789760797.143406:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 94217 -> 96265 00010000:00010000:3.0:1789760797.143420:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.143433:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.143442:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.143470:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.143475:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.143486:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.143509:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.143518:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.144084:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777259520:12345-192.168.203.38@tcp:4:dd.500 Request processed in 54653us (54989us total) trans 4294967617 rc 0/0 00000100:00100000:3.0:1789760797.144096:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:3.0:1789760797.144105:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473245719109 time 473273624198 state 0x2 ref 0 00000100:00100000:0.0:1789760797.150531:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.150755:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777259648 00000100:00100000:3.0:1789760797.150765:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777259648 00000100:00100000:3.0:1789760797.150852:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473245719109 time 473273624198 state 0x0 ref 1 00000100:00100000:3.0:1789760797.150865:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473323624198 time 473273624198 state 0x1 ref 1 00000100:00100000:3.0:1789760797.150942:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473323624198 time 473335150470 state 0x0 ref 1 00000100:00100000:3.0:1789760797.150970:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777259648:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.151016:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 49283072, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x17809 00010000:00010000:3.0:1789760797.151025:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.151038:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760797.151043:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.151049:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.151062:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760797.192969:0:6454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789760797.229354:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:3.0:1789760797.229364:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 96265 -> 98313 00010000:00010000:3.0:1789760797.229378:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.229390:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.229399:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.229406:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.229411:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.229434:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.229453:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.229461:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.229560:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2405:x1876699777259648:12345-192.168.203.38@tcp:4:dd.500 Request processed in 78588us (79032us total) trans 4294967618 rc 0/0 00000100:00100000:3.0:1789760797.229570:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:3.0:1789760797.229580:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473323624198 time 473335150470 state 0x2 ref 0 00000001:00080000:1.0:1789760797.230485:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967618 is committed 00000100:00100000:0.0:1789760797.244102:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.244197:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777259776 00000100:00100000:3.0:1789760797.244206:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777259776 00000100:00100000:3.0:1789760797.244261:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473323624198 time 473335150470 state 0x0 ref 1 00000100:00100000:3.0:1789760797.244274:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473385150470 time 473335150470 state 0x1 ref 1 00000100:00100000:3.0:1789760797.244304:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473385150470 time 473428513191 state 0x0 ref 1 00000100:00100000:3.0:1789760797.244316:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777259776:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.244375:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 50331648, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x18009 00010000:00010000:3.0:1789760797.244385:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.244414:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760797.244418:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.244424:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.244439:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760797.310251:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967619 is committed 00002000:00010000:3.0:1789760797.310526:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:3.0:1789760797.310531:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 98313 -> 100361 00010000:00010000:3.0:1789760797.310545:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.310557:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.310566:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.310573:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.310578:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.310587:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.310626:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.310778:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.310893:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777259776:12345-192.168.203.38@tcp:4:dd.500 Request processed in 66575us (66797us total) trans 4294967619 rc 0/0 00000100:00100000:3.0:1789760797.310902:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:3.0:1789760797.311044:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473385150470 time 473428513191 state 0x2 ref 0 00000100:00100000:2.0:1789760797.319882:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760797.320150:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777259904 00000100:00100000:0.0:1789760797.320159:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777259904 00000100:00100000:0.0:1789760797.320217:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473385150470 time 473428513191 state 0x0 ref 1 00000100:00100000:0.0:1789760797.320253:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473478513191 time 473428513191 state 0x1 ref 1 00000100:00100000:0.0:1789760797.320280:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473478513191 time 473504489493 state 0x0 ref 1 00000100:00100000:0.0:1789760797.320291:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777259904:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760797.320333:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 51380224, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x18809 00010000:00010000:0.0:1789760797.320350:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.320365:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1789760797.320369:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.320375:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.320390:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.382955:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760797.384717:0:3463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798252544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789760797.384822:0:3463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.384902:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798252544 00000100:00100000:0.0:1789760797.384909:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798252544 00000100:00100000:0.0:1789760797.384966:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789760797.384978:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798252544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789760797.385016:0:6471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760797.385075:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1876699798252544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.385089:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789760797.385240:0:3463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1876699798252544:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1789760797.393112:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967620 is committed 00002000:00010000:2.0:1789760797.393404:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:2.0:1789760797.393624:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 100361 -> 102409 00010000:00010000:2.0:1789760797.393644:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.393659:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.393670:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.393676:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760797.393688:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.393698:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.393736:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.393743:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2eace8b/0xc2b9a3a7398589d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.394434:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777259904:12345-192.168.203.38@tcp:4:dd.500 Request processed in 74137us (74553us total) trans 4294967620 rc 0/0 00000100:00100000:3.0:1789760797.394446:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:3.0:1789760797.394455:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473478513191 time 473504489493 state 0x2 ref 0 00000100:00100000:2.0:1789760797.414026:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.414113:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777260032 00000100:00100000:3.0:1789760797.414124:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777260032 00000100:00100000:3.0:1789760797.414179:0:14781:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473478513191 time 473504489493 state 0x0 ref 1 00000100:00100000:3.0:1789760797.414193:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473554489493 time 473504489493 state 0x1 ref 1 00000100:00100000:3.0:1789760797.414226:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473554489493 time 473598435540 state 0x0 ref 1 00000100:00100000:3.0:1789760797.414238:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777260032:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.414293:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 52428800, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x19009 00010000:00010000:3.0:1789760797.414302:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.414317:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760797.414321:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.414327:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.414341:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.470051:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967621 is committed 00002000:00010000:2.0:1789760797.470277:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:2.0:1789760797.470282:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 102409 -> 104459 00010000:00010000:2.0:1789760797.470295:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.470308:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.470316:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.470323:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760797.470328:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.470346:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.470365:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.470385:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e3fc0/0xc2b9a3a7398589d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.470476:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777260032:12345-192.168.203.38@tcp:4:dd.500 Request processed in 56236us (56455us total) trans 4294967621 rc 0/0 00000100:00100000:2.0:1789760797.470486:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:2.0:1789760797.470496:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473554489493 time 473598435540 state 0x2 ref 0 00000100:00100000:0.0:1789760797.488326:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.492063:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777260160 00000100:00100000:3.0:1789760797.492079:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777260160 00000100:00100000:2.0:1789760797.492254:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473554489493 time 473598435540 state 0x0 ref 1 00000100:00100000:2.0:1789760797.492268:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473648435540 time 473598435540 state 0x1 ref 1 00000100:00100000:2.0:1789760797.492302:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473648435540 time 473676512305 state 0x0 ref 1 00000100:00100000:2.0:1789760797.492318:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777260160:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760797.492363:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 53477376, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0x1980b 00010000:00010000:2.0:1789760797.492372:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.492386:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789760797.492391:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.492397:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.492411:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.543944:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967622 is committed 00002000:00010000:2.0:1789760797.544107:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:2.0:1789760797.544112:0:8118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789760796 -> 1789760797 00002000:00010000:2.0:1789760797.544114:0:8118:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789760796 -> 1789760797 00002000:00010000:2.0:1789760797.544117:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 104459 -> 106507 00010000:00010000:2.0:1789760797.544131:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.544205:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.544214:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.544221:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760797.544226:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.544234:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.544253:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.544261:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.545239:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e547f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777260160:12345-192.168.203.38@tcp:4:dd.500 Request processed in 52918us (57105us total) trans 4294967622 rc 0/0 00000100:00100000:2.0:1789760797.545250:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:2.0:1789760797.545259:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473648435540 time 473676512305 state 0x2 ref 0 00000100:00100000:1.0:1789760797.564357:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.564495:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777260288 00000100:00100000:3.0:1789760797.564505:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777260288 00000100:00100000:3.0:1789760797.564562:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473648435540 time 473676512305 state 0x0 ref 1 00000100:00100000:3.0:1789760797.564576:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473726512305 time 473676512305 state 0x1 ref 1 00000100:00100000:3.0:1789760797.564605:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473726512305 time 473748814557 state 0x0 ref 1 00000100:00100000:3.0:1789760797.564619:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777260288:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.564665:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 54525952, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1a00b 00010000:00010000:3.0:1789760797.564692:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.564719:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760797.564724:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.564731:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.564745:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.619472:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967623 is committed 00002000:00010000:3.0:1789760797.619546:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:3.0:1789760797.619552:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 106507 -> 108555 00010000:00010000:3.0:1789760797.619565:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.619579:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.619588:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.619596:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.619600:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.619609:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.619650:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.619658:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.619834:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777260288:12345-192.168.203.38@tcp:4:dd.500 Request processed in 55213us (55493us total) trans 4294967623 rc 0/0 00000100:00100000:3.0:1789760797.619844:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1789760797.619854:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473726512305 time 473748814557 state 0x2 ref 0 00000100:00100000:3.0:1789760797.626245:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760797.626361:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777260416 00000100:00100000:2.0:1789760797.626372:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777260416 00000100:00100000:2.0:1789760797.626427:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473726512305 time 473748814557 state 0x0 ref 1 00000100:00100000:2.0:1789760797.626441:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473798814557 time 473748814557 state 0x1 ref 1 00000100:00100000:2.0:1789760797.626473:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473798814557 time 473810682694 state 0x0 ref 1 00000100:00100000:2.0:1789760797.626486:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777260416:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760797.626537:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 55574528, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1a80b 00010000:00010000:2.0:1789760797.626547:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.626566:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789760797.626571:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.626578:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.626592:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.684262:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967624 is committed 00002000:00010000:2.0:1789760797.684299:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:2.0:1789760797.684304:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 108555 -> 110603 00010000:00010000:2.0:1789760797.684318:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.684332:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.684350:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.684357:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760797.684361:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.684371:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.684391:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.684399:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d04eb0/0xc2b9a3a7398589ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.684493:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777260416:12345-192.168.203.38@tcp:4:dd.500 Request processed in 58005us (58255us total) trans 4294967624 rc 0/0 00000100:00100000:2.0:1789760797.684520:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:2.0:1789760797.684530:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473798814557 time 473810682694 state 0x2 ref 0 00000100:00100000:1.0:1789760797.690899:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.691026:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777260544 00000100:00100000:3.0:1789760797.691035:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777260544 00000100:00100000:3.0:1789760797.691092:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473798814557 time 473810682694 state 0x0 ref 1 00000100:00100000:3.0:1789760797.691105:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473860682694 time 473810682694 state 0x1 ref 1 00000100:00100000:3.0:1789760797.691134:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473860682694 time 473875342740 state 0x0 ref 1 00000100:00100000:3.0:1789760797.691146:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777260544:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.691192:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 56623104, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1b00b 00010000:00010000:3.0:1789760797.691201:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.691234:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760797.691239:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.691246:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.691260:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760797.744733:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:3.0:1789760797.744742:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 110603 -> 112651 00010000:00010000:3.0:1789760797.744756:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.744769:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.744778:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.744805:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.744810:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.744818:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.744860:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.744869:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a7398589f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.744973:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777260544:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53824us (54081us total) trans 4294967625 rc 0/0 00000100:00100000:3.0:1789760797.744982:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:3.0:1789760797.744990:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473860682694 time 473875342740 state 0x2 ref 0 00000001:00080000:0.0:1789760797.749287:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967625 is committed 00000100:00100000:1.0:1789760797.751028:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.751102:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777260672 00000100:00100000:3.0:1789760797.751112:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777260672 00000100:00100000:3.0:1789760797.751179:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473860682694 time 473875342740 state 0x0 ref 1 00000100:00100000:3.0:1789760797.751194:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473925342740 time 473875342740 state 0x1 ref 1 00000100:00100000:3.0:1789760797.751221:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473925342740 time 473935430755 state 0x0 ref 1 00000100:00100000:3.0:1789760797.751235:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777260672:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.751281:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 57671680, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1b80b 00010000:00010000:3.0:1789760797.751291:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.751308:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789760797.751322:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.751329:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.751355:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760797.802715:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967626 is committed 00002000:00010000:2.0:1789760797.804100:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:2.0:1789760797.804106:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 112651 -> 114699 00010000:00010000:2.0:1789760797.804120:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.804131:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.804140:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.804147:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760797.804152:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.804161:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.804178:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.804185:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d20f366/0xc2b9a3a7398589fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.804325:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777260672:12345-192.168.203.38@tcp:4:dd.500 Request processed in 53087us (53299us total) trans 4294967626 rc 0/0 00000100:00100000:2.0:1789760797.804343:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1789760797.804354:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473925342740 time 473935430755 state 0x2 ref 0 00000100:00100000:1.0:1789760797.821289:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760797.821893:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777260800 00000100:00100000:3.0:1789760797.821903:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777260800 00000100:00100000:3.0:1789760797.821956:0:14781:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473925342740 time 473935430755 state 0x0 ref 1 00000100:00100000:3.0:1789760797.821971:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473985430755 time 473935430755 state 0x1 ref 1 00000100:00100000:3.0:1789760797.821992:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473985430755 time 474006201179 state 0x0 ref 1 00000100:00100000:3.0:1789760797.822005:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777260800:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760797.822054:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 58720256, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1c00b 00010000:00010000:3.0:1789760797.822064:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.822081:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1789760797.822086:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.822092:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.822110:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760797.873465:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967627 is committed 00002000:00010000:3.0:1789760797.873530:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:3.0:1789760797.873535:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 114699 -> 116747 00010000:00010000:3.0:1789760797.873550:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.873562:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.873570:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.873578:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.873583:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.873592:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.873613:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.873621:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.873743:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777260800:12345-192.168.203.38@tcp:4:dd.500 Request processed in 51737us (52459us total) trans 4294967627 rc 0/0 00000100:00100000:3.0:1789760797.873753:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1789760797.873761:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473985430755 time 474006201179 state 0x2 ref 0 00000100:00100000:1.0:1789760797.880460:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760797.880966:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777260928 00000100:00100000:2.0:1789760797.880975:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777260928 00000100:00100000:2.0:1789760797.881027:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 473985430755 time 474006201179 state 0x0 ref 1 00000100:00100000:2.0:1789760797.881041:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474056201179 time 474006201179 state 0x1 ref 1 00000100:00100000:2.0:1789760797.881105:0:8118:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474056201179 time 474065313721 state 0x0 ref 1 00000100:00100000:2.0:1789760797.881118:0:8118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777260928:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760797.881183:0:8118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 59768832, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1c80b 00010000:00010000:2.0:1789760797.881193:0:8118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.881210:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1789760797.881214:0:8118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760797.881221:0:8118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.881235:0:8118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760797.895240:0:8431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 474079449580ns, next at 475079447602ns, rc = 0 00000100:00100000:2.0:1789760797.895291:0:3461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798252672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760797.895368:0:3461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760797.895444:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798252672 00000100:00100000:2.0:1789760797.895451:0:8116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798252672 00000100:00100000:2.0:1789760797.895493:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789760797.895502:0:8116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798252672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789760797.895523:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 171900928 pending 1703936 free 3792699392 avail 3789553664 00000100:00100000:2.0:1789760797.895566:0:8116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1876699798252672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760797.895573:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789760797.895620:0:3461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3461:1876699798252672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789760797.895889:0:3462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff97e57ab2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798252800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760797.895916:0:3462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.895997:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699798252800 00000100:00100000:0.0:1789760797.896001:0:8115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699798252800 00000100:00100000:0.0:1789760797.896034:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789760797.896041:0:8115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798252800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760797.896052:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 171900928 pending 1703936 free 3792699392 avail 3789553664 00000100:00100000:0.0:1789760797.896085:0:8115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1876699798252800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.896091:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789760797.896433:0:3462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff97e57ab2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1876699798252800:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789760797.996021:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967628 is committed 00002000:00010000:3.0:1789760797.996076:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:3.0:1789760797.996081:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 116747 -> 118795 00010000:00010000:3.0:1789760797.996096:0:8118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.996110:0:8118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.996118:0:8118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.996125:0:8118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760797.996130:0:8118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.996138:0:8118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.996169:0:8118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.996190:0:8118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d770cb6c/0xc2b9a3a739858a09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.996288:0:8118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777260928:12345-192.168.203.38@tcp:4:dd.500 Request processed in 115168us (115835us total) trans 4294967628 rc 0/0 00000100:00100000:3.0:1789760797.996299:0:8118:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:3.0:1789760797.996309:0:8118:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474056201179 time 474065313721 state 0x2 ref 0 00000100:00100000:1.0:1789760798.002996:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760798.003132:0:13391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777261056 00000100:00100000:3.0:1789760798.003143:0:13391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777261056 00000100:00100000:3.0:1789760798.003267:0:13391:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474056201179 time 474065313721 state 0x0 ref 1 00000100:00100000:3.0:1789760798.003280:0:13391:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474115313721 time 474065313721 state 0x1 ref 1 00000100:00100000:3.0:1789760798.003311:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 474115313721 time 474187520485 state 0x0 ref 1 00000100:00100000:3.0:1789760798.003325:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261056:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760798.003479:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 60817408, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1d00b 00010000:00010000:3.0:1789760798.003489:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.003505:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1789760798.003510:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.003521:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.003555:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760798.044598:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967629 is committed 00002000:00010000:3.0:1789760798.044703:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:3.0:1789760798.044708:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 118795 -> 120843 00010000:00010000:3.0:1789760798.044723:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.044735:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.044744:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.044751:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:3.0:1789760798.044755:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.044764:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.044784:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.044815:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760798.044927:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261056:12345-192.168.203.38@tcp:4:dd.500 Request processed in 41600us (41935us total) trans 4294967629 rc 0/0 00000100:00100000:3.0:1789760798.044937:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:3.0:1789760798.044946:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 474115313721 time 474187520485 state 0x2 ref 0 00000100:00100000:3.0:1789760798.050901:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760798.051070:0:13388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777261184 00000100:00100000:2.0:1789760798.051081:0:13388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777261184 00000100:00100000:2.0:1789760798.051135:0:13388:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 474115313721 time 474187520485 state 0x0 ref 1 00000100:00100000:2.0:1789760798.051149:0:13388:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 1 deadline 474237520485 time 474187520485 state 0x1 ref 1 00000100:00100000:2.0:1789760798.051187:0:13388:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474237520485 time 474235396147 state 0x0 ref 1 00000100:00100000:2.0:1789760798.051201:0:13388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261184:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760798.051261:0:13388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 61865984, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1d80b 00010000:00010000:2.0:1789760798.051271:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.051286:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1789760798.051290:0:13388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.051297:0:13388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.051311:0:13388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760798.120831:0:13388:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:0.0:1789760798.120842:0:13388:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 120843 -> 122891 00010000:00010000:0.0:1789760798.120857:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.120870:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.120880:0:13388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.120888:0:13388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760798.120906:0:13388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.120916:0:13388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760798.120916:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967630 is committed 00010000:00010000:0.0:1789760798.120937:0:13388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.120945:0:13388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905e6db1/0xc2b9a3a739858a17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760798.121089:0:13388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261184:12345-192.168.203.38@tcp:4:dd.500 Request processed in 69886us (70304us total) trans 4294967630 rc 0/0 00000100:00100000:0.0:1789760798.121100:0:13388:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:0.0:1789760798.121110:0:13388:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474237520485 time 474235396147 state 0x2 ref 0 00000100:00100000:1.0:1789760798.126952:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760798.127259:0:13390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777261312 00000100:00100000:2.0:1789760798.127269:0:13390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777261312 00000100:00100000:2.0:1789760798.127329:0:13390:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474237520485 time 474235396147 state 0x0 ref 1 00000100:00100000:2.0:1789760798.127519:0:13390:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474285396147 time 474235396147 state 0x1 ref 1 00000100:00100000:2.0:1789760798.127551:0:13390:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474285396147 time 474311760177 state 0x0 ref 1 00000100:00100000:2.0:1789760798.127564:0:13390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777261312:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760798.128296:0:13390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 62914560, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1e00b 00010000:00010000:2.0:1789760798.128307:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.128323:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1789760798.128408:0:13390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.128415:0:13390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.128431:0:13390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760798.201632:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967631 is committed 00002000:00010000:0.0:1789760798.201864:0:13390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:0.0:1789760798.201869:0:13390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 122891 -> 124939 00010000:00010000:0.0:1789760798.201885:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.201898:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.201908:0:13390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.201934:0:13390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd01800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760798.201940:0:13390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.201950:0:13390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.201970:0:13390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.201979:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452e397c/0xc2b9a3a739858a1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760798.202079:0:13390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777261312:12345-192.168.203.38@tcp:4:dd.500 Request processed in 74513us (75131us total) trans 4294967631 rc 0/0 00000100:00100000:0.0:1789760798.202089:0:13390:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:0.0:1789760798.202100:0:13390:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474285396147 time 474311760177 state 0x2 ref 0 00000100:00100000:0.0:1789760798.212448:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760798.212540:0:13389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777261440 00000100:00100000:2.0:1789760798.212551:0:13389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777261440 00000100:00100000:2.0:1789760798.212602:0:13389:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474285396147 time 474311760177 state 0x0 ref 1 00000100:00100000:2.0:1789760798.212615:0:13389:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474361760177 time 474311760177 state 0x1 ref 1 00000100:00100000:2.0:1789760798.212644:0:13389:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474361760177 time 474396853752 state 0x0 ref 1 00000100:00100000:2.0:1789760798.212657:0:13389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2404:x1876699777261440:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:2.0:1789760798.212720:0:13389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 63963136, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1e80b 00010000:00010000:2.0:1789760798.212730:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.212746:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1789760798.212750:0:13389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.212756:0:13389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.212769:0:13389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.215186:0:7281:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789760798.275877:0:13389:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:2.0:1789760798.275886:0:13389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 124939 -> 126987 00010000:00010000:2.0:1789760798.275901:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.275913:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.275922:0:13389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.275930:0:13389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57fd00c00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760798.275935:0:13389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.275944:0:13389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.275969:0:13389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.275978:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea59fa5/0xc2b9a3a739858a25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.276077:0:13389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac82f857-edfe-4201-bbe8-4599ba569acb+7:2404:x1876699777261440:12345-192.168.203.38@tcp:4:dd.500 Request processed in 63418us (63634us total) trans 4294967632 rc 0/0 00000100:00100000:2.0:1789760798.276103:0:13389:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:2.0:1789760798.276113:0:13389:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474361760177 time 474396853752 state 0x2 ref 0 00000001:00080000:0.0:1789760798.276366:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967632 is committed 00000100:00100000:0.0:1789760798.292142:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760798.292194:0:14781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777261568 00000100:00100000:3.0:1789760798.292204:0:14781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777261568 00000100:00100000:3.0:1789760798.292264:0:14781:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474361760177 time 474396853752 state 0x0 ref 1 00000100:00100000:3.0:1789760798.292279:0:14781:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474446853752 time 474396853752 state 0x1 ref 1 00000100:00100000:3.0:1789760798.292314:0:14781:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474446853752 time 474476523303 state 0x0 ref 1 00000100:00100000:3.0:1789760798.292329:0:14781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777261568:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760798.292378:0:14781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 65011712, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1f00b 00010000:00010000:3.0:1789760798.292387:0:14781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.292403:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1789760798.292407:0:14781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.292413:0:14781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.292427:0:14781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760798.328270:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967633 is committed 00002000:00010000:2.0:1789760798.328366:0:14781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:2.0:1789760798.328371:0:14781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 126987 -> 129035 00010000:00010000:2.0:1789760798.328386:0:14781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.328398:0:14781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.328408:0:14781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.328415:0:14781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760798.328419:0:14781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.328428:0:14781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.328447:0:14781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.328455:0:14781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eaf852a/0xc2b9a3a739858a2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.328565:0:14781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2403:x1876699777261568:12345-192.168.203.38@tcp:4:dd.500 Request processed in 36235us (36429us total) trans 4294967633 rc 0/0 00000100:00100000:2.0:1789760798.328575:0:14781:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:2.0:1789760798.328584:0:14781:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474446853752 time 474476523303 state 0x2 ref 0 00000100:00100000:3.0:1789760798.335258:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1789760798.335403:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777261696 00000100:00100000:2.0:1789760798.335414:0:8118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777261696 00000100:00100000:2.0:1789760798.335478:0:8118:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474446853752 time 474476523303 state 0x0 ref 1 00000100:00100000:2.0:1789760798.335492:0:8118:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474526523303 time 474476523303 state 0x1 ref 1 00000100:00100000:3.0:1789760798.342485:0:13391:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474526523303 time 474526684971 state 0x0 ref 1 00000100:00100000:3.0:1789760798.342527:0:13391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ac16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261696:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760798.342583:0:13391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 66060288, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x1f80b 00010000:00010000:3.0:1789760798.342591:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.342607:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1789760798.342611:0:13391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.342617:0:13391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.342631:0:13391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760798.420362:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967634 is committed 00002000:00010000:1.0:1789760798.420396:0:13391:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:1.0:1789760798.420402:0:13391:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 129035 -> 131083 00010000:00010000:1.0:1789760798.420417:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.420431:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.420440:0:13391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.420449:0:13391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542800 already unused, calling callback (ffffffffc14af350) 00010000:00010000:1.0:1789760798.420454:0:13391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.420464:0:13391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.420484:0:13391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.420492:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e340b684/0xc2b9a3a739858a33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760798.420590:0:13391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ac16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261696:12345-192.168.203.38@tcp:4:dd.500 Request processed in 78075us (85337us total) trans 4294967634 rc 0/0 00000100:00100000:1.0:1789760798.420615:0:13391:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:1.0:1789760798.420625:0:13391:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474526523303 time 474526684971 state 0x2 ref 0 00000100:00100000:1.0:1789760798.428815:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760798.428996:0:13393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777261824 00000100:00100000:3.0:1789760798.429007:0:13393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777261824 00000100:00100000:3.0:1789760798.429076:0:13393:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474526523303 time 474526684971 state 0x0 ref 1 00000100:00100000:3.0:1789760798.429091:0:13393:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474576684971 time 474526684971 state 0x1 ref 1 00000100:00100000:3.0:1789760798.429122:0:13393:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474576684971 time 474613330116 state 0x0 ref 1 00000100:00100000:3.0:1789760798.429134:0:13393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261824:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760798.429203:0:13393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 67108864, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x2000b 00010000:00010000:3.0:1789760798.429213:0:13393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.429230:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1789760798.429234:0:13393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.429240:0:13393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.429255:0:13393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760798.475506:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967635 is committed 00002000:00010000:0.0:1789760798.475599:0:13393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:0.0:1789760798.475605:0:13393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 131083 -> 133131 00010000:00010000:0.0:1789760798.475621:0:13393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.475650:0:13393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.475659:0:13393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.475667:0:13393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f542e00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:0.0:1789760798.475671:0:13393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.475692:0:13393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.475713:0:13393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.475720:0:13393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f712f4a6/0xc2b9a3a739858a3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760798.475877:0:13393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261824:12345-192.168.203.38@tcp:4:dd.500 Request processed in 46739us (47088us total) trans 4294967635 rc 0/0 00000100:00100000:0.0:1789760798.475888:0:13393:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:0.0:1789760798.475900:0:13393:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474576684971 time 474613330116 state 0x2 ref 0 00000100:00100000:1.0:1789760798.489211:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760798.489276:0:13385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777261952 00000100:00100000:3.0:1789760798.489286:0:13385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777261952 00000100:00100000:3.0:1789760798.489349:0:13385:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474576684971 time 474613330116 state 0x0 ref 1 00000100:00100000:3.0:1789760798.489362:0:13385:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474663330116 time 474613330116 state 0x1 ref 1 00000100:00100000:3.0:1789760798.489392:0:13385:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474663330116 time 474673601740 state 0x0 ref 1 00000100:00100000:3.0:1789760798.489403:0:13385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e449346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261952:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760798.489450:0:13385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 68157440, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0x2080b 00010000:00010000:3.0:1789760798.489459:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.489475:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1789760798.489493:0:13385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.489499:0:13385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.489514:0:13385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760798.567127:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967636 is committed 00002000:00010000:2.0:1789760798.567234:0:13385:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:2.0:1789760798.567239:0:13385:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789760797 -> 1789760798 00002000:00010000:2.0:1789760798.567242:0:13385:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789760797 -> 1789760798 00002000:00010000:2.0:1789760798.567244:0:13385:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 133131 -> 135179 00010000:00010000:2.0:1789760798.567256:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.567269:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.567278:0:13385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.567286:0:13385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e57f543a00 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760798.567297:0:13385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.567307:0:13385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.567391:0:13385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.567400:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000986d1ec2/0xc2b9a3a739858a41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.567529:0:13385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e449346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777261952:12345-192.168.203.38@tcp:4:dd.500 Request processed in 78123us (78323us total) trans 4294967636 rc 0/0 00000100:00100000:2.0:1789760798.567539:0:13385:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:2.0:1789760798.567549:0:13385:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474663330116 time 474673601740 state 0x2 ref 0 00000100:00100000:2.0:1789760798.585900:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1789760798.585996:0:13392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777262080 00000100:00100000:0.0:1789760798.586007:0:13392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777262080 00000100:00100000:0.0:1789760798.586137:0:13392:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474663330116 time 474673601740 state 0x0 ref 1 00000100:00100000:0.0:1789760798.586151:0:13392:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474723601740 time 474673601740 state 0x1 ref 1 00000100:00100000:0.0:1789760798.586239:0:13392:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474723601740 time 474770447643 state 0x0 ref 1 00000100:00100000:0.0:1789760798.586253:0:13392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777262080:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:0.0:1789760798.586302:0:13392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 69206016, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x2100b 00010000:00010000:0.0:1789760798.586310:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.586427:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1789760798.586434:0:13392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760798.586440:0:13392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.586456:0:13392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760798.633067:0:8141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967637 is committed 00002000:00010000:2.0:1789760798.633277:0:13392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:2.0:1789760798.633282:0:13392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 135179 -> 137227 00010000:00010000:2.0:1789760798.633297:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.633310:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.633318:0:13392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.633356:0:13392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e542d31600 already unused, calling callback (ffffffffc14af350) 00010000:00010000:2.0:1789760798.633360:0:13392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.633370:0:13392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.633389:0:13392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.633398:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ace35e0/0xc2b9a3a739858a48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.633498:0:13392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e57ab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2405:x1876699777262080:12345-192.168.203.38@tcp:4:dd.500 Request processed in 47242us (47602us total) trans 4294967637 rc 0/0 00000100:00100000:2.0:1789760798.633508:0:13392:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:2.0:1789760798.633518:0:13392:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474723601740 time 474770447643 state 0x2 ref 0 00000100:00100000:2.0:1789760798.640592:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1789760798.640685:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699777262208 00000100:00100000:3.0:1789760798.640696:0:8119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699777262208 00000100:00100000:3.0:1789760798.640753:0:8119:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474723601740 time 474770447643 state 0x0 ref 1 00000100:00100000:3.0:1789760798.640766:0:8119:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474820447643 time 474770447643 state 0x1 ref 1 00000100:00100000:3.0:1789760798.640816:0:8119:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff97e57fcf3a00 key jobid={dd.500}&opcode={ost_write} rule@0xffff97e449966500 gen 0 rate 20 depth 3 token 0 deadline 474820447643 time 474825024308 state 0x0 ref 1 00000100:00100000:3.0:1789760798.640829:0:8119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e57ab36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac82f857-edfe-4201-bbe8-4599ba569acb+5:2406:x1876699777262208:12345-192.168.203.38@tcp:4:dd.500 00002000:00010000:3.0:1789760798.640874:0:8119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 70254592, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0x2180b 00010000:00010000:3.0:1789760798.640883:0:8119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858a4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.640898:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1789760798.640903:0:8119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.640908:0:8119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858a4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.640923:0:8119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3299f19/0xc2b9a3a739858a4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 Debug log: 46999 lines, 46999 kept, 0 dropped, 0 bad.